Appendix A Results of the Core Tracks and Domain-Specific Tracks Prepared by: Giorgio Maria Di Nunzio and Nicola Ferro Department of Information Engineering University of Padua A.1 A.2 Introduction A.3 A.4 Results for CLEF 2005 Core Tracks and Domain-Spicific Tracks The following pages contain the results for all valid experiments for the Ad-hoc and Domain-specific tasks that were officially submitted to the organizers of the CLEF 2005 campaign. This document is divided in three main parts: 1. List of submitted runs 2. Overview graphs 3. Individual results 1. List of submitted runs This section gives a listing of all runs and their characteristics: Participant: the name of the participant responsible for run. Country: country of participant. Run Tag unique identifier for each experiment. Task: track/task to which the experiment belongs. Topic language: language of the topics used to create the experiment (ISO identifiers for language). Query type: identifies the parts of the topics used to create the experiment (T = title, D = Description, N = Narrative). Run Type: type of experiment (automatic/manual). Pool: specifies if experiment was used for relevance assessment pooling. 2. Overview Graphs For each track/task two front-back pages are produced to compare the top experiments. The first page shows the best entries only for the mandatory title + description (TD) automatic run of at most top five paricipant. The second page shows the best entries among all runs (T/TD/TDN, automatic/manual) submitted of at most top five participants. The two pages contain the following information: - Front - Average precision vs Recall plot - R-Precision vs number of retrieved documents plot - Back - Comparison to median plot - A table with best/median/worst performance figures for each topic 3. Individual Results This section provides the individual results for each official experiments. Each experiment is presented in one page containing a set of tables and graphs: - Overall statistics and info - Interpolated recall vs Precision averages - Document cutoff levels vs Precision at DCL - Individual topic results A.5 A.6 List of Submitted Runs A.7 A.8 Participant Country Run Tag Task Topic Query Run Type Pool Lang. Type u.budapest Hungary qalltall AH-Monolingual-HU HU TD automatic yes u.budapest Hungary qfirststemtall AH-Monolingual-HU HU TD automatic yes u.budapest Hungary qfstfs AH-Monolingual-HU HU TD automatic yes u.budapest Hungary qnostemtall AH-Monolingual-HU HU TD automatic no u.budapest Hungary qnostemtfirsstem AH-Monolingual-HU HU TD automatic no u.budapest Hungary qnostemtnostem AH-Monolingual-HU HU TD automatic yes clips France CLIPS05DEFR AH-Bilingual-X2FR DE TDN automatic yes clips France CLIPS05DEFR0 AH-Bilingual-X2FR DE TD automatic no clips France CLIPS05EFR AH-Bilingual-X2FR ES TDN automatic no clips France CLIPS05ESFR0 AH-Bilingual-X2FR ES TD automatic no clips France CLIPS05FR0 AH-Monolingual-FR FR TD automatic no clips France CLIPS05FR1 AH-Monolingual-FR FR TDN automatic yes clips France CLIPS05FR2 AH-Monolingual-FR FR TDN automatic no cmu USA HBC1000test AH-Merging EN TD automatic no cmu USA HBC150test AH-Merging EN TD automatic no cmu USA HBT150w05test AH-Merging EN TD automatic no cmu USA HBT15w05test AH-Merging EN TD automatic no cmu USA UNEC1000test AH-Merging EN TD automatic no cmu USA UNEC150test AH-Merging EN TD automatic no cmu USA UNET150w05test AH-Merging EN TD automatic no cmu USA UNET15w05test AH-Merging EN TD automatic no cmu USA adhocM3Trntest AH-2-years-on EN TD automatic no cmu USA adhocM4Trntest AH-2-years-on EN TD automatic no cmu USA adhocM5Trntest AH-2-years-on EN TD automatic no cmu USA adhocM5w1test AH-2-years-on EN TD automatic no miracle Spain BGHT AH-Monolingual-BG BG TD automatic no miracle Spain ENMST AH-Bilingual-X2HU EN TD automatic no miracle Spain ENMxNP01ST1 AH-Bilingual-X2HU EN TD automatic yes miracle Spain ENSSR AH-Bilingual-X2PT EN TDN automatic no miracle Spain ENSST AH-Bilingual-X2FR EN TD automatic no miracle Spain ENSST AH-Bilingual-X2PT EN TD automatic no miracle Spain ENSxNP01HR1 AH-Bilingual-X2FR EN TDN automatic no miracle Spain ENSxNP01SR1 AH-Bilingual-X2FR EN TDN automatic no miracle Spain ENSxNP01SR1 AH-Bilingual-X2PT EN TDN automatic yes miracle Spain ENXHT AH-Bilingual-X2BG EN TD automatic yes miracle Spain ENXST AH-Bilingual-X2BG EN TD automatic yes miracle Spain ESASR AH-Bilingual-X2PT ES TDN automatic no miracle Spain ESAST AH-Bilingual-X2PT ES TD automatic no miracle Spain ESAxNP01SR1 AH-Bilingual-X2PT ES TDN automatic yes miracle Spain ESSST AH-Bilingual-X2FR ES TD automatic no miracle Spain ESSxNP01HR1 AH-Bilingual-X2FR ES TDN automatic no miracle Spain ESSxNP01SR1 AH-Bilingual-X2FR ES TDN automatic yes miracle Spain HUHT AH-Monolingual-HU HU TD automatic no miracle Spain SR AH-Monolingual-PT PT TDN automatic yes miracle Spain ST AH-Monolingual-BG BG TD automatic yes miracle Spain ST AH-Monolingual-PT PT TD automatic no miracle Spain aHRSR AH-Monolingual-FR FR TDN automatic no miracle Spain aHRSRxNP01HR1 AH-Monolingual-FR FR TDN automatic yes miracle Spain aHTST AH-Monolingual-FR FR TD automatic no miracle Spain aHTSTxNP01ST1 AH-Monolingual-HU HU TD automatic yes miracle Spain aSRr1SR AH-Monolingual-PT PT TDN automatic no miracle Spain enml0XSRpHL AH-2-years-on EN TDN automatic no miracle Spain enmlSTpH AH-2-years-on EN TD automatic no miracle Spain enmlSTpHL AH-2-years-on EN TD automatic no miracle Spain enmlXSRpA AH-2-years-on EN TDN automatic no miracle Spain esml9XnteSRp AH-2-years-on ES TDN automatic no A.9 Participant Country Run Tag Task Topic Query Run Type Pool Lang. Type miracle Spain esml9XstiSTp AH-2-years-on ES TD automatic no miracle Spain frml9XntfSRp AH-2-years-on FR TDN automatic no miracle Spain r1SR AH-Monolingual-BG BG TDN automatic yes miracle Spain xNP01SR1 AH-Monolingual-PT PT TDN automatic no miracle Spain xNP01ST1 AH-Monolingual-HU HU TD automatic yes miracle Spain xNP01r1SR1 AH-Monolingual-FR FR TDN automatic no dcu Ireland dcu.Prositqgm1 AH-Merging EN TD automatic no dcu Ireland dcu.Prositqgm2 AH-Merging EN TD automatic no dcu Ireland dcu.Prositqgp AH-Merging EN TD automatic no dcu Ireland dcu.Prositqgt AH-Merging EN TD automatic no dcu Ireland dcu.humm1 AH-Merging EN TD automatic no dcu Ireland dcu.humm2 AH-Merging EN TD automatic no dcu Ireland dcu.hump AH-Merging EN TD automatic no dcu Ireland dcu.humt AH-Merging EN TD automatic no cocri France RIMfuzzET020 AH-Monolingual-FR FR T manual no cocri France RIMfuzzET050 AH-Monolingual-FR FR T manual no cocri France RIMfuzzLemme050 AH-Monolingual-FR FR T manual yes cocri France RIMfuzzLemme080 AH-Monolingual-FR FR T manual no cocri France RIMfuzzTD050 AH-Monolingual-FR FR TD manual no hummingbird Canada humBG05t AH-Monolingual-BG BG T automatic yes hummingbird Canada humBG05td AH-Monolingual-BG BG TD automatic yes hummingbird Canada humBG05tde AH-Monolingual-BG BG TD automatic yes hummingbird Canada humFR05t AH-Monolingual-FR FR T automatic yes hummingbird Canada humFR05td AH-Monolingual-FR FR TD automatic no hummingbird Canada humFR05tde AH-Monolingual-FR FR TD automatic no hummingbird Canada humHU05t AH-Monolingual-HU HU T automatic yes hummingbird Canada humHU05td AH-Monolingual-HU HU TD automatic yes hummingbird Canada humHU05tde AH-Monolingual-HU HU TD automatic yes hummingbird Canada humPT05t AH-Monolingual-PT PT T automatic yes hummingbird Canada humPT05td AH-Monolingual-PT PT TD automatic no hummingbird Canada humPT05tde AH-Monolingual-PT PT TD automatic no irit France CWNSE_T DS-Monolingual-EN EN T automatic yes irit France CWNSE_TD DS-Monolingual-EN EN TD automatic yes irit France CWN_T DS-Monolingual-EN EN T automatic yes irit France CWN_TD DS-Monolingual-EN EN TD automatic yes irit France C_T DS-Monolingual-EN EN T automatic yes jhu/apl USA aplbienbga AH-Bilingual-X2BG EN TD automatic yes jhu/apl USA aplbienbge AH-Bilingual-X2BG EN TD automatic yes jhu/apl USA aplbienfrc AH-Bilingual-X2FR EN TD automatic yes jhu/apl USA aplbienhua AH-Bilingual-X2HU EN TD automatic yes jhu/apl USA aplbienhue AH-Bilingual-X2HU EN TD automatic no jhu/apl USA aplbienptb AH-Bilingual-X2PT EN TD automatic yes jhu/apl USA aplbiesptb AH-Bilingual-X2PT ES TD automatic no jhu/apl USA aplbigrena AH-Bilingual-X2EN GR TD automatic yes jhu/apl USA aplbihuena AH-Bilingual-X2EN HU TD automatic yes jhu/apl USA aplbiidena AH-Bilingual-X2EN ID TD automatic yes jhu/apl USA aplbiidend AH-Bilingual-X2EN ID TDN automatic no jhu/apl USA aplmobgc AH-Monolingual-BG BG TD automatic yes jhu/apl USA aplmobgd AH-Monolingual-BG BG TD automatic yes jhu/apl USA aplmobge AH-Monolingual-BG BG TD automatic no jhu/apl USA aplmofra AH-Monolingual-FR FR TD automatic yes jhu/apl USA aplmofrb AH-Monolingual-FR FR TD automatic no jhu/apl USA aplmofrc AH-Monolingual-FR FR TD automatic no jhu/apl USA aplmofre AH-Monolingual-FR FR TD automatic no jhu/apl USA aplmohuc AH-Monolingual-HU HU TD automatic yes jhu/apl USA aplmohud AH-Monolingual-HU HU TD automatic yes A.10 Participant Country Run Tag Task Topic Query Run Type Pool Lang. Type jhu/apl USA aplmohue AH-Monolingual-HU HU TD automatic no jhu/apl USA aplmopta AH-Monolingual-PT PT TD automatic no jhu/apl USA aplmoptc AH-Monolingual-PT PT TD automatic yes jhu/apl USA aplmoptd AH-Monolingual-PT PT TD automatic no jhu/apl USA aplmopte AH-Monolingual-PT PT TD automatic no msu-nivc Russia cirGHLAru2en AH-Bilingual-X2EN RU TDN automatic yes msu-nivc Russia cirGIRTen2en DS-Monolingual-EN EN TDN automatic yes msu-nivc Russia cirGIRTru2en DS-Bilingual-X2EN RU TDN automatic yes msu-nivc Russia cirRSSCen2ru DS-Bilingual-X2RU EN TDN automatic yes msu-nivc Russia cirRSSCru2ru DS-Monolingual-RU RU TDN automatic yes sics Sweden sics-fr-b AH-Monolingual-FR FR TD automatic yes sics Sweden sics-fr-k AH-Monolingual-FR FR TD automatic no sics Sweden sics-fr-van AH-Monolingual-FR FR TD automatic no tlr USA tlrTDfr2pt3 AH-Bilingual-X2PT FR TD automatic no tlr USA tlrTDfr2ptRFS1 AH-Bilingual-X2PT FR TD automatic yes tlr USA tlrTDfr3 AH-Monolingual-FR FR TD automatic no tlr USA tlrTDfrRFS1 AH-Monolingual-FR FR TD automatic yes tlr USA tlrTDhuE AH-Monolingual-HU HU TD automatic yes tlr USA tlrTDhuSC AH-Monolingual-HU HU TD automatic yes tlr USA tlrTDpt3 AH-Monolingual-PT PT TD automatic no tlr USA tlrTDptRF2 AH-Monolingual-PT PT TD automatic no tlr USA tlrTDptRFS1 AH-Monolingual-PT PT TD automatic yes alicante Spain IRn-bu-fexp AH-Monolingual-BG BG TD automatic yes alicante Spain IRn-bu-vexp AH-Monolingual-BG BG TD automatic yes alicante Spain IRn-bu-vnexp AH-Monolingual-BG BG TD automatic no alicante Spain IRn-enfr-fexp AH-Bilingual-X2FR EN TD automatic no alicante Spain IRn-enfr-vexp AH-Bilingual-X2FR EN TD automatic no alicante Spain IRn-enfr-vnexp AH-Bilingual-X2FR EN TD automatic no alicante Spain IRn-enpt-fexp AH-Bilingual-X2PT EN TD automatic no alicante Spain IRn-enpt-fexpfl AH-Bilingual-X2PT EN TD automatic yes alicante Spain IRn-enpt-vexp AH-Bilingual-X2PT EN TD automatic no alicante Spain IRn-enpt-vnexp AH-Bilingual-X2PT EN TD automatic no alicante Spain IRn-fr-fexp AH-Monolingual-FR FR TD automatic no alicante Spain IRn-fr-vexp AH-Monolingual-FR FR TD automatic yes alicante Spain IRn-fr-vnexp AH-Monolingual-FR FR TD automatic no alicante Spain IRn-hu-fexp AH-Monolingual-HU HU TD automatic yes alicante Spain IRn-hu-vexp AH-Monolingual-HU HU TD automatic yes alicante Spain IRn-hu-vnexp AH-Monolingual-HU HU TD automatic no alicante Spain IRn-pt-fexp AH-Monolingual-PT PT TD automatic no alicante Spain IRn-pt-vexp AH-Monolingual-PT PT TD automatic yes alicante Spain IRn-pt-vnexp AH-Monolingual-PT PT TD automatic no ilps Netherlands UAmsMoHu1AnH AH-Monolingual-HU HU TD automatic yes ilps Netherlands UAmsMoHu2AnG AH-Monolingual-HU HU TD automatic yes ilps Netherlands UAmsMoHu3AnL AH-Monolingual-HU HU TD automatic no ilps Netherlands UAmsMoHu4AnV AH-Monolingual-HU HU TD automatic no berkeley USA BERK1BLDEEN01 DS-Bilingual-X2EN DE TD automatic yes berkeley USA BERK1BLDERU01 DS-Bilingual-X2RU DE TD automatic yes berkeley USA BERK1BLENDE01 DS-Bilingual-X2DE EN TD automatic yes berkeley USA BERK1BLENRU01 DS-Bilingual-X2RU EN TD automatic yes berkeley USA BERK1BLRUDE01 DS-Bilingual-X2DE RU TD automatic yes berkeley USA BERK1BLRUEN01 DS-Bilingual-X2EN RU TD automatic yes berkeley USA BERK1MLDE01 DS-Monolingual-DE DE TD automatic yes berkeley USA BERK1MLEN01 DS-Monolingual-EN EN TD automatic yes berkeley USA BERK1MLRU01 DS-Monolingual-RU RU TD automatic yes berkeley USA BERK1MUDEALL01 DS-Multi DE TD automatic no berkeley USA BERK1MUENALL01 DS-Multi EN TD automatic no A.11 Participant Country Run Tag Task Topic Query Run Type Pool Lang. Type berkeley USA BERK1MURUALL01 DS-Multi RU TD automatic no berkeley-2 USA BK2GBLEG1 DS-Bilingual-X2DE EN TD automatic yes berkeley-2 USA BK2GBLEG2 DS-Bilingual-X2DE EN TD automatic yes berkeley-2 USA BK2GBLEG3 DS-Bilingual-X2DE EN TD automatic yes berkeley-2 USA BK2GBLEG4 DS-Bilingual-X2DE EN TD automatic yes berkeley-2 USA BK2GBLER1 DS-Bilingual-X2RU EN TD automatic yes berkeley-2 USA BK2GBLGE1 DS-Bilingual-X2EN DE TD automatic yes berkeley-2 USA BK2GBLGE2 DS-Bilingual-X2EN DE TD automatic yes berkeley-2 USA BK2GBLGE3 DS-Bilingual-X2EN DE TD automatic yes berkeley-2 USA BK2GBLGR1 DS-Bilingual-X2RU DE TD automatic yes berkeley-2 USA BK2GMLEE1 DS-Monolingual-EN EN TD automatic yes berkeley-2 USA BK2GMLEE2 DS-Monolingual-EN EN TD automatic yes berkeley-2 USA BK2GMLEE3 DS-Monolingual-EN EN TD automatic yes berkeley-2 USA BK2GMLGG1 DS-Monolingual-DE DE TD automatic yes berkeley-2 USA BK2GMLGG2 DS-Monolingual-DE DE TD automatic yes berkeley-2 USA BK2GMLGG3 DS-Monolingual-DE DE TD automatic yes berkeley-2 USA BK2GMLGG4 DS-Monolingual-DE DE TD automatic yes berkeley-2 USA BK2GMLRU1 DS-Monolingual-RU RU TD automatic yes berkeley-2 USA BK2GMLRU2 DS-Monolingual-RU RU TDN automatic yes buffalo USA UBbi-en-pt-comb1 AH-Bilingual-X2PT EN TD automatic yes buffalo USA UBbi-en-pt-comb2 AH-Bilingual-X2PT EN TD automatic no buffalo USA UBbi-en-pt-t1 AH-Bilingual-X2PT EN TD automatic no buffalo USA UBbi-en-pt-t2 AH-Bilingual-X2PT EN TD automatic no buffalo USA UBmono-pt-comb1 AH-Monolingual-PT PT TD automatic no buffalo USA UBmono-pt-rf1 AH-Monolingual-PT PT TD automatic yes buffalo USA UBmono-pt-rf2 AH-Monolingual-PT PT TD automatic no buffalo USA UBmono-pt-rf3 AH-Monolingual-PT PT TD automatic no isi-unige Switzerland ADJUSTDU AH-2-years-on NL TDN manual no isi-unige Switzerland ADJUSTEN AH-2-years-on EN TDN manual no isi-unige Switzerland ADJUSTFR AH-2-years-on FR TDN manual no isi-unige Switzerland ADJUSTSP AH-2-years-on ES TDN manual no isi-unige Switzerland AUTOEN AH-2-years-on EN TD automatic no isi-unige Switzerland FEEDBCKEN AH-2-years-on EN TDN manual no u.glasgow UK glabgtdn AH-Monolingual-BG BG TDN automatic yes u.glasgow UK glabgtdnqe AH-Monolingual-BG BG TDN automatic yes u.glasgow UK glabgtdqe AH-Monolingual-BG BG TD automatic no u.glasgow UK gladeentdn DS-Bilingual-X2EN DE TDN automatic yes u.glasgow UK gladeentdnqe DS-Bilingual-X2EN DE TDN automatic yes u.glasgow UK gladeentdqe DS-Bilingual-X2EN DE TD automatic yes u.glasgow UK gladetdn DS-Monolingual-DE DE TDN automatic yes u.glasgow UK gladetdqe DS-Monolingual-DE DE TD automatic yes u.glasgow UK glaenbgtd AH-Bilingual-X2BG EN TD automatic yes u.glasgow UK glaenbgtdn1 AH-Bilingual-X2BG EN TDN automatic yes u.glasgow UK glaenbgtdn2 AH-Bilingual-X2BG EN TDN automatic yes u.glasgow UK glaenbgtdnqe1 AH-Bilingual-X2BG EN TDN automatic no u.glasgow UK glaenbgtdnqe2 AH-Bilingual-X2BG EN TDN automatic no u.glasgow UK glaendetdn DS-Bilingual-X2DE EN TDN automatic yes u.glasgow UK glaendetdnqe DS-Bilingual-X2DE EN TDN automatic yes u.glasgow UK glaendetdqe DS-Bilingual-X2DE EN TD automatic yes u.glasgow UK glaentd DS-Monolingual-EN EN TD automatic yes u.glasgow UK glaentdnqe DS-Monolingual-EN EN TDN automatic yes u.glasgow UK glaespttd AH-Bilingual-X2PT ES TD automatic yes u.glasgow UK glaespttdn AH-Bilingual-X2PT ES TDN automatic yes u.glasgow UK glaespttdnqe AH-Bilingual-X2PT ES TDN automatic no u.glasgow UK glafrtdn AH-Monolingual-FR FR TDN automatic no u.glasgow UK glafrtdqe1 AH-Monolingual-FR FR TD automatic yes A.12 Participant Country Run Tag Task Topic Query Run Type Pool Lang. Type u.glasgow UK glafrtdqe2 AH-Monolingual-FR FR TD automatic no u.glasgow UK glagrentdn AH-Bilingual-X2EN GR TDN automatic yes u.glasgow UK glagrentdqe AH-Bilingual-X2EN GR TD automatic yes u.glasgow UK glahutdn AH-Monolingual-HU HU TDN automatic yes u.glasgow UK glahutdnqe AH-Monolingual-HU HU TDN automatic no u.glasgow UK glahutdqe AH-Monolingual-HU HU TD automatic yes u.glasgow UK glaitfrtd AH-Bilingual-X2FR IT TD automatic no u.glasgow UK glaitfrtdn AH-Bilingual-X2FR IT TDN automatic yes u.glasgow UK glaitfrtdnqe AH-Bilingual-X2FR IT TDN automatic no u.glasgow UK glapttdn AH-Monolingual-PT PT TDN automatic yes u.glasgow UK glapttdnqe AH-Monolingual-PT PT TDN automatic no u.glasgow UK glapttdqe AH-Monolingual-PT PT TD automatic no u.glasgow UK glaruentdn DS-Bilingual-X2EN RU TDN automatic yes u.glasgow UK glaruentdnqe DS-Bilingual-X2EN RU TDN automatic yes u.glasgow UK glaruentdqe DS-Bilingual-X2EN RU TD automatic yes u.glasgow UK glaruentdqeD DS-Bilingual-X2EN RU TD automatic yes u.glasgow UK glarutdqe DS-Monolingual-RU RU TD automatic yes hagen Germany FUHegfyyn DS-Bilingual-X2DE EN TD automatic yes hagen Germany FUHegpyyd DS-Bilingual-X2DE EN TD automatic yes hagen Germany FUHegpyyn DS-Bilingual-X2DE EN TD automatic yes hagen Germany FUHegsyyn DS-Bilingual-X2DE EN TD automatic yes hagen Germany FUHegwyyn DS-Bilingual-X2DE EN TD automatic yes hagen Germany FUHggynd DS-Monolingual-DE DE TD automatic yes hagen Germany FUHggynn DS-Monolingual-DE DE TD automatic yes hagen Germany FUHggyyd DS-Monolingual-DE DE TD automatic yes hagen Germany FUHggyydbf DS-Monolingual-DE DE TD automatic yes hagen Germany FUHggyyn DS-Monolingual-DE DE TD automatic yes hildesheim Germany UHIBG1 AH-Monolingual-BG BG TD automatic yes hildesheim Germany UHIBG2 AH-Monolingual-BG BG TD automatic yes hildesheim Germany UHIENFR1 AH-Bilingual-X2FR EN TD automatic no hildesheim Germany UHIENFR2 AH-Bilingual-X2FR EN TD automatic no hildesheim Germany UHIFR1 AH-Monolingual-FR FR TD automatic yes hildesheim Germany UHIFR2 AH-Monolingual-FR FR TD automatic no hildesheim Germany UHIFR3 AH-Monolingual-FR FR TD automatic no hildesheim Germany UHIFR4 AH-Monolingual-FR FR TD automatic no hildesheim Germany UHIGIRT1 DS-Monolingual-DE DE TD automatic yes hildesheim Germany UHIGIRT2 DS-Monolingual-DE DE TD automatic yes hildesheim Germany UHIGIRT3 DS-Bilingual-X2DE EN TD automatic yes hildesheim Germany UHIHU1 AH-Monolingual-HU HU TD automatic yes hildesheim Germany UHIHU2 AH-Monolingual-HU HU TD automatic yes hildesheim Germany UHIRUFR1 AH-Bilingual-X2FR RU TD automatic yes depok Indonesia UI-DESC10 AH-Bilingual-X2EN ID D automatic yes depok Indonesia UI-DESC20 AH-Bilingual-X2EN ID D automatic no depok Indonesia UI-TD10 AH-Bilingual-X2EN ID TD automatic yes depok Indonesia UI-TD20 AH-Bilingual-X2EN ID TD automatic no depok Indonesia UI-TITLE10 AH-Bilingual-X2EN ID T automatic no depok Indonesia UI-TITLE20 AH-Bilingual-X2EN ID T automatic yes jaen Spain UJAMENEDF AH-Merging EN TD automatic no jaen Spain UJAMENEDFRR AH-Merging EN TD automatic no jaen Spain UJAMENEOK AH-Merging EN TD automatic no jaen Spain UJAMENEOKRR AH-Merging EN TD automatic no jaen Spain UJAPRFRSV2RR AH-2-years-on EN TD automatic no jaen Spain UJARSV2 AH-2-years-on EN TD automatic no jaen Spain UJARSV2RR AH-2-years-on EN TD automatic no jaen Spain UJAUARSV2RR AH-2-years-on EN TD automatic no xldb Portugal XLDBTumba01 AH-Monolingual-PT PT TDN manual yes A.13 Participant Country Run Tag Task Topic Query Run Type Pool Lang. Type xldb Portugal XLDBTumba02 AH-Monolingual-PT PT TDN automatic no xldb Portugal XLDBTumba03 AH-Bilingual-X2PT EN TDN automatic yes xldb Portugal XLDBTumba04 AH-Bilingual-X2PT EN TDN automatic no xldb Portugal XLDBTumba05 AH-Monolingual-PT PT TDN manual yes xldb Portugal XLDBTumba06 AH-Monolingual-PT PT TDN automatic no xldb Portugal XLDBTumba07 AH-Bilingual-X2PT EN TDN automatic no xldb Portugal XLDBTumba08 AH-Bilingual-X2PT EN TDN automatic no xldb Portugal XLDBTumba09 AH-Monolingual-PT PT TD automatic no unine Switzerland UniNEbg1 AH-Monolingual-BG BG TD automatic yes unine Switzerland UniNEbg2 AH-Monolingual-BG BG TD automatic yes unine Switzerland UniNEbg3 AH-Monolingual-BG BG TD automatic no unine Switzerland UniNEbibg1 AH-Bilingual-X2BG EN TD automatic yes unine Switzerland UniNEbibg2 AH-Bilingual-X2BG EN TD automatic yes unine Switzerland UniNEbibg3 AH-Bilingual-X2BG EN TD automatic no unine Switzerland UniNEbifr1 AH-Bilingual-X2FR EN TD automatic yes unine Switzerland UniNEbifr2 AH-Bilingual-X2FR EN TD automatic no unine Switzerland UniNEbifr3 AH-Bilingual-X2FR EN TD automatic no unine Switzerland UniNEbihu1 AH-Bilingual-X2HU EN TD automatic yes unine Switzerland UniNEbihu2 AH-Bilingual-X2HU EN TD automatic no unine Switzerland UniNEbihu3 AH-Bilingual-X2HU EN TD automatic no unine Switzerland UniNEbipt1 AH-Bilingual-X2PT EN TD automatic yes unine Switzerland UniNEbipt2 AH-Bilingual-X2PT EN TD automatic no unine Switzerland UniNEbipt3 AH-Bilingual-X2PT EN TD automatic no unine Switzerland UniNEfr1 AH-Monolingual-FR FR TD automatic yes unine Switzerland UniNEfr2 AH-Monolingual-FR FR TD automatic no unine Switzerland UniNEfr3 AH-Monolingual-FR FR TD automatic no unine Switzerland UniNEgde1 DS-Monolingual-DE DE TD automatic yes unine Switzerland UniNEgde2 DS-Monolingual-DE DE TD automatic yes unine Switzerland UniNEgde3 DS-Monolingual-DE DE TD automatic yes unine Switzerland UniNEgen1 DS-Monolingual-EN EN TD automatic yes unine Switzerland UniNEgen2 DS-Monolingual-EN EN TD automatic yes unine Switzerland UniNEgen3 DS-Monolingual-EN EN TD automatic yes unine Switzerland UniNEgru1 DS-Monolingual-RU RU TD automatic yes unine Switzerland UniNEgru2 DS-Monolingual-RU RU TD automatic yes unine Switzerland UniNEgru3 DS-Monolingual-RU RU TD automatic yes unine Switzerland UniNEhu1 AH-Monolingual-HU HU TD automatic yes unine Switzerland UniNEhu2 AH-Monolingual-HU HU TD automatic yes unine Switzerland UniNEhu3 AH-Monolingual-HU HU TD automatic no unine Switzerland UniNEpt1 AH-Monolingual-PT PT TD automatic yes unine Switzerland UniNEpt2 AH-Monolingual-PT PT TD automatic no unine Switzerland UniNEpt3 AH-Monolingual-PT PT TD automatic no dsv-stockholm Sweden ds-am-fr-da-l AH-Bilingual-X2FR AM TD automatic yes dsv-stockholm Sweden ds-am-fr-da-s AH-Bilingual-X2FR AM TD automatic yes dsv-stockholm Sweden ds-am-fr-nonda-l AH-Bilingual-X2FR AM TD automatic no dsv-stockholm Sweden ds-am-fr-nonda-s AH-Bilingual-X2FR AM TD automatic no u.surugadai Japan SrgdDT05 AH-Bilingual-X2FR DE TD automatic no u.surugadai Japan SrgdMgE03 AH-Bilingual-X2FR DE TD automatic no u.surugadai Japan SrgdMgG02 AH-Bilingual-X2FR DE TD automatic yes u.surugadai Japan SrgdMono01 AH-Monolingual-FR FR TD automatic yes u.surugadai Japan SrgdQT04 AH-Bilingual-X2FR DE TD automatic no A.14 Overview Graphs A.15 A.16 Ad-Hoc Overview Graphs AH-2-years-on CLEF 2005 − Top 4 participants of Ad−Hoc Multilingual Multi−8 2−years−on − Interpolated Recall vs Average Precision 100% cmu [Avg. Prec. 44.93%; Run adhocM5Trntest, TD Auto, Not Pooled] jaen [Avg. Prec. 29.57%; Run UJAPRFRSV2RR, TD Auto, Not Pooled] 90% miracle [Avg. Prec. 26.06%; Run esml9XstiSTp, TD Auto, Not Pooled] isi−unige [Avg. Prec. 10.33%; Run AUTOEN, TD Auto, Not Pooled] 80% 70% Average Precision 60% 50% 40% 30% 20% 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 − Top 4 participants of Ad−Hoc Multilingual Multi−8 2−years−on − Retrieved documents vs Precision 100% cmu [Exact Prec. 46.55%, Run adhocM5Trntest, TD Auto, Not Pooled] jaen [Exact Prec. 33.85%, Run UJAPRFRSV2RR, TD Auto, Not Pooled] 90% miracle [Exact Prec. 30.50%, Run esml9XstiSTp, TD Auto, Not Pooled] isi−unige [Exact Prec. 16.29%, Run AUTOEN, TD Auto, Not Pooled] 80% 70% 60% R−Precision 50% 40% 30% 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) A.17 Ad-Hoc Overview Graphs AH-2-years-on CLEF 2005 − Top 4 participants of Ad−Hoc Multilingual Multi−8 2−years−on − Comparison to median by topic (topics 161 to 180) 1 cmu [Run adhocM5Trntest, TD Auto, Not Pooled] jaen [Run UJAPRFRSV2RR, TD Auto, Not Pooled] Difference (average precision) miracle [Run esml9XstiSTp, TD Auto, Not Pooled] 0.5 isi−unige [Run AUTOEN, TD Auto, Not Pooled] 0 −0.5 −1 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 Topic Number CLEF 2005 − Top 4 participants of Ad−Hoc Multilingual Multi−8 2−years−on − Comparison to median by topic (topics 181 to 200) 1 cmu [Run adhocM5Trntest, TD Auto, Not Pooled] jaen [Run UJAPRFRSV2RR, TD Auto, Not Pooled] Difference (average precision) miracle [Run esml9XstiSTp, TD Auto, Not Pooled] 0.5 isi−unige [Run AUTOEN, TD Auto, Not Pooled] 0 −0.5 −1 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 Topic Number # of Relevant Retrieved Docs @ 100 # of Relevant Retrieved Docs @ 1000 Average Precision % Topic ID Best Median Worst Best Median Worst Best Median Worst 161 9 5 0 13 7 1 45.11 24.04 00.01 162 97 66 2 243 196 4 85.84 45.85 00.78 163 88 68 11 258 204 106 75.30 40.13 09.04 164 41 13 2 123 53 3 10.08 01.58 00.02 165 18 13 3 22 15 7 43.67 33.45 03.20 166 3 0 0 13 6 0 01.02 00.23 00.00 167 21 17 7 24 21 18 55.20 35.84 12.02 168 48 26 5 156 110 37 25.61 13.32 01.11 169 4 2 0 20 10 0 02.77 00.73 00.00 170 23 14 0 25 23 1 67.67 21.45 00.01 171 23 10 1 61 34 1 14.97 03.72 01.01 172 13 6 2 29 17 8 13.08 04.86 00.28 173 25 22 3 28 23 3 67.98 56.13 02.89 174 79 62 17 91 79 17 85.74 66.60 14.79 175 19 13 3 23 18 4 66.86 26.56 05.48 176 99 93 47 259 256 47 92.21 82.72 16.29 177 36 19 3 75 53 3 35.71 16.21 00.50 178 46 15 0 75 37 1 22.23 04.00 00.00 179 75 39 5 320 159 19 61.63 13.79 04.54 180 78 49 8 312 218 15 54.46 26.26 00.65 181 93 84 7 667 541 13 39.02 30.00 00.24 182 49 35 2 74 68 2 59.60 40.85 00.20 183 33 25 2 69 54 2 36.71 20.06 00.48 184 63 42 3 124 81 3 45.23 24.93 01.21 185 19 11 0 36 27 0 25.76 13.75 00.00 186 74 32 0 235 116 0 52.09 11.86 00.00 187 72 30 18 130 79 19 66.21 19.98 08.88 188 36 30 0 54 43 0 56.81 36.23 00.00 189 30 27 2 30 28 2 75.91 60.57 05.78 190 49 22 0 132 66 3 25.72 07.41 00.01 191 1 1 0 1 1 0 100.00 25.00 00.00 192 90 50 6 163 98 41 78.95 29.55 08.10 193 49 31 4 147 118 31 29.56 16.57 03.01 194 24 11 0 24 15 0 64.67 22.58 00.00 195 38 19 0 65 39 3 38.74 14.67 00.08 196 33 30 2 40 33 2 73.78 57.55 03.75 197 94 90 27 681 539 27 59.71 42.87 02.84 198 13 8 1 26 15 1 22.09 09.06 01.43 199 84 78 32 297 280 32 74.95 65.58 05.70 200 70 47 1 196 106 19 44.49 17.45 00.15 A.18 Ad-Hoc Overview Graphs AH-2-years-on CLEF 2005 − Top 4 participants of Ad−Hoc Multilingual Multi−8 2−years−on − Interpolated Recall vs Average Precision 100% cmu [Avg. Prec. 44.93%; Run adhocM5Trntest, TD Auto, Not Pooled] miracle [Avg. Prec. 33.32%; Run frml9XntfSRp, TDN Auto, Not Pooled] 90% jaen [Avg. Prec. 29.57%; Run UJAPRFRSV2RR, TD Auto, Not Pooled] isi−unige [Avg. Prec. 21.02%; Run FEEDBCKEN, TDN Manual, Not Pooled] 80% 70% Average Precision 60% 50% 40% 30% 20% 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 − Top 4 participants of Ad−Hoc Multilingual Multi−8 2−years−on − Retrieved documents vs Precision 100% cmu [Exact Prec. 46.55%, Run adhocM5Trntest, TD Auto, Not Pooled] miracle [Exact Prec. 37.99%, Run frml9XntfSRp, TDN Auto, Not Pooled] 90% jaen [Exact Prec. 33.85%, Run UJAPRFRSV2RR, TD Auto, Not Pooled] isi−unige [Exact Prec. 27.41%, Run FEEDBCKEN, TDN Manual, Not Pooled] 80% 70% 60% R−Precision 50% 40% 30% 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) A.19 Ad-Hoc Overview Graphs AH-2-years-on CLEF 2005 − Top 4 participants of Ad−Hoc Multilingual Multi−8 2−years−on − Comparison to median by topic (topics 161 to 180) 1 cmu [Run adhocM5Trntest, TD Auto, Not Pooled] miracle [Run frml9XntfSRp, TDN Auto, Not Pooled] Difference (average precision) jaen [Run UJAPRFRSV2RR, TD Auto, Not Pooled] 0.5 isi−unige [Run FEEDBCKEN, TDN Manual, Not Pooled] 0 −0.5 −1 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 Topic Number CLEF 2005 − Top 4 participants of Ad−Hoc Multilingual Multi−8 2−years−on − Comparison to median by topic (topics 181 to 200) 1 cmu [Run adhocM5Trntest, TD Auto, Not Pooled] miracle [Run frml9XntfSRp, TDN Auto, Not Pooled] Difference (average precision) jaen [Run UJAPRFRSV2RR, TD Auto, Not Pooled] 0.5 isi−unige [Run FEEDBCKEN, TDN Manual, Not Pooled] 0 −0.5 −1 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 Topic Number A.20 Ad-Hoc Overview Graphs AH-Merging CLEF 2005 − Top 3 participants of Ad−Hoc Multilingual Multi−8 Merging − Interpolated Recall vs Average Precision 100% cmu [Avg. Prec. 41.19%; Run UNET150w05test, TD Auto] dcu [Avg. Prec. 32.86%; Run dcu.Prositqgm2, TD Auto] 90% jaen [Avg. Prec. 30.37%; Run UJAMENEDFRR, TD Auto] 80% 70% Average Precision 60% 50% 40% 30% 20% 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 − Top 3 participants of Ad−Hoc Multilingual Multi−8 Merging − Retrieved documents vs Precision 100% cmu [Exact Prec. 43.32%, Run UNET150w05test, TD Auto] dcu [Exact Prec. 36.25%, Run dcu.Prositqgm2, TD Auto] 90% jaen [Exact Prec. 35.24%, Run UJAMENEDFRR, TD Auto] 80% 70% 60% R−Precision 50% 40% 30% 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) A.21 Ad-Hoc Overview Graphs AH-Merging CLEF 2005 − Top 3 participants of Ad−Hoc Multilingual Multi−8 Merging − Comparison to median by topic (topics 161 to 180) 1 cmu [Run UNET150w05test, TD Auto] dcu [Run dcu.Prositqgm2, TD Auto] Difference (average precision) jaen [Run UJAMENEDFRR, TD Auto] 0.5 0 −0.5 −1 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 Topic Number CLEF 2005 − Top 3 participants of Ad−Hoc Multilingual Multi−8 Merging − Comparison to median by topic (topics 181 to 200) 1 cmu [Run UNET150w05test, TD Auto] dcu [Run dcu.Prositqgm2, TD Auto] Difference (average precision) jaen [Run UJAMENEDFRR, TD Auto] 0.5 0 −0.5 −1 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 Topic Number # of Relevant Retrieved Docs @ 100 # of Relevant Retrieved Docs @ 1000 Average Precision % Topic ID Best Median Worst Best Median Worst Best Median Worst 161 1 0 0 6 1 1 05.79 00.03 00.01 162 91 67 38 243 198 148 73.28 46.09 18.40 163 86 80 52 249 226 183 67.77 58.10 38.42 164 19 15 2 78 39 13 02.19 01.40 00.06 165 17 14 11 20 15 14 30.96 22.90 13.10 166 5 0 0 11 8 5 02.70 00.32 00.12 167 21 17 11 24 21 17 53.64 33.86 17.70 168 38 23 2 151 107 29 22.97 11.78 03.62 169 5 2 0 22 12 5 02.65 01.25 00.24 170 24 19 3 25 24 17 65.80 35.46 06.53 171 16 11 6 68 57 37 07.66 06.20 03.43 172 14 6 4 30 20 12 10.18 03.50 00.98 173 26 23 21 27 24 23 73.76 63.40 50.35 174 80 62 31 94 80 69 88.99 65.50 29.52 175 20 10 7 23 12 10 66.79 32.82 16.46 176 98 93 86 259 257 251 86.01 82.96 63.96 177 26 19 10 62 57 23 22.71 17.10 06.11 178 16 4 0 56 18 5 05.20 00.83 00.10 179 72 46 18 282 146 81 52.42 20.14 05.16 180 74 28 14 290 78 43 53.76 05.62 02.26 181 89 81 43 691 526 417 39.87 27.24 15.80 182 47 40 29 74 70 68 59.77 50.32 29.31 183 28 22 17 70 57 43 29.74 18.51 08.07 184 58 41 25 133 86 52 43.81 23.61 10.91 185 21 11 3 35 26 21 29.70 12.80 03.30 186 71 34 2 233 154 35 40.96 21.58 00.57 187 64 44 14 123 85 31 55.65 28.62 04.99 188 46 27 12 56 41 23 69.81 35.82 10.01 189 30 25 20 30 26 24 74.24 59.18 43.53 190 69 27 9 151 98 28 42.83 11.67 02.30 191 1 1 1 1 1 1 100.00 100.00 12.50 192 78 53 14 137 108 50 58.51 32.82 04.81 193 54 47 19 150 129 101 32.94 27.24 09.04 194 22 11 5 23 14 10 60.39 28.32 09.14 195 36 21 3 64 36 10 37.75 15.01 00.42 196 33 29 16 37 33 21 76.04 56.64 23.99 197 96 87 48 645 517 180 56.57 36.06 07.93 198 14 10 2 28 20 9 22.96 07.56 05.33 199 88 77 67 297 292 209 74.43 67.26 44.50 200 68 59 24 183 117 73 40.61 26.86 08.28 A.22 Ad-Hoc Overview Graphs AH-Merging CLEF 2005 − Top 3 participants of Ad−Hoc Multilingual Multi−8 Merging − Interpolated Recall vs Average Precision 100% cmu [Avg. Prec. 41.19%; Run UNET150w05test, TD Auto] dcu [Avg. Prec. 32.86%; Run dcu.Prositqgm2, TD Auto] 90% jaen [Avg. Prec. 30.37%; Run UJAMENEDFRR, TD Auto] 80% 70% Average Precision 60% 50% 40% 30% 20% 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 − Top 3 participants of Ad−Hoc Multilingual Multi−8 Merging − Retrieved documents vs Precision 100% cmu [Exact Prec. 43.32%, Run UNET150w05test, TD Auto] dcu [Exact Prec. 36.25%, Run dcu.Prositqgm2, TD Auto] 90% jaen [Exact Prec. 35.24%, Run UJAMENEDFRR, TD Auto] 80% 70% 60% R−Precision 50% 40% 30% 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) A.23 Ad-Hoc Overview Graphs AH-Merging CLEF 2005 − Top 3 participants of Ad−Hoc Multilingual Multi−8 Merging − Comparison to median by topic (topics 161 to 180) 1 cmu [Run UNET150w05test, TD Auto] dcu [Run dcu.Prositqgm2, TD Auto] Difference (average precision) jaen [Run UJAMENEDFRR, TD Auto] 0.5 0 −0.5 −1 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 Topic Number CLEF 2005 − Top 3 participants of Ad−Hoc Multilingual Multi−8 Merging − Comparison to median by topic (topics 181 to 200) 1 cmu [Run UNET150w05test, TD Auto] dcu [Run dcu.Prositqgm2, TD Auto] Difference (average precision) jaen [Run UJAMENEDFRR, TD Auto] 0.5 0 −0.5 −1 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 Topic Number A.24 Ad-Hoc Overview Graphs AH-Bilingual-X2BG CLEF 2005 − Top 4 participants of Ad−Hoc Bilingual X2BG − Interpolated Recall vs Average Precision 100% miracle [Avg. Prec. 23.55%; Run ENXST, TD Auto, Pooled] unine [Avg. Prec. 13.99%; Run UniNEbibg3, TD Auto, Not Pooled] 90% u.glasgow [Avg. Prec. 12.04%; Run glaenbgtd, TD Auto, Pooled] jhu−apl [Avg. Prec. 9.59%; Run aplbienbge, TD Auto, Pooled] 80% 70% Average Precision 60% 50% 40% 30% 20% 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 − Top 4 participants of Ad−Hoc Bilingual X2BG − Retrieved documents vs Precision 100% miracle [Exact Prec. 23.38%, Run ENXST, TD Auto, Pooled] unine [Exact Prec. 14.30%, Run UniNEbibg3, TD Auto, Not Pooled] 90% u.glasgow [Exact Prec. 13.36%, Run glaenbgtd, TD Auto, Pooled] jhu−apl [Exact Prec. 9.93%, Run aplbienbge, TD Auto, Pooled] 80% 70% 60% R−Precision 50% 40% 30% 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) A.25 Ad-Hoc Overview Graphs AH-Bilingual-X2BG CLEF 2005 − Top 4 participants of Ad−Hoc Bilingual X2BG − Comparison to median by topic (topics 251 to 275) 1 miracle [Run ENXST, TD Auto, Pooled] unine [Run UniNEbibg3, TD Auto, Not Pooled] Difference (average precision) u.glasgow [Run glaenbgtd, TD Auto, Pooled] 0.5 jhu−apl [Run aplbienbge, TD Auto, Pooled] 0 −0.5 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic Number CLEF 2005 − Top 4 participants of Ad−Hoc Bilingual X2BG − Comparison to median by topic (topics 276 to 300) 1 miracle [Run ENXST, TD Auto, Pooled] unine [Run UniNEbibg3, TD Auto, Not Pooled] Difference (average precision) u.glasgow [Run glaenbgtd, TD Auto, Pooled] 0.5 jhu−apl [Run aplbienbge, TD Auto, Pooled] 0 −0.5 −1 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number # of Relevant Retrieved Docs @ 100 # of Relevant Retrieved Docs @ 1000 Average Precision % Topic ID Best Median Worst Best Median Worst Best Median Worst 251 23 6 4 37 16 11 32.28 09.13 02.09 252 7 4 1 9 8 4 17.68 05.78 00.48 253 17 13 4 23 18 16 31.45 19.00 07.16 254 38 31 14 50 47 37 44.95 30.31 11.89 255 2 1 0 3 2 1 33.51 01.46 00.17 256 2 1 1 2 2 2 51.59 04.07 00.79 257 8 5 0 12 10 6 32.41 18.68 00.38 258 1 0 0 1 0 0 20.00 00.06 00.00 259 7 6 0 7 6 2 80.75 69.08 00.13 260 11 5 0 13 11 0 29.61 08.21 00.00 261 12 9 0 18 14 9 31.83 19.18 00.41 262 29 3 0 35 12 5 49.01 04.78 00.09 263 31 5 0 44 31 8 40.93 02.10 00.89 264 8 7 4 10 8 7 21.09 11.04 04.12 265 7 2 0 13 5 1 16.61 00.80 00.02 266 8 6 0 13 7 0 20.80 05.56 00.00 267 13 7 0 21 20 0 13.63 07.03 00.00 268 14 9 0 14 11 4 51.38 37.58 00.27 269 4 0 0 4 2 0 31.68 00.46 00.00 270 4 2 1 5 3 2 36.28 10.88 00.74 271 2 0 0 2 1 0 06.97 00.22 00.00 272 1 0 0 1 0 0 03.23 00.00 00.00 273 19 10 0 39 34 1 22.81 11.69 00.01 274 3 3 1 4 4 3 25.94 04.71 01.84 275 9 5 1 10 7 4 29.38 12.61 00.89 276 6 2 1 8 7 4 10.02 01.90 00.46 277 10 5 0 10 6 1 53.63 06.50 00.01 278 5 2 0 9 5 0 13.69 01.03 00.00 279 6 6 0 6 6 6 94.44 37.54 02.05 280 5 2 0 8 8 0 14.37 03.46 00.00 281 7 6 1 7 7 4 40.41 23.06 01.42 282 5 3 0 7 5 1 18.09 03.02 00.01 283 18 16 0 18 17 0 76.27 60.68 00.00 284 3 3 1 3 3 3 20.48 05.73 02.47 285 3 0 0 3 0 0 43.06 00.00 00.00 286 3 1 0 16 12 9 01.60 00.92 00.52 287 21 19 11 35 33 28 26.77 19.99 10.23 288 4 2 0 13 8 1 03.04 01.29 00.01 289 2 2 0 2 2 0 56.67 20.02 00.00 290 22 2 0 23 9 0 77.11 02.34 00.00 291 38 27 16 54 48 39 43.03 26.31 15.40 292 0 0 0 0 0 0 00.00 00.00 00.00 293 4 4 1 4 4 4 63.84 32.30 01.99 294 40 32 23 47 43 33 72.61 52.16 33.32 295 51 37 2 63 47 15 57.30 35.36 00.83 296 1 0 0 1 0 0 01.61 00.00 00.00 297 5 3 0 5 5 2 41.44 06.24 00.10 298 2 0 0 2 1 0 51.47 00.11 00.00 299 3 2 0 5 4 0 18.89 01.93 00.00 300 6 4 2 7 5 3 52.98 05.38 02.21 A.26 Ad-Hoc Overview Graphs AH-Bilingual-X2BG CLEF 2005 − Top 4 participants of Ad−Hoc Bilingual X2BG − Interpolated Recall vs Average Precision 100% miracle [Avg. Prec. 23.55%; Run ENXST, TD Auto, Pooled] u.glasgow [Avg. Prec. 17.99%; Run glaenbgtdnqe1, TDN Auto, Not Pooled] 90% unine [Avg. Prec. 13.99%; Run UniNEbibg3, TD Auto, Not Pooled] jhu−apl [Avg. Prec. 9.59%; Run aplbienbge, TD Auto, Pooled] 80% 70% Average Precision 60% 50% 40% 30% 20% 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 − Top 4 participants of Ad−Hoc Bilingual X2BG − Retrieved documents vs Precision 100% miracle [Exact Prec. 23.38%, Run ENXST, TD Auto, Pooled] u.glasgow [Exact Prec. 17.10%, Run glaenbgtdnqe1, TDN Auto, Not Pooled] 90% unine [Exact Prec. 14.30%, Run UniNEbibg3, TD Auto, Not Pooled] jhu−apl [Exact Prec. 9.93%, Run aplbienbge, TD Auto, Pooled] 80% 70% 60% R−Precision 50% 40% 30% 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) A.27 Ad-Hoc Overview Graphs AH-Bilingual-X2BG CLEF 2005 − Top 4 participants of Ad−Hoc Bilingual X2BG − Comparison to median by topic (topics 251 to 275) 1 miracle [Run ENXST, TD Auto, Pooled] u.glasgow [Run glaenbgtdnqe1, TDN Auto, Not Pooled] Difference (average precision) unine [Run UniNEbibg3, TD Auto, Not Pooled] 0.5 jhu−apl [Run aplbienbge, TD Auto, Pooled] 0 −0.5 −1 251252253254255256257258259260261262263264265266267268269270271272273274275 Topic Number CLEF 2005 − Top 4 participants of Ad−Hoc Bilingual X2BG − Comparison to median by topic (topics 276 to 300) 1 miracle [Run ENXST, TD Auto, Pooled] u.glasgow [Run glaenbgtdnqe1, TDN Auto, Not Pooled] Difference (average precision) unine [Run UniNEbibg3, TD Auto, Not Pooled] 0.5 jhu−apl [Run aplbienbge, TD Auto, Pooled] 0 −0.5 −1 276277278279280281282283284285286287288289290291292293294295296297298299300 Topic Number A.28 Ad-Hoc Overview Graphs AH-Bilingual-X2EN CLEF 2005 − Top 3 participants of Ad−Hoc Bilingual X2EN (only newcomers) − Interpolated Recall vs Average Precision 100% jhu−apl [Avg. Prec. 33.13%; Run aplbiidena, TD Auto, Pooled] u.glasgow [Avg. Prec. 29.35%; Run glagrentdqe, TD Auto, Pooled] 90% depok [Avg. Prec. 12.85%; Run UI−TD10, TD Auto, Pooled] 80% 70% Average Precision 60% 50% 40% 30% 20% 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 − Top 3 participants of Ad−Hoc Bilingual X2EN (only newcomers) − Retrieved documents vs Precision 100% jhu−apl [Exact Prec. 34.15%, Run aplbiidena, TD Auto, Pooled] u.glasgow [Exact Prec. 30.66%, Run glagrentdqe, TD Auto, Pooled] 90% depok [Exact Prec. 14.43%, Run UI−TD10, TD Auto, Pooled] 80% 70% 60% R−Precision 50% 40% 30% 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) A.29 Ad-Hoc Overview Graphs AH-Bilingual-X2EN CLEF 2005 − Top 3 participants of Ad−Hoc Bilingual X2EN (only newcomers) − Comparison to median by topic (topics 251 to 275) 1 jhu−apl [Run aplbiidena, TD Auto, Pooled] u.glasgow [Run glagrentdqe, TD Auto, Pooled] Difference (average precision) depok [Run UI−TD10, TD Auto, Pooled] 0.5 0 −0.5 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic Number CLEF 2005 − Top 3 participants of Ad−Hoc Bilingual X2EN (only newcomers) − Comparison to median by topic (topics 276 to 300) 1 jhu−apl [Run aplbiidena, TD Auto, Pooled] u.glasgow [Run glagrentdqe, TD Auto, Pooled] Difference (average precision) depok [Run UI−TD10, TD Auto, Pooled] 0.5 0 −0.5 −1 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number # of Relevant Retrieved Docs @ 100 # of Relevant Retrieved Docs @ 1000 Average Precision % Topic ID Best Median Worst Best Median Worst Best Median Worst 251 41 21 1 55 36 6 56.83 24.19 00.43 252 22 5 0 29 19 2 54.12 04.08 00.01 253 65 22 13 165 66 46 38.12 08.20 02.76 254 63 37 13 192 148 73 36.90 18.97 07.25 255 4 4 1 4 4 4 60.71 13.21 01.07 256 34 32 18 34 34 19 93.62 85.93 47.07 257 37 15 0 63 55 17 37.57 11.23 00.37 258 4 0 0 4 1 0 14.37 00.23 00.00 259 2 0 0 3 2 0 41.93 00.74 00.00 260 54 15 0 62 45 6 68.59 12.06 00.05 261 23 0 0 30 7 1 27.92 00.43 00.00 262 35 5 0 50 36 9 14.08 03.20 00.12 263 24 0 0 46 12 0 20.62 00.27 00.00 264 19 11 2 22 21 10 70.55 12.19 01.16 265 6 6 0 6 6 4 51.16 22.58 00.44 266 3 0 0 4 0 0 05.69 00.00 00.00 267 13 9 5 21 16 12 33.20 21.20 05.33 268 3 3 2 3 3 2 71.93 57.09 25.08 269 8 3 0 9 7 0 26.70 04.73 00.00 270 49 37 21 57 54 47 70.00 48.45 19.62 271 19 15 0 24 22 1 57.91 27.56 00.01 272 14 9 0 14 13 3 34.35 11.26 00.06 273 71 25 0 83 69 18 87.75 19.92 00.69 274 14 1 0 16 8 0 46.56 00.44 00.00 275 41 30 8 65 63 39 44.88 30.34 08.32 276 47 16 0 59 44 4 59.67 10.95 00.02 277 24 12 0 24 19 2 36.78 13.90 00.03 278 14 2 0 20 11 1 24.26 02.08 00.01 279 4 2 0 4 4 2 43.41 05.04 00.15 280 8 4 0 20 9 1 10.88 01.18 00.00 281 30 15 8 42 40 29 40.01 15.73 09.15 282 25 3 0 31 14 1 38.99 01.92 00.03 283 36 6 0 38 21 10 63.65 10.61 00.31 284 35 12 0 38 30 1 51.52 08.02 00.00 285 62 35 3 69 68 8 85.64 38.92 00.42 286 2 0 0 7 3 0 01.03 00.15 00.00 287 36 9 1 49 20 10 47.31 10.04 00.37 288 40 28 18 72 60 40 51.24 24.72 11.27 289 18 17 0 18 17 5 78.82 41.29 00.69 290 29 11 1 49 36 26 35.51 07.56 01.65 291 24 4 1 29 21 7 55.89 02.08 00.27 292 4 4 0 4 4 0 88.75 16.89 00.00 293 32 21 0 34 33 0 69.85 27.79 00.00 294 25 20 1 27 24 8 66.90 30.72 00.38 295 26 0 0 50 7 0 26.50 00.11 00.00 296 24 9 0 24 15 0 62.00 10.37 00.00 297 11 5 0 12 8 4 65.02 03.72 00.46 298 20 15 0 30 27 9 27.66 18.50 00.33 299 32 20 1 76 68 13 38.58 21.09 00.24 300 21 1 0 42 1 0 17.45 00.03 00.00 A.30 Ad-Hoc Overview Graphs AH-Bilingual-X2EN CLEF 2005 − Top 4 participants of Ad−Hoc Bilingual X2EN (only newcomers) − Interpolated Recall vs Average Precision 100% jhu−apl [Avg. Prec. 37.28%; Run aplbiidend, TDN Auto, Not Pooled] u.glasgow [Avg. Prec. 29.35%; Run glagrentdqe, TD Auto, Pooled] 90% msu−nivc [Avg. Prec. 22.82%; Run cirGHLAru2en, TDN Auto, Pooled] depok [Avg. Prec. 12.85%; Run UI−TD10, TD Auto, Pooled] 80% 70% Average Precision 60% 50% 40% 30% 20% 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 − Top 4 participants of Ad−Hoc Bilingual X2EN (only newcomers) − Retrieved documents vs Precision 100% jhu−apl [Exact Prec. 35.47%, Run aplbiidend, TDN Auto, Not Pooled] u.glasgow [Exact Prec. 30.66%, Run glagrentdqe, TD Auto, Pooled] 90% msu−nivc [Exact Prec. 26.05%, Run cirGHLAru2en, TDN Auto, Pooled] depok [Exact Prec. 14.43%, Run UI−TD10, TD Auto, Pooled] 80% 70% 60% R−Precision 50% 40% 30% 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) A.31 Ad-Hoc Overview Graphs AH-Bilingual-X2EN CLEF 2005 − Top 4 participants of Ad−Hoc Bilingual X2EN (only newcomers) − Comparison to median by topic (topics 251 to 275) 1 jhu−apl [Run aplbiidend, TDN Auto, Not Pooled] u.glasgow [Run glagrentdqe, TD Auto, Pooled] Difference (average precision) msu−nivc [Run cirGHLAru2en, TDN Auto, Pooled] 0.5 depok [Run UI−TD10, TD Auto, Pooled] 0 −0.5 −1 251252253254255256257258259260261262263264265266267268269270271272273274275 Topic Number CLEF 2005 − Top 4 participants of Ad−Hoc Bilingual X2EN (only newcomers) − Comparison to median by topic (topics 276 to 300) 1 jhu−apl [Run aplbiidend, TDN Auto, Not Pooled] u.glasgow [Run glagrentdqe, TD Auto, Pooled] Difference (average precision) msu−nivc [Run cirGHLAru2en, TDN Auto, Pooled] 0.5 depok [Run UI−TD10, TD Auto, Pooled] 0 −0.5 −1 276277278279280281282283284285286287288289290291292293294295296297298299300 Topic Number A.32 Ad-Hoc Overview Graphs AH-Bilingual-X2FR CLEF 2005 − Top 5 participants of Ad−Hoc Bilingual X2FR − Interpolated Recall vs Average Precision 100% alicante [Avg. Prec. 35.90%; Run IRn−enfr−vexp, TD Auto, Not Pooled] unine [Avg. Prec. 34.67%; Run UniNEbifr2, TD Auto, Not Pooled] 90% hildesheim [Avg. Prec. 34.65%; Run UHIENFR2, TD Auto, Not Pooled] jhu−apl [Avg. Prec. 34.42%; Run aplbienfrc, TD Auto, Pooled] miracle [Avg. Prec. 30.76%; Run ENSST, TD Auto, Not Pooled] 80% 70% Average Precision 60% 50% 40% 30% 20% 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 − Top 5 participants of Ad−Hoc Bilingual X2FR − Retrieved documents vs Precision 100% alicante [Exact Prec. 36.15%, Run IRn−enfr−vexp, TD Auto, Not Pooled] unine [Exact Prec. 36.02%, Run UniNEbifr2, TD Auto, Not Pooled] 90% hildesheim [Exact Prec. 36.54%, Run UHIENFR2, TD Auto, Not Pooled] jhu−apl [Exact Prec. 33.75%, Run aplbienfrc, TD Auto, Pooled] miracle [Exact Prec. 31.86%, Run ENSST, TD Auto, Not Pooled] 80% 70% 60% R−Precision 50% 40% 30% 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) A.33 Ad-Hoc Overview Graphs AH-Bilingual-X2FR CLEF 2005 − Top 5 participants of Ad−Hoc Bilingual X2FR − Comparison to median by topic (topics 251 to 275) 1 alicante [Run IRn−enfr−vexp, TD Auto, Not Pooled] unine [Run UniNEbifr2, TD Auto, Not Pooled] Difference (average precision) hildesheim [Run UHIENFR2, TD Auto, Not Pooled] 0.5 jhu−apl [Run aplbienfrc, TD Auto, Pooled] miracle [Run ENSST, TD Auto, Not Pooled] 0 −0.5 −1 251252253254255256257258259260261262263264265266267268269270271272273274275 Topic Number CLEF 2005 − Top 5 participants of Ad−Hoc Bilingual X2FR − Comparison to median by topic (topics 276 to 300) 1 alicante [Run IRn−enfr−vexp, TD Auto, Not Pooled] unine [Run UniNEbifr2, TD Auto, Not Pooled] Difference (average precision) hildesheim [Run UHIENFR2, TD Auto, Not Pooled] 0.5 jhu−apl [Run aplbienfrc, TD Auto, Pooled] miracle [Run ENSST, TD Auto, Not Pooled] 0 −0.5 −1 276277278279280281282283284285286287288289290291292293294295296297298299300 Topic Number # of Relevant Retrieved Docs @ 100 # of Relevant Retrieved Docs @ 1000 Average Precision % Topic ID Best Median Worst Best Median Worst Best Median Worst 251 23 12 2 35 23 8 38.68 13.10 01.20 252 19 9 0 24 18 0 27.61 06.94 00.00 253 81 18 0 163 74 0 63.83 12.58 00.00 254 77 61 8 176 168 35 69.75 52.91 02.04 255 1 1 0 1 1 0 50.00 01.22 00.00 256 9 9 0 9 9 2 91.65 77.13 00.11 257 27 12 0 71 55 0 18.75 08.49 00.00 258 2 0 0 2 1 0 25.98 00.06 00.00 259 11 9 0 11 11 0 51.97 25.60 00.00 260 54 13 0 71 31 0 58.46 13.95 00.00 261 5 0 0 5 2 0 56.02 00.08 00.00 262 3 0 0 6 5 0 23.02 00.68 00.00 263 18 10 0 21 20 2 44.21 18.03 00.02 264 74 54 1 95 92 1 80.28 58.70 00.04 265 26 21 0 33 33 5 43.47 21.28 00.09 266 15 2 0 20 6 1 15.50 00.78 00.00 267 24 16 0 25 25 0 47.03 20.54 00.00 268 6 6 0 6 6 1 67.23 22.68 00.07 269 36 22 0 83 66 7 38.05 18.73 00.06 270 53 44 1 62 60 5 66.92 56.32 00.07 271 33 30 0 34 34 5 88.21 70.14 00.07 272 12 9 0 13 13 2 26.26 12.02 00.06 273 66 49 0 116 105 4 65.32 43.70 00.02 274 20 17 1 21 20 3 80.96 61.14 00.23 275 55 30 0 73 53 3 69.32 30.80 00.03 276 20 13 0 29 23 0 28.88 13.89 00.00 277 18 15 0 18 18 1 67.29 43.04 00.01 278 16 3 0 18 10 0 66.66 04.24 00.00 279 13 9 0 43 35 0 10.39 06.31 00.00 280 26 16 0 43 39 1 37.61 18.04 00.01 281 36 28 0 43 43 7 58.77 32.67 00.10 282 10 3 0 17 10 0 11.54 02.64 00.00 283 37 27 0 40 37 0 77.11 45.91 00.00 284 56 39 0 67 67 0 70.49 38.73 00.00 285 66 49 0 99 90 0 65.43 44.52 00.00 286 5 1 0 8 6 0 28.10 01.53 00.00 287 68 37 4 149 128 9 57.18 27.31 00.15 288 16 7 0 27 20 1 20.34 06.06 00.05 289 24 6 0 24 7 0 75.87 17.83 00.00 290 34 9 0 39 31 3 53.72 09.56 00.03 291 43 15 0 71 50 4 37.93 07.05 00.04 292 10 3 0 10 8 0 32.16 04.47 00.00 293 81 73 0 121 120 0 78.54 69.43 00.00 294 29 22 0 32 28 3 69.20 62.81 00.05 295 51 28 0 75 61 5 52.79 26.35 00.09 296 27 22 0 27 27 1 43.35 24.41 00.01 297 40 30 0 50 40 0 64.42 43.61 00.00 298 59 38 0 135 123 1 50.53 28.95 00.00 299 16 5 0 53 23 1 15.83 01.78 00.00 300 16 13 0 23 18 0 20.72 09.55 00.00 A.34 Ad-Hoc Overview Graphs AH-Bilingual-X2FR CLEF 2005 − Top 5 participants of Ad−Hoc Bilingual X2FR − Interpolated Recall vs Average Precision 100% alicante [Avg. Prec. 35.90%; Run IRn−enfr−vexp, TD Auto, Not Pooled] unine [Avg. Prec. 34.67%; Run UniNEbifr2, TD Auto, Not Pooled] 90% hildesheim [Avg. Prec. 34.65%; Run UHIENFR2, TD Auto, Not Pooled] jhu−apl [Avg. Prec. 34.42%; Run aplbienfrc, TD Auto, Pooled] miracle [Avg. Prec. 31.34%; Run ESSxNP01SR1, TDN Auto, Pooled] 80% 70% Average Precision 60% 50% 40% 30% 20% 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 − Top 5 participants of Ad−Hoc Bilingual X2FR − Retrieved documents vs Precision 100% alicante [Exact Prec. 36.15%, Run IRn−enfr−vexp, TD Auto, Not Pooled] unine [Exact Prec. 36.02%, Run UniNEbifr2, TD Auto, Not Pooled] 90% hildesheim [Exact Prec. 36.54%, Run UHIENFR2, TD Auto, Not Pooled] jhu−apl [Exact Prec. 33.75%, Run aplbienfrc, TD Auto, Pooled] miracle [Exact Prec. 32.66%, Run ESSxNP01SR1, TDN Auto, Pooled] 80% 70% 60% R−Precision 50% 40% 30% 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) A.35 Ad-Hoc Overview Graphs AH-Bilingual-X2FR CLEF 2005 − Top 5 participants of Ad−Hoc Bilingual X2FR − Comparison to median by topic (topics 251 to 275) 1 alicante [Run IRn−enfr−vexp, TD Auto, Not Pooled] unine [Run UniNEbifr2, TD Auto, Not Pooled] Difference (average precision) hildesheim [Run UHIENFR2, TD Auto, Not Pooled] 0.5 jhu−apl [Run aplbienfrc, TD Auto, Pooled] miracle [Run ESSxNP01SR1, TDN Auto, Pooled] 0 −0.5 −1 251252253254255256257258259260261262263264265266267268269270271272273274275 Topic Number CLEF 2005 − Top 5 participants of Ad−Hoc Bilingual X2FR − Comparison to median by topic (topics 276 to 300) 1 alicante [Run IRn−enfr−vexp, TD Auto, Not Pooled] unine [Run UniNEbifr2, TD Auto, Not Pooled] Difference (average precision) hildesheim [Run UHIENFR2, TD Auto, Not Pooled] 0.5 jhu−apl [Run aplbienfrc, TD Auto, Pooled] miracle [Run ESSxNP01SR1, TDN Auto, Pooled] 0 −0.5 −1 276277278279280281282283284285286287288289290291292293294295296297298299300 Topic Number A.36 Ad-Hoc Overview Graphs AH-Bilingual-X2HU CLEF 2005 − Top 3 participants of Ad−Hoc Bilingual X2HU − Interpolated Recall vs Average Precision 100% miracle [Avg. Prec. 30.16%; Run ENMST, TD Auto, Not Pooled] unine [Avg. Prec. 28.82%; Run UniNEbihu3, TD Auto, Not Pooled] 90% jhu−apl [Avg. Prec. 24.58%; Run aplbienhue, TD Auto, Not Pooled] 80% 70% Average Precision 60% 50% 40% 30% 20% 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 − Top 3 participants of Ad−Hoc Bilingual X2HU − Retrieved documents vs Precision 100% miracle [Exact Prec. 28.61%, Run ENMST, TD Auto, Not Pooled] unine [Exact Prec. 27.89%, Run UniNEbihu3, TD Auto, Not Pooled] 90% jhu−apl [Exact Prec. 24.37%, Run aplbienhue, TD Auto, Not Pooled] 80% 70% 60% R−Precision 50% 40% 30% 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) A.37 Ad-Hoc Overview Graphs AH-Bilingual-X2HU CLEF 2005 − Top 3 participants of Ad−Hoc Bilingual X2HU − Comparison to median by topic (topics 251 to 275) 1 miracle [Run ENMST, TD Auto, Not Pooled] unine [Run UniNEbihu3, TD Auto, Not Pooled] Difference (average precision) jhu−apl [Run aplbienhue, TD Auto, Not Pooled] 0.5 0 −0.5 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic Number CLEF 2005 − Top 3 participants of Ad−Hoc Bilingual X2HU − Comparison to median by topic (topics 276 to 300) 1 miracle [Run ENMST, TD Auto, Not Pooled] unine [Run UniNEbihu3, TD Auto, Not Pooled] Difference (average precision) jhu−apl [Run aplbienhue, TD Auto, Not Pooled] 0.5 0 −0.5 −1 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number # of Relevant Retrieved Docs @ 100 # of Relevant Retrieved Docs @ 1000 Average Precision % Topic ID Best Median Worst Best Median Worst Best Median Worst 251 20 10 7 27 22 16 38.21 12.20 05.16 252 17 15 8 20 20 18 38.29 18.75 12.72 253 34 32 26 38 37 35 46.60 43.75 36.26 254 24 24 23 24 24 24 67.45 47.52 44.98 255 6 3 2 6 6 4 51.81 34.26 10.79 256 9 9 9 10 10 9 83.96 81.04 73.46 257 12 8 4 13 13 6 25.88 11.56 06.87 258 0 0 0 2 1 0 00.29 00.04 00.00 259 3 1 0 4 4 4 42.52 03.27 00.65 260 5 0 0 5 1 0 10.85 00.02 00.00 261 2 0 0 3 2 0 40.74 00.57 00.00 262 6 3 0 11 9 0 06.30 03.01 00.00 263 13 1 0 20 11 3 23.48 00.66 00.04 264 3 2 2 5 3 3 40.36 12.58 06.53 265 11 5 2 13 13 13 39.55 12.41 03.03 266 18 12 7 30 28 25 24.21 17.41 05.05 267 7 6 3 7 7 7 57.53 41.96 03.80 268 15 12 4 15 14 9 52.79 25.91 03.69 269 4 2 1 8 7 3 04.40 00.85 00.26 270 16 9 0 21 21 0 36.66 27.51 00.00 271 9 8 6 9 9 9 32.06 25.34 14.84 272 1 1 1 1 1 1 33.33 14.29 07.69 273 12 8 2 26 24 8 20.24 08.10 00.48 274 20 9 6 20 15 9 71.50 18.36 07.67 275 2 1 1 2 2 1 83.33 17.50 00.64 276 25 19 13 41 40 37 26.39 18.00 09.75 277 13 7 4 13 13 9 53.46 16.68 07.37 278 8 0 0 10 1 0 38.81 00.01 00.00 279 9 8 4 9 9 8 78.56 30.30 06.54 280 12 6 4 17 17 15 33.75 06.29 05.15 281 26 26 26 26 26 26 96.72 95.60 85.13 282 8 3 2 11 10 4 21.91 06.52 01.48 283 9 9 0 9 9 1 57.76 33.44 00.02 284 8 0 0 9 8 0 23.11 00.68 00.00 285 10 0 0 10 2 0 50.70 00.11 00.00 286 12 5 2 41 38 34 04.36 02.59 02.06 287 52 48 35 66 61 57 74.38 67.19 42.97 288 13 11 0 27 18 3 09.77 05.70 00.04 289 8 8 8 8 8 8 100.00 98.61 94.72 290 67 60 33 87 84 63 69.49 61.46 32.27 291 41 39 34 47 45 43 67.58 57.75 55.18 292 2 2 1 2 2 2 51.85 51.01 50.21 293 35 31 17 37 36 36 84.17 60.59 13.92 294 4 4 3 4 4 4 95.00 43.94 07.52 295 8 8 0 8 8 2 15.07 12.15 00.05 296 22 12 4 25 25 18 33.79 11.57 02.62 297 7 6 5 8 8 7 65.58 59.58 22.26 298 9 3 0 19 8 5 12.99 01.33 00.25 299 2 0 0 3 0 0 30.23 00.00 00.00 300 5 3 1 9 8 7 09.99 03.66 01.88 A.38 Ad-Hoc Overview Graphs AH-Bilingual-X2HU CLEF 2005 − Top 3 participants of Ad−Hoc Bilingual X2HU − Interpolated Recall vs Average Precision 100% miracle [Avg. Prec. 30.16%; Run ENMST, TD Auto, Not Pooled] unine [Avg. Prec. 28.82%; Run UniNEbihu3, TD Auto, Not Pooled] 90% jhu−apl [Avg. Prec. 24.58%; Run aplbienhue, TD Auto, Not Pooled] 80% 70% Average Precision 60% 50% 40% 30% 20% 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 − Top 3 participants of Ad−Hoc Bilingual X2HU − Retrieved documents vs Precision 100% miracle [Exact Prec. 28.61%, Run ENMST, TD Auto, Not Pooled] unine [Exact Prec. 27.89%, Run UniNEbihu3, TD Auto, Not Pooled] 90% jhu−apl [Exact Prec. 24.37%, Run aplbienhue, TD Auto, Not Pooled] 80% 70% 60% R−Precision 50% 40% 30% 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) A.39 Ad-Hoc Overview Graphs AH-Bilingual-X2HU CLEF 2005 − Top 3 participants of Ad−Hoc Bilingual X2HU − Comparison to median by topic (topics 251 to 275) 1 miracle [Run ENMST, TD Auto, Not Pooled] unine [Run UniNEbihu3, TD Auto, Not Pooled] Difference (average precision) jhu−apl [Run aplbienhue, TD Auto, Not Pooled] 0.5 0 −0.5 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic Number CLEF 2005 − Top 3 participants of Ad−Hoc Bilingual X2HU − Comparison to median by topic (topics 276 to 300) 1 miracle [Run ENMST, TD Auto, Not Pooled] unine [Run UniNEbihu3, TD Auto, Not Pooled] Difference (average precision) jhu−apl [Run aplbienhue, TD Auto, Not Pooled] 0.5 0 −0.5 −1 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.40 Ad-Hoc Overview Graphs AH-Bilingual-X2PT CLEF 2005 − Top 5 participants of Ad−Hoc Bilingual X2PT − Interpolated Recall vs Average Precision 100% unine [Avg. Prec. 34.04%; Run UniNEbipt1, TD Auto, Pooled] jhu−apl [Avg. Prec. 31.85%; Run aplbiesptb, TD Auto, Not Pooled] 90% miracle [Avg. Prec. 31.06%; Run ESAST, TD Auto, Not Pooled] alicante [Avg. Prec. 29.18%; Run IRn−enpt−vexp, TD Auto, Not Pooled] tlr [Avg. Prec. 23.58%; Run tlrTDfr2ptRFS1, TD Auto, Pooled] 80% 70% Average Precision 60% 50% 40% 30% 20% 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 − Top 5 participants of Ad−Hoc Bilingual X2PT − Retrieved documents vs Precision 100% unine [Exact Prec. 34.26%, Run UniNEbipt1, TD Auto, Pooled] jhu−apl [Exact Prec. 34.11%, Run aplbiesptb, TD Auto, Not Pooled] 90% miracle [Exact Prec. 33.53%, Run ESAST, TD Auto, Not Pooled] alicante [Exact Prec. 31.38%, Run IRn−enpt−vexp, TD Auto, Not Pooled] tlr [Exact Prec. 26.89%, Run tlrTDfr2ptRFS1, TD Auto, Pooled] 80% 70% 60% R−Precision 50% 40% 30% 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) A.41 Ad-Hoc Overview Graphs AH-Bilingual-X2PT CLEF 2005 − Top 5 participants of Ad−Hoc Bilingual X2PT − Comparison to median by topic (topics 251 to 275) 1 unine [Run UniNEbipt1, TD Auto, Pooled] jhu−apl [Run aplbiesptb, TD Auto, Not Pooled] Difference (average precision) miracle [Run ESAST, TD Auto, Not Pooled] 0.5 alicante [Run IRn−enpt−vexp, TD Auto, Not Pooled] tlr [Run tlrTDfr2ptRFS1, TD Auto, Pooled] 0 −0.5 −1 251252253254255256257258259260261262263264265266267268269270271272273274275 Topic Number CLEF 2005 − Top 5 participants of Ad−Hoc Bilingual X2PT − Comparison to median by topic (topics 276 to 300) 1 unine [Run UniNEbipt1, TD Auto, Pooled] jhu−apl [Run aplbiesptb, TD Auto, Not Pooled] Difference (average precision) miracle [Run ESAST, TD Auto, Not Pooled] 0.5 alicante [Run IRn−enpt−vexp, TD Auto, Not Pooled] tlr [Run tlrTDfr2ptRFS1, TD Auto, Pooled] 0 −0.5 −1 276277278279280281282283284285286287288289290291292293294295296297298299300 Topic Number # of Relevant Retrieved Docs @ 100 # of Relevant Retrieved Docs @ 1000 Average Precision % Topic ID Best Median Worst Best Median Worst Best Median Worst 251 43 27 18 64 51 19 58.50 29.53 15.86 252 28 4 0 40 26 0 47.99 03.25 00.00 253 50 15 1 122 49 2 35.99 03.92 00.01 254 68 56 14 125 79 14 66.46 41.86 05.76 255 5 3 0 6 6 0 45.63 23.47 00.00 256 12 12 0 12 12 0 100.00 94.06 00.00 257 27 19 0 55 45 0 25.88 14.42 00.00 258 1 0 0 1 1 0 16.67 00.33 00.00 259 17 15 0 17 17 0 53.47 35.32 00.00 260 55 41 0 88 78 0 56.75 40.75 00.00 261 17 0 0 22 1 0 27.72 00.04 00.00 262 9 1 0 18 5 0 12.14 00.49 00.00 263 22 5 0 59 17 0 21.16 02.86 00.00 264 34 20 0 43 34 0 63.54 23.64 00.00 265 23 15 0 26 24 0 31.48 20.96 00.00 266 52 25 0 87 73 0 52.12 27.49 00.00 267 29 9 0 59 34 0 28.01 13.35 00.00 268 7 4 0 7 7 0 55.94 19.01 00.00 269 19 10 0 39 29 0 13.94 05.78 00.00 270 25 20 0 41 41 0 35.54 22.40 00.00 271 35 15 0 40 29 0 73.59 33.83 00.00 272 17 14 0 17 16 0 36.56 26.52 00.00 273 48 34 9 73 57 9 55.57 30.51 08.62 274 6 3 0 6 6 0 29.67 09.76 00.00 275 40 26 0 57 47 0 48.33 30.62 00.00 276 28 15 0 38 30 0 41.49 14.16 00.00 277 18 2 0 20 7 0 29.47 01.80 00.00 278 18 2 0 19 9 0 57.64 01.43 00.00 279 22 10 0 23 17 0 63.32 26.60 00.00 280 19 11 2 29 24 2 25.93 10.45 00.53 281 51 45 27 67 67 65 74.15 60.46 28.74 282 31 24 0 74 65 0 22.11 17.02 00.00 283 37 26 0 44 41 0 70.64 47.16 00.00 284 29 10 0 40 27 0 38.16 06.10 00.00 285 35 11 0 59 27 0 42.37 11.18 00.00 286 52 10 0 174 61 1 26.96 02.24 00.01 287 49 26 0 94 74 0 43.51 17.90 00.00 288 6 1 0 8 7 0 16.26 01.46 00.00 289 9 4 1 9 7 1 50.15 29.72 02.78 290 49 6 0 66 26 0 60.89 05.64 00.00 291 48 28 3 88 65 3 45.33 19.74 00.48 292 7 3 0 8 6 0 36.67 08.44 00.00 293 66 42 14 98 84 26 73.48 41.46 09.44 294 28 26 0 33 30 0 69.06 57.56 00.00 295 76 47 3 149 95 15 54.59 24.80 00.23 296 46 38 0 49 49 0 56.26 43.07 00.00 297 29 15 0 39 24 0 55.44 37.11 00.00 298 51 23 4 74 63 4 66.14 20.27 00.26 299 67 32 0 163 108 0 51.34 22.13 00.00 300 40 4 0 56 19 0 43.35 03.45 00.00 A.42 Ad-Hoc Overview Graphs AH-Bilingual-X2PT CLEF 2005 − Top 5 participants of Ad−Hoc Bilingual X2PT − Interpolated Recall vs Average Precision 100% unine [Avg. Prec. 34.04%; Run UniNEbipt1, TD Auto, Pooled] miracle [Avg. Prec. 32.87%; Run ESASR, TDN Auto, Not Pooled] 90% jhu−apl [Avg. Prec. 31.85%; Run aplbiesptb, TD Auto, Not Pooled] alicante [Avg. Prec. 29.18%; Run IRn−enpt−vexp, TD Auto, Not Pooled] tlr [Avg. Prec. 23.58%; Run tlrTDfr2ptRFS1, TD Auto, Pooled] 80% 70% Average Precision 60% 50% 40% 30% 20% 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 − Top 5 participants of Ad−Hoc Bilingual X2PT − Retrieved documents vs Precision 100% unine [Exact Prec. 34.26%, Run UniNEbipt1, TD Auto, Pooled] miracle [Exact Prec. 34.74%, Run ESASR, TDN Auto, Not Pooled] 90% jhu−apl [Exact Prec. 34.11%, Run aplbiesptb, TD Auto, Not Pooled] alicante [Exact Prec. 31.38%, Run IRn−enpt−vexp, TD Auto, Not Pooled] tlr [Exact Prec. 26.89%, Run tlrTDfr2ptRFS1, TD Auto, Pooled] 80% 70% 60% R−Precision 50% 40% 30% 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) A.43 Ad-Hoc Overview Graphs AH-Bilingual-X2PT CLEF 2005 − Top 5 participants of Ad−Hoc Bilingual X2PT − Comparison to median by topic (topics 251 to 275) 1 unine [Run UniNEbipt1, TD Auto, Pooled] miracle [Run ESASR, TDN Auto, Not Pooled] Difference (average precision) jhu−apl [Run aplbiesptb, TD Auto, Not Pooled] 0.5 alicante [Run IRn−enpt−vexp, TD Auto, Not Pooled] tlr [Run tlrTDfr2ptRFS1, TD Auto, Pooled] 0 −0.5 −1 251252253254255256257258259260261262263264265266267268269270271272273274275 Topic Number CLEF 2005 − Top 5 participants of Ad−Hoc Bilingual X2PT − Comparison to median by topic (topics 276 to 300) 1 unine [Run UniNEbipt1, TD Auto, Pooled] miracle [Run ESASR, TDN Auto, Not Pooled] Difference (average precision) jhu−apl [Run aplbiesptb, TD Auto, Not Pooled] 0.5 alicante [Run IRn−enpt−vexp, TD Auto, Not Pooled] tlr [Run tlrTDfr2ptRFS1, TD Auto, Pooled] 0 −0.5 −1 276277278279280281282283284285286287288289290291292293294295296297298299300 Topic Number A.44 Ad-Hoc Overview Graphs AH-Monolingual-BG CLEF 2005 − Top 5 participants of Ad−Hoc Monolingual BG − Interpolated Recall vs Average Precision 100% jhu−apl [Avg. Prec. 32.03%; Run aplmobgd, TD Auto, Pooled] hummingbird [Avg. Prec. 29.18%; Run humBG05tde, TD Auto, Pooled] 90% unine [Avg. Prec. 28.39%; Run UniNEbg3, TD Auto, Not Pooled] miracle [Avg. Prec. 26.76%; Run ST, TD Auto, Pooled] u.glasgow [Avg. Prec. 25.14%; Run glabgtdqe, TD Auto, Not Pooled] 80% 70% Average Precision 60% 50% 40% 30% 20% 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 − Top 5 participants of Ad−Hoc Monolingual BG − Retrieved documents vs Precision 100% jhu−apl [Exact Prec. 30.38%, Run aplmobgd, TD Auto, Pooled] hummingbird [Exact Prec. 27.45%, Run humBG05tde, TD Auto, Pooled] 90% unine [Exact Prec. 25.93%, Run UniNEbg3, TD Auto, Not Pooled] miracle [Exact Prec. 26.27%, Run ST, TD Auto, Pooled] u.glasgow [Exact Prec. 24.33%, Run glabgtdqe, TD Auto, Not Pooled] 80% 70% 60% R−Precision 50% 40% 30% 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) A.45 Ad-Hoc Overview Graphs AH-Monolingual-BG CLEF 2005 − Top 5 participants of Ad−Hoc Monolingual BG − Comparison to median by topic (topics 251 to 275) 1 jhu−apl [Run aplmobgd, TD Auto, Pooled] hummingbird [Run humBG05tde, TD Auto, Pooled] Difference (average precision) unine [Run UniNEbg3, TD Auto, Not Pooled] 0.5 miracle [Run ST, TD Auto, Pooled] u.glasgow [Run glabgtdqe, TD Auto, Not Pooled] 0 −0.5 −1 251252253254255256257258259260261262263264265266267268269270271272273274275 Topic Number CLEF 2005 − Top 5 participants of Ad−Hoc Monolingual BG − Comparison to median by topic (topics 276 to 300) 1 jhu−apl [Run aplmobgd, TD Auto, Pooled] hummingbird [Run humBG05tde, TD Auto, Pooled] Difference (average precision) unine [Run UniNEbg3, TD Auto, Not Pooled] 0.5 miracle [Run ST, TD Auto, Pooled] u.glasgow [Run glabgtdqe, TD Auto, Not Pooled] 0 −0.5 −1 276277278279280281282283284285286287288289290291292293294295296297298299300 Topic Number # of Relevant Retrieved Docs @ 100 # of Relevant Retrieved Docs @ 1000 Average Precision % Topic ID Best Median Worst Best Median Worst Best Median Worst 251 26 17 8 38 33 21 47.86 31.02 17.47 252 6 3 0 9 7 3 11.64 03.78 00.10 253 18 15 9 23 21 16 29.31 22.86 09.95 254 38 30 9 50 49 22 42.42 29.92 05.52 255 2 2 1 2 2 2 55.56 23.33 02.34 256 2 2 1 2 2 2 75.00 62.70 17.60 257 11 5 2 12 10 4 31.12 18.76 03.01 258 1 1 0 1 1 0 100.00 29.16 00.00 259 7 6 3 7 7 5 96.17 60.74 02.99 260 12 11 3 13 12 7 44.37 30.23 09.90 261 16 11 4 21 14 4 45.19 18.92 03.99 262 33 28 4 36 35 5 68.82 51.37 02.73 263 9 6 2 30 22 6 04.69 02.64 00.70 264 8 8 1 10 8 2 29.04 16.71 00.57 265 13 11 6 13 13 8 40.20 27.00 16.88 266 9 6 0 14 10 0 17.02 07.56 00.00 267 17 11 1 21 21 3 39.42 10.72 00.43 268 14 14 13 14 14 13 71.83 44.22 19.32 269 3 1 0 4 3 1 25.91 04.76 00.03 270 4 2 1 5 4 2 04.30 02.07 00.81 271 2 2 0 2 2 0 100.00 13.76 00.00 272 1 1 1 1 1 1 100.00 15.48 01.32 273 30 21 7 39 36 33 41.26 27.24 05.77 274 4 3 1 4 4 1 34.81 07.26 00.38 275 8 5 2 10 8 7 29.62 16.42 05.15 276 7 6 4 9 9 6 13.16 10.28 04.64 277 11 6 0 11 9 1 60.29 30.24 00.02 278 11 7 0 11 9 3 49.72 15.72 00.10 279 6 6 5 6 6 6 93.33 63.46 12.27 280 6 4 0 8 8 1 38.87 05.74 00.02 281 7 7 5 7 7 7 49.06 40.04 16.59 282 5 3 2 6 6 3 36.78 18.86 07.38 283 18 18 8 18 18 17 72.35 52.54 12.07 284 4 3 1 4 3 1 19.42 11.57 00.26 285 3 3 3 3 3 3 68.06 35.21 25.96 286 13 7 0 20 19 0 16.18 06.42 00.00 287 22 18 14 35 34 27 27.60 21.66 13.47 288 7 2 0 13 9 4 14.18 02.37 00.15 289 2 2 2 2 2 2 64.29 55.72 11.86 290 23 21 15 23 23 20 73.10 43.37 30.71 291 40 36 32 54 53 45 53.11 42.55 36.54 292 0 0 0 0 0 0 00.00 00.00 00.00 293 4 4 0 4 4 1 70.22 40.24 00.05 294 43 30 16 47 45 25 79.76 57.94 21.86 295 51 38 2 67 59 16 68.11 39.40 00.83 296 1 1 0 1 1 1 50.00 02.99 00.17 297 5 3 0 5 5 0 24.51 04.19 00.00 298 2 2 0 2 2 1 11.92 02.53 00.06 299 5 1 0 6 4 1 09.58 01.04 00.09 300 6 4 2 7 6 2 32.35 15.11 03.71 A.46 Ad-Hoc Overview Graphs AH-Monolingual-BG CLEF 2005 − Top 5 participants of Ad−Hoc Monolingual BG − Interpolated Recall vs Average Precision 100% jhu−apl [Avg. Prec. 32.03%; Run aplmobgd, TD Auto, Pooled] hummingbird [Avg. Prec. 29.18%; Run humBG05tde, TD Auto, Pooled] 90% unine [Avg. Prec. 28.39%; Run UniNEbg3, TD Auto, Not Pooled] miracle [Avg. Prec. 26.76%; Run ST, TD Auto, Pooled] u.glasgow [Avg. Prec. 25.14%; Run glabgtdqe, TD Auto, Not Pooled] 80% 70% Average Precision 60% 50% 40% 30% 20% 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 − Top 5 participants of Ad−Hoc Monolingual BG − Retrieved documents vs Precision 100% jhu−apl [Exact Prec. 30.38%, Run aplmobgd, TD Auto, Pooled] hummingbird [Exact Prec. 27.45%, Run humBG05tde, TD Auto, Pooled] 90% unine [Exact Prec. 25.93%, Run UniNEbg3, TD Auto, Not Pooled] miracle [Exact Prec. 26.27%, Run ST, TD Auto, Pooled] u.glasgow [Exact Prec. 24.33%, Run glabgtdqe, TD Auto, Not Pooled] 80% 70% 60% R−Precision 50% 40% 30% 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) A.47 Ad-Hoc Overview Graphs AH-Monolingual-BG CLEF 2005 − Top 5 participants of Ad−Hoc Monolingual BG − Comparison to median by topic (topics 251 to 275) 1 jhu−apl [Run aplmobgd, TD Auto, Pooled] hummingbird [Run humBG05tde, TD Auto, Pooled] Difference (average precision) unine [Run UniNEbg3, TD Auto, Not Pooled] 0.5 miracle [Run ST, TD Auto, Pooled] u.glasgow [Run glabgtdqe, TD Auto, Not Pooled] 0 −0.5 −1 251252253254255256257258259260261262263264265266267268269270271272273274275 Topic Number CLEF 2005 − Top 5 participants of Ad−Hoc Monolingual BG − Comparison to median by topic (topics 276 to 300) 1 jhu−apl [Run aplmobgd, TD Auto, Pooled] hummingbird [Run humBG05tde, TD Auto, Pooled] Difference (average precision) unine [Run UniNEbg3, TD Auto, Not Pooled] 0.5 miracle [Run ST, TD Auto, Pooled] u.glasgow [Run glabgtdqe, TD Auto, Not Pooled] 0 −0.5 −1 276277278279280281282283284285286287288289290291292293294295296297298299300 Topic Number A.48 Ad-Hoc Overview Graphs AH-Monolingual-FR CLEF 2005 − Top 5 participants of Ad−Hoc Monolingual FR − Interpolated Recall vs Average Precision 100% jhu−apl [Avg. Prec. 42.14%; Run aplmofra, TD Auto, Pooled] unine [Avg. Prec. 42.07%; Run UniNEfr1, TD Auto, Pooled] 90% u.glasgow [Avg. Prec. 40.17%; Run glafrtdqe1, TD Auto, Pooled] hummingbird [Avg. Prec. 40.06%; Run humFR05tde, TD Auto, Not Pooled] tlr [Avg. Prec. 40.00%; Run tlrTDfrRFS1, TD Auto, Pooled] 80% 70% Average Precision 60% 50% 40% 30% 20% 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 − Top 5 participants of Ad−Hoc Monolingual FR − Retrieved documents vs Precision 100% jhu−apl [Exact Prec. 40.47%, Run aplmofra, TD Auto, Pooled] unine [Exact Prec. 42.81%, Run UniNEfr1, TD Auto, Pooled] 90% u.glasgow [Exact Prec. 39.69%, Run glafrtdqe1, TD Auto, Pooled] hummingbird [Exact Prec. 40.87%, Run humFR05tde, TD Auto, Not Pooled] tlr [Exact Prec. 39.90%, Run tlrTDfrRFS1, TD Auto, Pooled] 80% 70% 60% R−Precision 50% 40% 30% 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) A.49 Ad-Hoc Overview Graphs AH-Monolingual-FR CLEF 2005 − Top 5 participants of Ad−Hoc Monolingual FR − Comparison to median by topic (topics 251 to 275) 1 jhu−apl [Run aplmofra, TD Auto, Pooled] unine [Run UniNEfr1, TD Auto, Pooled] Difference (average precision) u.glasgow [Run glafrtdqe1, TD Auto, Pooled] 0.5 hummingbird [Run humFR05tde, TD Auto, Not Pooled] tlr [Run tlrTDfrRFS1, TD Auto, Pooled] 0 −0.5 −1 251252253254255256257258259260261262263264265266267268269270271272273274275 Topic Number CLEF 2005 − Top 5 participants of Ad−Hoc Monolingual FR − Comparison to median by topic (topics 276 to 300) 1 jhu−apl [Run aplmofra, TD Auto, Pooled] unine [Run UniNEfr1, TD Auto, Pooled] Difference (average precision) u.glasgow [Run glafrtdqe1, TD Auto, Pooled] 0.5 hummingbird [Run humFR05tde, TD Auto, Not Pooled] tlr [Run tlrTDfrRFS1, TD Auto, Pooled] 0 −0.5 −1 276277278279280281282283284285286287288289290291292293294295296297298299300 Topic Number # of Relevant Retrieved Docs @ 100 # of Relevant Retrieved Docs @ 1000 Average Precision % Topic ID Best Median Worst Best Median Worst Best Median Worst 251 26 16 6 35 31 12 41.93 24.64 04.96 252 18 9 1 24 19 8 47.88 09.00 00.83 253 85 51 13 172 132 26 66.77 33.78 02.47 254 73 63 26 176 169 84 66.87 53.60 14.46 255 1 1 0 1 1 0 05.88 01.20 00.00 256 9 9 4 9 9 5 97.65 80.04 02.62 257 34 24 1 78 66 12 27.03 17.32 00.19 258 2 1 0 2 2 0 57.14 02.70 00.00 259 9 4 0 11 10 1 12.85 03.64 00.01 260 57 39 16 72 58 29 64.16 45.02 08.56 261 3 0 0 4 1 0 29.07 00.06 00.00 262 5 3 0 6 5 3 39.59 28.32 00.11 263 16 10 3 21 18 4 45.68 30.72 00.48 264 78 65 28 96 93 44 85.20 71.37 21.29 265 26 21 8 33 33 24 44.38 27.72 09.89 266 29 21 0 33 30 3 39.50 24.55 00.06 267 24 22 4 25 25 13 58.25 40.19 03.14 268 6 6 1 6 6 4 81.07 58.38 10.35 269 40 24 1 83 67 25 39.46 19.54 00.91 270 55 46 11 62 62 26 76.68 59.89 03.31 271 33 32 9 34 34 21 90.94 86.48 08.49 272 13 11 3 13 13 6 46.47 12.99 01.98 273 75 53 6 117 107 17 73.24 49.08 01.25 274 21 19 2 21 20 4 92.19 70.84 02.25 275 57 42 18 74 57 35 68.57 47.75 19.96 276 19 15 2 30 27 11 30.64 17.72 01.78 277 18 17 0 18 18 1 62.65 40.05 00.01 278 16 12 5 19 17 10 60.91 38.18 05.16 279 16 9 2 44 37 3 13.04 07.32 00.31 280 30 20 1 43 41 6 46.68 29.37 00.14 281 38 28 9 43 43 42 50.38 35.66 10.68 282 6 2 0 17 9 1 05.12 01.60 00.03 283 39 34 10 40 39 34 79.94 69.06 18.93 284 56 49 3 67 67 17 74.45 59.15 00.92 285 65 57 15 99 96 21 70.52 59.86 07.03 286 7 5 1 8 8 5 28.10 07.07 01.58 287 68 51 5 148 137 30 54.58 41.08 00.90 288 16 9 3 28 24 16 21.43 08.18 02.96 289 23 22 1 24 23 6 76.50 66.98 02.34 290 33 25 1 40 37 4 56.13 25.77 00.22 291 50 43 3 81 77 11 61.46 42.53 00.55 292 8 5 0 10 9 3 22.68 07.80 00.30 293 81 71 7 121 118 34 77.78 64.94 02.02 294 28 22 6 32 28 8 74.56 60.79 14.61 295 50 46 13 76 72 26 51.34 44.52 07.62 296 27 21 0 27 26 1 61.25 25.67 00.02 297 46 34 10 50 43 21 74.64 49.94 07.24 298 73 56 9 137 130 28 72.39 45.97 01.47 299 18 8 0 50 34 2 12.94 04.94 00.02 300 20 14 0 24 22 6 32.91 12.10 00.16 A.50 Ad-Hoc Overview Graphs AH-Monolingual-FR CLEF 2005 − Top 5 participants of Ad−Hoc Monolingual FR − Interpolated Recall vs Average Precision 100% jhu−apl [Avg. Prec. 42.14%; Run aplmofra, TD Auto, Pooled] unine [Avg. Prec. 42.07%; Run UniNEfr1, TD Auto, Pooled] 90% u.glasgow [Avg. Prec. 40.17%; Run glafrtdqe1, TD Auto, Pooled] hummingbird [Avg. Prec. 40.06%; Run humFR05tde, TD Auto, Not Pooled] tlr [Avg. Prec. 40.00%; Run tlrTDfrRFS1, TD Auto, Pooled] 80% 70% Average Precision 60% 50% 40% 30% 20% 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 − Top 5 participants of Ad−Hoc Monolingual FR − Retrieved documents vs Precision 100% jhu−apl [Exact Prec. 40.47%, Run aplmofra, TD Auto, Pooled] unine [Exact Prec. 42.81%, Run UniNEfr1, TD Auto, Pooled] 90% u.glasgow [Exact Prec. 39.69%, Run glafrtdqe1, TD Auto, Pooled] hummingbird [Exact Prec. 40.87%, Run humFR05tde, TD Auto, Not Pooled] tlr [Exact Prec. 39.90%, Run tlrTDfrRFS1, TD Auto, Pooled] 80% 70% 60% R−Precision 50% 40% 30% 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) A.51 Ad-Hoc Overview Graphs AH-Monolingual-FR CLEF 2005 − Top 5 participants of Ad−Hoc Monolingual FR − Comparison to median by topic (topics 251 to 275) 1 jhu−apl [Run aplmofra, TD Auto, Pooled] unine [Run UniNEfr1, TD Auto, Pooled] Difference (average precision) u.glasgow [Run glafrtdqe1, TD Auto, Pooled] 0.5 hummingbird [Run humFR05tde, TD Auto, Not Pooled] tlr [Run tlrTDfrRFS1, TD Auto, Pooled] 0 −0.5 −1 251252253254255256257258259260261262263264265266267268269270271272273274275 Topic Number CLEF 2005 − Top 5 participants of Ad−Hoc Monolingual FR − Comparison to median by topic (topics 276 to 300) 1 jhu−apl [Run aplmofra, TD Auto, Pooled] unine [Run UniNEfr1, TD Auto, Pooled] Difference (average precision) u.glasgow [Run glafrtdqe1, TD Auto, Pooled] 0.5 hummingbird [Run humFR05tde, TD Auto, Not Pooled] tlr [Run tlrTDfrRFS1, TD Auto, Pooled] 0 −0.5 −1 276277278279280281282283284285286287288289290291292293294295296297298299300 Topic Number A.52 Ad-Hoc Overview Graphs AH-Monolingual-HU CLEF 2005 − Top 5 participants of Ad−Hoc Monolingual HU − Interpolated Recall vs Average Precision 100% jhu−apl [Avg. Prec. 41.12%; Run aplmohud, TD Auto, Pooled] unine [Avg. Prec. 38.89%; Run UniNEhu3, TD Auto, Not Pooled] 90% miracle [Avg. Prec. 35.20%; Run xNP01ST1, TD Auto, Pooled] hummingbird [Avg. Prec. 33.09%; Run humHU05tde, TD Auto, Pooled] hildesheim [Avg. Prec. 32.64%; Run UHIHU2, TD Auto, Pooled] 80% 70% Average Precision 60% 50% 40% 30% 20% 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 − Top 5 participants of Ad−Hoc Monolingual HU − Retrieved documents vs Precision 100% jhu−apl [Exact Prec. 40.92%, Run aplmohud, TD Auto, Pooled] unine [Exact Prec. 38.64%, Run UniNEhu3, TD Auto, Not Pooled] 90% miracle [Exact Prec. 34.24%, Run xNP01ST1, TD Auto, Pooled] hummingbird [Exact Prec. 34.00%, Run humHU05tde, TD Auto, Pooled] hildesheim [Exact Prec. 32.91%, Run UHIHU2, TD Auto, Pooled] 80% 70% 60% R−Precision 50% 40% 30% 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) A.53 Ad-Hoc Overview Graphs AH-Monolingual-HU CLEF 2005 − Top 5 participants of Ad−Hoc Monolingual HU − Comparison to median by topic (topics 251 to 275) 1 jhu−apl [Run aplmohud, TD Auto, Pooled] unine [Run UniNEhu3, TD Auto, Not Pooled] Difference (average precision) miracle [Run xNP01ST1, TD Auto, Pooled] 0.5 hummingbird [Run humHU05tde, TD Auto, Pooled] hildesheim [Run UHIHU2, TD Auto, Pooled] 0 −0.5 −1 251252253254255256257258259260261262263264265266267268269270271272273274275 Topic Number CLEF 2005 − Top 5 participants of Ad−Hoc Monolingual HU − Comparison to median by topic (topics 276 to 300) 1 jhu−apl [Run aplmohud, TD Auto, Pooled] unine [Run UniNEhu3, TD Auto, Not Pooled] Difference (average precision) miracle [Run xNP01ST1, TD Auto, Pooled] 0.5 hummingbird [Run humHU05tde, TD Auto, Pooled] hildesheim [Run UHIHU2, TD Auto, Pooled] 0 −0.5 −1 276277278279280281282283284285286287288289290291292293294295296297298299300 Topic Number # of Relevant Retrieved Docs @ 100 # of Relevant Retrieved Docs @ 1000 Average Precision % Topic ID Best Median Worst Best Median Worst Best Median Worst 251 18 8 0 27 21 5 30.07 07.69 00.49 252 15 5 0 20 10 0 20.95 04.55 00.00 253 35 31 0 38 35 1 47.95 34.29 00.02 254 24 20 5 24 23 13 64.27 33.54 03.24 255 6 3 0 6 4 2 100.00 46.51 00.09 256 10 9 4 10 10 5 87.24 72.05 24.19 257 13 8 0 13 12 1 36.13 15.63 00.02 258 3 2 0 3 2 0 33.46 13.50 00.00 259 4 3 0 4 4 2 59.65 22.93 00.46 260 6 4 0 6 5 1 42.19 15.48 00.14 261 3 1 0 3 2 0 48.89 16.72 00.00 262 11 8 0 12 12 6 57.69 20.98 02.19 263 14 8 0 20 18 1 14.43 09.10 00.05 264 5 3 1 5 4 2 40.63 31.66 00.32 265 11 6 3 13 13 3 37.51 24.81 09.39 266 20 13 6 29 26 12 26.99 13.76 02.92 267 7 6 4 7 7 5 71.65 45.25 05.77 268 15 14 5 15 14 5 70.25 54.08 24.07 269 14 4 0 17 9 0 20.58 02.92 00.00 270 19 13 7 22 22 13 31.29 18.70 08.30 271 9 7 1 9 9 1 74.87 29.00 05.00 272 1 1 0 1 1 0 20.00 01.51 00.00 273 19 15 4 26 25 12 39.28 20.96 02.19 274 20 18 10 21 20 14 87.26 45.02 21.56 275 2 2 0 2 2 1 83.33 43.34 00.12 276 26 19 6 41 41 23 33.39 19.83 04.15 277 5 1 0 7 3 0 06.48 00.66 00.00 278 12 8 0 14 12 0 42.35 27.20 00.00 279 9 8 0 9 9 1 90.53 49.56 00.01 280 11 7 3 17 17 6 17.33 08.58 01.51 281 26 26 14 26 26 16 97.50 92.38 41.29 282 7 2 0 11 8 1 14.76 01.96 00.11 283 9 9 0 9 9 0 67.87 56.79 00.00 284 13 8 0 13 8 1 38.06 18.48 00.02 285 11 2 0 11 6 2 73.03 11.64 00.13 286 29 13 0 58 42 0 37.09 09.52 00.00 287 52 20 8 67 50 21 72.46 17.95 02.37 288 20 8 2 28 23 10 34.95 08.67 00.95 289 8 8 3 8 8 4 100.00 88.16 01.50 290 71 47 6 87 76 36 74.67 43.01 02.95 291 44 38 10 47 46 16 71.04 58.96 07.66 292 2 1 0 2 2 0 52.00 21.55 00.00 293 37 32 1 37 35 16 96.66 83.58 00.67 294 4 4 2 4 4 2 100.00 82.71 31.25 295 8 8 4 8 8 4 30.98 21.75 08.90 296 22 12 1 25 24 5 27.15 17.88 00.33 297 8 7 0 8 8 0 70.96 50.84 00.00 298 18 6 0 19 10 0 37.32 05.39 00.00 299 4 2 1 4 3 1 27.41 06.88 02.23 300 9 7 0 9 7 0 46.19 19.66 00.00 A.54 Ad-Hoc Overview Graphs AH-Monolingual-HU CLEF 2005 − Top 5 participants of Ad−Hoc Monolingual HU − Interpolated Recall vs Average Precision 100% jhu−apl [Avg. Prec. 41.12%; Run aplmohud, TD Auto, Pooled] unine [Avg. Prec. 38.89%; Run UniNEhu3, TD Auto, Not Pooled] 90% miracle [Avg. Prec. 35.20%; Run xNP01ST1, TD Auto, Pooled] hummingbird [Avg. Prec. 33.09%; Run humHU05tde, TD Auto, Pooled] hildesheim [Avg. Prec. 32.64%; Run UHIHU2, TD Auto, Pooled] 80% 70% Average Precision 60% 50% 40% 30% 20% 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 − Top 5 participants of Ad−Hoc Monolingual HU − Retrieved documents vs Precision 100% jhu−apl [Exact Prec. 40.92%, Run aplmohud, TD Auto, Pooled] unine [Exact Prec. 38.64%, Run UniNEhu3, TD Auto, Not Pooled] 90% miracle [Exact Prec. 34.24%, Run xNP01ST1, TD Auto, Pooled] hummingbird [Exact Prec. 34.00%, Run humHU05tde, TD Auto, Pooled] hildesheim [Exact Prec. 32.91%, Run UHIHU2, TD Auto, Pooled] 80% 70% 60% R−Precision 50% 40% 30% 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) A.55 Ad-Hoc Overview Graphs AH-Monolingual-HU CLEF 2005 − Top 5 participants of Ad−Hoc Monolingual HU − Comparison to median by topic (topics 251 to 275) 1 jhu−apl [Run aplmohud, TD Auto, Pooled] unine [Run UniNEhu3, TD Auto, Not Pooled] Difference (average precision) miracle [Run xNP01ST1, TD Auto, Pooled] 0.5 hummingbird [Run humHU05tde, TD Auto, Pooled] hildesheim [Run UHIHU2, TD Auto, Pooled] 0 −0.5 −1 251252253254255256257258259260261262263264265266267268269270271272273274275 Topic Number CLEF 2005 − Top 5 participants of Ad−Hoc Monolingual HU − Comparison to median by topic (topics 276 to 300) 1 jhu−apl [Run aplmohud, TD Auto, Pooled] unine [Run UniNEhu3, TD Auto, Not Pooled] Difference (average precision) miracle [Run xNP01ST1, TD Auto, Pooled] 0.5 hummingbird [Run humHU05tde, TD Auto, Pooled] hildesheim [Run UHIHU2, TD Auto, Pooled] 0 −0.5 −1 276277278279280281282283284285286287288289290291292293294295296297298299300 Topic Number A.56 Ad-Hoc Overview Graphs AH-Monolingual-PT CLEF 2005 − Top 5 participants of Ad−Hoc Monolingual PT − Interpolated Recall vs Average Precision 100% unine [Avg. Prec. 38.75%; Run UniNEpt2, TD Auto, Not Pooled] hummingbird [Avg. Prec. 38.64%; Run humPT05tde, TD Auto, Not Pooled] 90% tlr [Avg. Prec. 37.42%; Run tlrTDptRF2, TD Auto, Not Pooled] jhu−apl [Avg. Prec. 36.54%; Run aplmopte, TD Auto, Not Pooled] alicante [Avg. Prec. 36.03%; Run IRn−pt−vexp, TD Auto, Pooled] 80% 70% Average Precision 60% 50% 40% 30% 20% 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 − Top 5 participants of Ad−Hoc Monolingual PT − Retrieved documents vs Precision 100% unine [Exact Prec. 39.17%, Run UniNEpt2, TD Auto, Not Pooled] hummingbird [Exact Prec. 40.55%, Run humPT05tde, TD Auto, Not Pooled] 90% tlr [Exact Prec. 39.04%, Run tlrTDptRF2, TD Auto, Not Pooled] jhu−apl [Exact Prec. 37.00%, Run aplmopte, TD Auto, Not Pooled] alicante [Exact Prec. 37.59%, Run IRn−pt−vexp, TD Auto, Pooled] 80% 70% 60% R−Precision 50% 40% 30% 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) A.57 Ad-Hoc Overview Graphs AH-Monolingual-PT CLEF 2005 − Top 5 participants of Ad−Hoc Monolingual PT − Comparison to median by topic (topics 251 to 275) 1 unine [Run UniNEpt2, TD Auto, Not Pooled] hummingbird [Run humPT05tde, TD Auto, Not Pooled] Difference (average precision) tlr [Run tlrTDptRF2, TD Auto, Not Pooled] 0.5 jhu−apl [Run aplmopte, TD Auto, Not Pooled] alicante [Run IRn−pt−vexp, TD Auto, Pooled] 0 −0.5 −1 251252253254255256257258259260261262263264265266267268269270271272273274275 Topic Number CLEF 2005 − Top 5 participants of Ad−Hoc Monolingual PT − Comparison to median by topic (topics 276 to 300) 1 unine [Run UniNEpt2, TD Auto, Not Pooled] hummingbird [Run humPT05tde, TD Auto, Not Pooled] Difference (average precision) tlr [Run tlrTDptRF2, TD Auto, Not Pooled] 0.5 jhu−apl [Run aplmopte, TD Auto, Not Pooled] alicante [Run IRn−pt−vexp, TD Auto, Pooled] 0 −0.5 −1 276277278279280281282283284285286287288289290291292293294295296297298299300 Topic Number # of Relevant Retrieved Docs @ 100 # of Relevant Retrieved Docs @ 1000 Average Precision % Topic ID Best Median Worst Best Median Worst Best Median Worst 251 53 38 18 70 60 19 72.62 51.20 16.62 252 34 20 0 43 38 7 64.14 22.26 00.19 253 56 43 24 132 117 52 39.50 28.96 12.29 254 73 58 10 126 98 10 68.82 47.82 06.06 255 6 4 1 6 6 4 68.06 30.74 02.69 256 12 12 9 12 12 9 100.00 94.88 58.21 257 28 20 1 56 50 10 29.64 17.38 00.72 258 2 1 0 2 2 0 100.00 05.57 00.00 259 17 17 8 17 17 9 53.31 36.99 12.94 260 33 20 0 78 55 0 27.19 12.30 00.00 261 14 9 4 19 14 5 24.02 12.12 03.40 262 17 9 0 26 20 0 16.88 07.44 00.00 263 28 13 4 57 49 4 24.66 09.98 01.31 264 37 27 13 43 43 13 71.52 50.35 15.81 265 25 22 6 26 26 6 32.83 25.53 07.18 266 56 46 6 87 86 6 58.89 50.04 04.65 267 43 34 11 59 58 18 51.54 32.52 11.72 268 7 6 3 7 7 3 56.28 42.87 12.44 269 23 11 6 41 30 14 17.76 08.68 02.77 270 29 21 10 41 41 21 38.07 23.49 07.93 271 35 30 1 40 38 4 70.52 54.19 02.79 272 17 13 1 17 16 9 37.53 24.84 00.85 273 49 35 9 74 67 9 56.70 39.47 07.76 274 6 4 0 6 6 1 38.87 16.67 00.26 275 43 30 3 56 52 3 54.32 36.53 03.80 276 29 20 0 38 37 1 43.26 22.99 00.01 277 14 9 0 20 18 0 15.61 08.84 00.00 278 16 13 2 19 18 2 60.36 36.97 06.14 279 21 17 0 23 20 3 59.80 46.84 00.07 280 22 7 1 34 23 9 39.16 07.00 00.74 281 52 40 26 67 67 62 72.85 49.09 23.93 282 43 28 16 73 67 23 29.94 19.44 03.84 283 42 37 24 44 43 24 80.96 71.28 30.91 284 32 28 10 40 40 22 49.22 30.75 06.85 285 38 31 7 58 56 7 48.92 39.26 09.32 286 84 65 0 210 179 24 61.54 43.68 00.15 287 45 27 1 93 77 10 35.25 14.96 00.28 288 5 2 0 8 7 1 19.17 02.23 00.12 289 9 9 8 9 9 8 84.15 64.45 40.51 290 55 42 0 66 65 0 74.23 45.54 00.00 291 40 35 7 86 79 7 33.94 25.69 04.82 292 7 4 3 8 7 4 42.15 20.54 05.66 293 75 52 24 98 94 24 80.15 56.49 16.61 294 33 31 5 33 33 13 81.57 68.14 03.34 295 84 70 50 169 142 105 69.23 46.82 24.33 296 46 33 2 49 49 2 71.37 43.68 01.70 297 29 21 2 38 30 2 59.07 35.11 04.88 298 45 33 11 76 67 39 57.96 32.83 06.29 299 75 62 11 174 163 11 61.51 47.25 04.54 300 17 7 3 32 15 5 09.53 01.86 00.35 A.58 Ad-Hoc Overview Graphs AH-Monolingual-PT CLEF 2005 − Top 5 participants of Ad−Hoc Monolingual PT − Interpolated Recall vs Average Precision 100% unine [Avg. Prec. 38.75%; Run UniNEpt2, TD Auto, Not Pooled] hummingbird [Avg. Prec. 38.64%; Run humPT05tde, TD Auto, Not Pooled] 90% tlr [Avg. Prec. 37.42%; Run tlrTDptRF2, TD Auto, Not Pooled] miracle [Avg. Prec. 36.98%; Run SR, TDN Auto, Pooled] jhu−apl [Avg. Prec. 36.54%; Run aplmopte, TD Auto, Not Pooled] 80% 70% Average Precision 60% 50% 40% 30% 20% 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 − Top 5 participants of Ad−Hoc Monolingual PT − Retrieved documents vs Precision 100% unine [Exact Prec. 39.17%, Run UniNEpt2, TD Auto, Not Pooled] hummingbird [Exact Prec. 40.55%, Run humPT05tde, TD Auto, Not Pooled] 90% tlr [Exact Prec. 39.04%, Run tlrTDptRF2, TD Auto, Not Pooled] miracle [Exact Prec. 37.71%, Run SR, TDN Auto, Pooled] jhu−apl [Exact Prec. 37.00%, Run aplmopte, TD Auto, Not Pooled] 80% 70% 60% R−Precision 50% 40% 30% 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) A.59 Ad-Hoc Overview Graphs AH-Monolingual-PT CLEF 2005 − Top 5 participants of Ad−Hoc Monolingual PT − Comparison to median by topic (topics 251 to 275) 1 unine [Run UniNEpt2, TD Auto, Not Pooled] hummingbird [Run humPT05tde, TD Auto, Not Pooled] Difference (average precision) tlr [Run tlrTDptRF2, TD Auto, Not Pooled] 0.5 miracle [Run SR, TDN Auto, Pooled] jhu−apl [Run aplmopte, TD Auto, Not Pooled] 0 −0.5 −1 251252253254255256257258259260261262263264265266267268269270271272273274275 Topic Number CLEF 2005 − Top 5 participants of Ad−Hoc Monolingual PT − Comparison to median by topic (topics 276 to 300) 1 unine [Run UniNEpt2, TD Auto, Not Pooled] hummingbird [Run humPT05tde, TD Auto, Not Pooled] Difference (average precision) tlr [Run tlrTDptRF2, TD Auto, Not Pooled] 0.5 miracle [Run SR, TDN Auto, Pooled] jhu−apl [Run aplmopte, TD Auto, Not Pooled] 0 −0.5 −1 276277278279280281282283284285286287288289290291292293294295296297298299300 Topic Number A.60 Domain-Specific Overview Graphs DS-Multi CLEF 2005 − Top 1 participants of Domain Specific Multilingual − Interpolated Recall vs Average Precision 100% berkeley [Avg. Prec. 5.32%; Run BERK1MURUALL01, TD Auto, Not Pooled] 90% 80% 70% Average Precision 60% 50% 40% 30% 20% 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 − Top 1 participants of Domain Specific Multilingual − Retrieved documents vs Precision 100% berkeley [Exact Prec. 12.12%, Run BERK1MURUALL01, TD Auto, Not Pooled] 90% 80% 70% 60% R−Precision 50% 40% 30% 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) A.61 Domain-Specific Overview Graphs DS-Multi CLEF 2005 − Top 1 participants of Domain Specific Multilingual − Comparison to median by topic (topics 126 to 138) 1 berkeley [Run BERK1MURUALL01, TD Auto, Not Pooled] Difference (average precision) 0.5 0 −0.5 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic Number CLEF 2005 − Top 1 participants of Domain Specific Multilingual − Comparison to median by topic (topics 139 to 150) 1 berkeley [Run BERK1MURUALL01, TD Auto, Not Pooled] Difference (average precision) 0.5 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number # of Relevant Retrieved Docs @ 100 # of Relevant Retrieved Docs @ 1000 Average Precision % Topic ID Best Median Worst Best Median Worst Best Median Worst 126 51 28 4 100 87 65 13.05 06.78 01.31 127 29 26 16 101 59 44 03.87 02.29 01.71 128 21 17 8 187 104 38 06.46 03.34 01.24 129 0 0 0 1 1 0 00.01 00.01 00.00 130 9 7 4 41 25 23 02.33 01.07 01.03 131 15 9 5 35 25 8 02.09 00.78 00.19 132 54 6 4 142 115 52 21.26 03.55 01.23 133 3 0 0 15 9 5 00.56 00.53 00.04 134 15 11 7 42 41 37 09.78 08.57 03.58 135 4 3 2 7 5 4 00.56 00.23 00.15 136 3 2 2 14 6 6 00.20 00.10 00.03 137 8 7 5 24 18 12 01.32 01.30 00.38 138 18 16 16 35 31 21 05.98 05.37 03.02 139 18 12 5 51 50 13 01.61 01.32 00.35 140 9 4 3 38 8 8 01.66 00.45 00.14 141 19 2 1 46 25 11 05.12 01.82 00.12 142 23 3 1 47 15 9 05.00 00.64 00.14 143 14 1 0 27 7 4 09.19 00.21 00.09 144 27 27 24 56 54 51 21.49 16.62 16.03 145 36 28 16 137 68 50 11.33 05.25 02.04 146 27 21 15 45 43 22 30.28 20.99 13.63 147 7 2 2 27 7 5 00.80 00.29 00.13 148 6 6 1 15 11 4 01.82 01.05 00.57 149 6 4 3 18 14 14 01.39 00.75 00.46 150 19 11 4 156 41 35 03.62 01.06 00.26 A.62 Domain-Specific Overview Graphs DS-Multi CLEF 2005 − Top 1 participants of Domain Specific Multilingual − Interpolated Recall vs Average Precision 100% berkeley [Avg. Prec. 5.32%; Run BERK1MURUALL01, TD Auto, Not Pooled] 90% 80% 70% Average Precision 60% 50% 40% 30% 20% 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 − Top 1 participants of Domain Specific Multilingual − Retrieved documents vs Precision 100% berkeley [Exact Prec. 12.12%, Run BERK1MURUALL01, TD Auto, Not Pooled] 90% 80% 70% 60% R−Precision 50% 40% 30% 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) A.63 Domain-Specific Overview Graphs DS-Multi CLEF 2005 − Top 1 participants of Domain Specific Multilingual − Comparison to median by topic (topics 126 to 138) 1 berkeley [Run BERK1MURUALL01, TD Auto, Not Pooled] Difference (average precision) 0.5 0 −0.5 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic Number CLEF 2005 − Top 1 participants of Domain Specific Multilingual − Comparison to median by topic (topics 139 to 150) 1 berkeley [Run BERK1MURUALL01, TD Auto, Not Pooled] Difference (average precision) 0.5 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number A.64 Domain-Specific Overview Graphs DS-Bilingual-X2DE CLEF 2005 − Top 5 participants of Domain Specific Bilingual X2DE − Interpolated Recall vs Average Precision 100% berkeley−2 [Avg. Prec. 42.01%; Run BK2GBLEG1, TD Auto, Pooled] hagen [Avg. Prec. 23.99%; Run FUHegpyyd, TD Auto, Pooled] 90% u.glasgow [Avg. Prec. 19.46%; Run glaendetdqe, TD Auto, Pooled] hildesheim [Avg. Prec. 17.79%; Run UHIGIRT3, TD Auto, Pooled] berkeley [Avg. Prec. 16.87%; Run BERK1BLRUDE01, TD Auto, Pooled] 80% 70% Average Precision 60% 50% 40% 30% 20% 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 − Top 5 participants of Domain Specific Bilingual X2DE − Retrieved documents vs Precision 100% berkeley−2 [Exact Prec. 41.92%, Run BK2GBLEG1, TD Auto, Pooled] hagen [Exact Prec. 27.14%, Run FUHegpyyd, TD Auto, Pooled] 90% u.glasgow [Exact Prec. 22.43%, Run glaendetdqe, TD Auto, Pooled] hildesheim [Exact Prec. 21.35%, Run UHIGIRT3, TD Auto, Pooled] berkeley [Exact Prec. 19.73%, Run BERK1BLRUDE01, TD Auto, Pooled] 80% 70% 60% R−Precision 50% 40% 30% 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) A.65 Domain-Specific Overview Graphs DS-Bilingual-X2DE CLEF 2005 − Top 5 participants of Domain Specific Bilingual X2DE − Comparison to median by topic (topics 126 to 138) 1 berkeley−2 [Run BK2GBLEG1, TD Auto, Pooled] hagen [Run FUHegpyyd, TD Auto, Pooled] Difference (average precision) u.glasgow [Run glaendetdqe, TD Auto, Pooled] 0.5 hildesheim [Run UHIGIRT3, TD Auto, Pooled] berkeley [Run BERK1BLRUDE01, TD Auto, Pooled] 0 −0.5 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic Number CLEF 2005 − Top 5 participants of Domain Specific Bilingual X2DE − Comparison to median by topic (topics 139 to 150) 1 berkeley−2 [Run BK2GBLEG1, TD Auto, Pooled] hagen [Run FUHegpyyd, TD Auto, Pooled] Difference (average precision) u.glasgow [Run glaendetdqe, TD Auto, Pooled] 0.5 hildesheim [Run UHIGIRT3, TD Auto, Pooled] berkeley [Run BERK1BLRUDE01, TD Auto, Pooled] 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number # of Relevant Retrieved Docs @ 100 # of Relevant Retrieved Docs @ 1000 Average Precision % Topic ID Best Median Worst Best Median Worst Best Median Worst 126 53 46 12 154 125 106 35.45 24.61 07.66 127 87 84 10 271 262 53 62.47 59.40 01.76 128 89 8 0 255 45 12 66.96 01.43 00.06 129 7 1 0 7 2 0 44.57 00.23 00.00 130 54 31 4 75 63 14 73.77 33.98 00.79 131 60 17 3 97 38 13 55.04 08.43 00.69 132 95 93 83 151 151 116 91.29 86.87 67.52 133 11 6 0 27 21 0 12.39 05.22 00.00 134 17 12 0 24 22 4 45.15 17.79 00.06 135 3 0 0 11 4 0 05.28 00.16 00.00 136 28 7 0 85 48 2 13.60 02.48 00.01 137 70 45 9 91 73 24 65.75 36.34 04.90 138 11 2 0 19 4 0 03.25 01.42 00.00 139 63 26 2 172 87 21 44.17 07.49 00.40 140 59 19 1 86 36 5 56.75 10.92 00.04 141 59 43 0 70 66 0 80.17 48.37 00.00 142 45 22 2 60 44 11 58.67 20.32 00.34 143 18 11 5 18 17 7 32.83 22.10 06.97 144 11 8 1 15 13 10 42.06 16.80 03.25 145 78 66 23 143 137 74 63.44 53.42 11.07 146 28 21 9 32 29 11 64.53 48.74 12.20 147 54 31 1 104 65 8 55.44 22.73 00.12 148 34 9 3 40 22 15 46.66 07.98 00.97 149 21 16 1 46 38 11 30.75 17.81 00.31 150 90 77 14 278 212 28 58.76 43.62 01.10 A.66 Domain-Specific Overview Graphs DS-Bilingual-X2DE CLEF 2005 − Top 5 participants of Domain Specific Bilingual X2DE − Interpolated Recall vs Average Precision 100% berkeley−2 [Avg. Prec. 42.01%; Run BK2GBLEG1, TD Auto, Pooled] hagen [Avg. Prec. 23.99%; Run FUHegpyyd, TD Auto, Pooled] 90% u.glasgow [Avg. Prec. 19.46%; Run glaendetdnqe, TDN Auto, Pooled] hildesheim [Avg. Prec. 17.79%; Run UHIGIRT3, TD Auto, Pooled] berkeley [Avg. Prec. 16.87%; Run BERK1BLRUDE01, TD Auto, Pooled] 80% 70% Average Precision 60% 50% 40% 30% 20% 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 − Top 5 participants of Domain Specific Bilingual X2DE − Retrieved documents vs Precision 100% berkeley−2 [Exact Prec. 41.92%, Run BK2GBLEG1, TD Auto, Pooled] hagen [Exact Prec. 27.14%, Run FUHegpyyd, TD Auto, Pooled] 90% u.glasgow [Exact Prec. 22.43%, Run glaendetdnqe, TDN Auto, Pooled] hildesheim [Exact Prec. 21.35%, Run UHIGIRT3, TD Auto, Pooled] berkeley [Exact Prec. 19.73%, Run BERK1BLRUDE01, TD Auto, Pooled] 80% 70% 60% R−Precision 50% 40% 30% 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) A.67 Domain-Specific Overview Graphs DS-Bilingual-X2DE CLEF 2005 − Top 5 participants of Domain Specific Bilingual X2DE − Comparison to median by topic (topics 126 to 138) 1 berkeley−2 [Run BK2GBLEG1, TD Auto, Pooled] hagen [Run FUHegpyyd, TD Auto, Pooled] Difference (average precision) u.glasgow [Run glaendetdnqe, TDN Auto, Pooled] 0.5 hildesheim [Run UHIGIRT3, TD Auto, Pooled] berkeley [Run BERK1BLRUDE01, TD Auto, Pooled] 0 −0.5 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic Number CLEF 2005 − Top 5 participants of Domain Specific Bilingual X2DE − Comparison to median by topic (topics 139 to 150) 1 berkeley−2 [Run BK2GBLEG1, TD Auto, Pooled] hagen [Run FUHegpyyd, TD Auto, Pooled] Difference (average precision) u.glasgow [Run glaendetdnqe, TDN Auto, Pooled] 0.5 hildesheim [Run UHIGIRT3, TD Auto, Pooled] berkeley [Run BERK1BLRUDE01, TD Auto, Pooled] 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number A.68 Domain-Specific Overview Graphs DS-Bilingual-X2EN CLEF 2005 − Top 3 participants of Domain Specific Bilingual X2EN − Interpolated Recall vs Average Precision 100% berkeley−2 [Avg. Prec. 47.43%; Run BK2GBLGE2, TD Auto, Pooled] u.glasgow [Avg. Prec. 38.99%; Run glaruentdqeD, TD Auto, Pooled] 90% berkeley [Avg. Prec. 23.98%; Run BERK1BLDEEN01, TD Auto, Pooled] 80% 70% Average Precision 60% 50% 40% 30% 20% 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 − Top 3 participants of Domain Specific Bilingual X2EN − Retrieved documents vs Precision 100% berkeley−2 [Exact Prec. 46.82%, Run BK2GBLGE2, TD Auto, Pooled] u.glasgow [Exact Prec. 41.56%, Run glaruentdqeD, TD Auto, Pooled] 90% berkeley [Exact Prec. 27.57%, Run BERK1BLDEEN01, TD Auto, Pooled] 80% 70% 60% R−Precision 50% 40% 30% 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) A.69 Domain-Specific Overview Graphs DS-Bilingual-X2EN CLEF 2005 − Top 3 participants of Domain Specific Bilingual X2EN − Comparison to median by topic (topics 126 to 138) 1 berkeley−2 [Run BK2GBLGE2, TD Auto, Pooled] u.glasgow [Run glaruentdqeD, TD Auto, Pooled] Difference (average precision) berkeley [Run BERK1BLDEEN01, TD Auto, Pooled] 0.5 0 −0.5 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic Number CLEF 2005 − Top 3 participants of Domain Specific Bilingual X2EN − Comparison to median by topic (topics 139 to 150) 1 berkeley−2 [Run BK2GBLGE2, TD Auto, Pooled] u.glasgow [Run glaruentdqeD, TD Auto, Pooled] Difference (average precision) berkeley [Run BERK1BLDEEN01, TD Auto, Pooled] 0.5 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number # of Relevant Retrieved Docs @ 100 # of Relevant Retrieved Docs @ 1000 Average Precision % Topic ID Best Median Worst Best Median Worst Best Median Worst 126 48 33 12 92 87 58 54.93 29.29 05.03 127 80 69 19 217 214 84 65.91 57.19 05.73 128 94 85 3 213 195 7 75.85 68.97 00.13 129 5 1 0 6 4 2 27.66 01.67 00.19 130 36 31 18 48 46 40 59.30 37.42 18.47 131 65 32 1 87 48 2 71.22 29.81 00.04 132 97 93 35 148 147 89 91.81 90.08 18.14 133 8 3 1 9 8 6 35.41 10.46 01.72 134 19 14 11 24 24 19 45.26 28.66 07.17 135 5 4 1 10 8 5 12.04 08.16 00.68 136 54 48 9 103 101 27 57.60 46.50 02.93 137 27 15 1 44 21 4 37.27 21.93 00.22 138 32 21 13 43 34 21 45.66 28.31 14.27 139 52 23 14 139 98 74 41.39 12.35 08.21 140 53 50 6 65 64 9 65.18 51.89 01.34 141 55 42 0 58 56 0 90.72 63.11 00.00 142 36 25 16 44 44 39 66.62 38.90 15.46 143 30 26 19 32 27 27 41.66 36.33 23.25 144 42 32 28 50 49 40 67.65 50.86 29.19 145 71 55 20 130 121 67 60.12 40.07 07.26 146 28 26 21 28 28 21 92.70 85.35 62.86 147 56 51 4 100 84 19 49.51 43.94 02.04 148 32 12 8 37 20 15 45.89 09.05 04.44 149 32 10 5 42 33 10 69.91 09.86 01.31 150 89 60 5 211 157 36 64.53 34.23 00.79 A.70 Domain-Specific Overview Graphs DS-Bilingual-X2EN CLEF 2005 − Top 4 participants of Domain Specific Bilingual X2EN − Interpolated Recall vs Average Precision 100% berkeley−2 [Avg. Prec. 47.43%; Run BK2GBLGE2, TD Auto, Pooled] u.glasgow [Avg. Prec. 38.99%; Run glaruentdqeD, TD Auto, Pooled] 90% msu−nivc [Avg. Prec. 24.03%; Run cirGIRTru2en, TDN Auto, Pooled] berkeley [Avg. Prec. 23.98%; Run BERK1BLDEEN01, TD Auto, Pooled] 80% 70% Average Precision 60% 50% 40% 30% 20% 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 − Top 4 participants of Domain Specific Bilingual X2EN − Retrieved documents vs Precision 100% berkeley−2 [Exact Prec. 46.82%, Run BK2GBLGE2, TD Auto, Pooled] u.glasgow [Exact Prec. 41.56%, Run glaruentdqeD, TD Auto, Pooled] 90% msu−nivc [Exact Prec. 27.37%, Run cirGIRTru2en, TDN Auto, Pooled] berkeley [Exact Prec. 27.57%, Run BERK1BLDEEN01, TD Auto, Pooled] 80% 70% 60% R−Precision 50% 40% 30% 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) A.71 Domain-Specific Overview Graphs DS-Bilingual-X2EN CLEF 2005 − Top 4 participants of Domain Specific Bilingual X2EN − Comparison to median by topic (topics 126 to 138) 1 berkeley−2 [Run BK2GBLGE2, TD Auto, Pooled] u.glasgow [Run glaruentdqeD, TD Auto, Pooled] Difference (average precision) msu−nivc [Run cirGIRTru2en, TDN Auto, Pooled] 0.5 berkeley [Run BERK1BLDEEN01, TD Auto, Pooled] 0 −0.5 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic Number CLEF 2005 − Top 4 participants of Domain Specific Bilingual X2EN − Comparison to median by topic (topics 139 to 150) 1 berkeley−2 [Run BK2GBLGE2, TD Auto, Pooled] u.glasgow [Run glaruentdqeD, TD Auto, Pooled] Difference (average precision) msu−nivc [Run cirGIRTru2en, TDN Auto, Pooled] 0.5 berkeley [Run BERK1BLDEEN01, TD Auto, Pooled] 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number A.72 Domain-Specific Overview Graphs DS-Bilingual-X2RU CLEF 2005 − Top 2 participants of Domain Specific Bilingual X2RU − Interpolated Recall vs Average Precision 100% berkeley−2 [Avg. Prec. 23.31%; Run BK2GBLGR1, TD Auto, Pooled] berkeley [Avg. Prec. 17.17%; Run BERK1BLDERU01, TD Auto, Pooled] 90% 80% 70% Average Precision 60% 50% 40% 30% 20% 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 − Top 2 participants of Domain Specific Bilingual X2RU − Retrieved documents vs Precision 100% berkeley−2 [Exact Prec. 25.01%, Run BK2GBLGR1, TD Auto, Pooled] berkeley [Exact Prec. 18.64%, Run BERK1BLDERU01, TD Auto, Pooled] 90% 80% 70% 60% R−Precision 50% 40% 30% 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) A.73 Domain-Specific Overview Graphs DS-Bilingual-X2RU CLEF 2005 − Top 2 participants of Domain Specific Bilingual X2RU − Comparison to median by topic (topics 126 to 138) 1 berkeley−2 [Run BK2GBLGR1, TD Auto, Pooled] berkeley [Run BERK1BLDERU01, TD Auto, Pooled] Difference (average precision) 0.5 0 −0.5 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic Number CLEF 2005 − Top 2 participants of Domain Specific Bilingual X2RU − Comparison to median by topic (topics 139 to 150) 1 berkeley−2 [Run BK2GBLGR1, TD Auto, Pooled] berkeley [Run BERK1BLDERU01, TD Auto, Pooled] Difference (average precision) 0.5 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number # of Relevant Retrieved Docs @ 100 # of Relevant Retrieved Docs @ 1000 Average Precision % Topic ID Best Median Worst Best Median Worst Best Median Worst 126 26 18 3 30 27 3 51.82 41.19 00.26 127 83 71 17 112 105 17 86.91 68.72 11.62 128 28 21 0 44 41 2 37.93 23.74 00.02 129 0 0 0 1 0 0 00.21 00.00 00.00 130 3 1 0 4 3 3 05.97 00.61 00.25 131 2 2 0 2 2 0 52.94 09.76 00.00 132 4 1 0 4 1 0 30.40 12.50 00.00 133 6 4 0 7 5 0 46.43 10.71 00.00 134 4 3 1 11 9 1 09.13 02.00 00.72 135 19 11 2 54 40 2 18.76 08.01 00.55 136 22 7 2 33 26 7 11.09 02.20 00.22 137 15 8 0 20 17 0 19.10 11.14 00.00 138 12 3 0 26 7 0 17.70 04.32 00.00 139 61 39 13 112 74 13 51.45 22.41 07.76 140 5 3 2 10 9 2 03.58 02.71 02.55 141 11 10 0 14 14 0 20.86 19.33 00.00 142 25 12 1 79 16 13 28.86 06.78 00.50 143 2 2 0 2 2 0 100.00 73.81 00.00 144 3 0 0 4 4 3 02.70 01.37 00.65 145 78 66 22 100 99 24 68.21 59.49 14.75 146 0 0 0 0 0 0 00.00 00.00 00.00 147 0 0 0 1 0 0 00.16 00.00 00.00 148 5 3 0 6 5 0 16.18 06.39 00.00 149 4 2 0 5 5 0 08.80 02.57 00.00 150 1 1 0 2 1 0 01.78 01.39 00.00 A.74 Domain-Specific Overview Graphs DS-Bilingual-X2RU CLEF 2005 − Top 3 participants of Domain Specific Bilingual X2RU − Interpolated Recall vs Average Precision 100% berkeley−2 [Avg. Prec. 23.31%; Run BK2GBLGR1, TD Auto, Pooled] berkeley [Avg. Prec. 17.17%; Run BERK1BLDERU01, TD Auto, Pooled] 90% msu−nivc [Avg. Prec. 2.16%; Run cirRSSCen2ru, TDN Auto, Pooled] 80% 70% Average Precision 60% 50% 40% 30% 20% 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 − Top 3 participants of Domain Specific Bilingual X2RU − Retrieved documents vs Precision 100% berkeley−2 [Exact Prec. 25.01%, Run BK2GBLGR1, TD Auto, Pooled] berkeley [Exact Prec. 18.64%, Run BERK1BLDERU01, TD Auto, Pooled] 90% msu−nivc [Exact Prec. 3.43%, Run cirRSSCen2ru, TDN Auto, Pooled] 80% 70% 60% R−Precision 50% 40% 30% 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) A.75 Domain-Specific Overview Graphs DS-Bilingual-X2RU CLEF 2005 − Top 3 participants of Domain Specific Bilingual X2RU − Comparison to median by topic (topics 126 to 138) 1 berkeley−2 [Run BK2GBLGR1, TD Auto, Pooled] berkeley [Run BERK1BLDERU01, TD Auto, Pooled] Difference (average precision) msu−nivc [Run cirRSSCen2ru, TDN Auto, Pooled] 0.5 0 −0.5 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic Number CLEF 2005 − Top 3 participants of Domain Specific Bilingual X2RU − Comparison to median by topic (topics 139 to 150) 1 berkeley−2 [Run BK2GBLGR1, TD Auto, Pooled] berkeley [Run BERK1BLDERU01, TD Auto, Pooled] Difference (average precision) msu−nivc [Run cirRSSCen2ru, TDN Auto, Pooled] 0.5 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number A.76 Domain-Specific Overview Graphs DS-Monolingual-DE CLEF 2005 − Top 5 participants of Domain Specific Monolingual DE − Interpolated Recall vs Average Precision 100% berkeley−2 [Avg. Prec. 49.36%; Run BK2GMLGG3, TD Auto, Pooled] unine [Avg. Prec. 49.21%; Run UniNEgde1, TD Auto, Pooled] 90% hagen [Avg. Prec. 30.31%; Run FUHggyydbf, TD Auto, Pooled] u.glasgow [Avg. Prec. 30.29%; Run gladetdqe, TD Auto, Pooled] berkeley [Avg. Prec. 23.14%; Run BERK1MLDE01, TD Auto, Pooled] 80% 70% Average Precision 60% 50% 40% 30% 20% 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 − Top 5 participants of Domain Specific Monolingual DE − Retrieved documents vs Precision 100% berkeley−2 [Exact Prec. 48.89%, Run BK2GMLGG3, TD Auto, Pooled] unine [Exact Prec. 49.02%, Run UniNEgde1, TD Auto, Pooled] 90% hagen [Exact Prec. 32.71%, Run FUHggyydbf, TD Auto, Pooled] u.glasgow [Exact Prec. 32.44%, Run gladetdqe, TD Auto, Pooled] berkeley [Exact Prec. 26.87%, Run BERK1MLDE01, TD Auto, Pooled] 80% 70% 60% R−Precision 50% 40% 30% 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) A.77 Domain-Specific Overview Graphs DS-Monolingual-DE CLEF 2005 − Top 5 participants of Domain Specific Monolingual DE − Comparison to median by topic (topics 126 to 138) 1 berkeley−2 [Run BK2GMLGG3, TD Auto, Pooled] unine [Run UniNEgde1, TD Auto, Pooled] Difference (average precision) hagen [Run FUHggyydbf, TD Auto, Pooled] 0.5 u.glasgow [Run gladetdqe, TD Auto, Pooled] berkeley [Run BERK1MLDE01, TD Auto, Pooled] 0 −0.5 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic Number CLEF 2005 − Top 5 participants of Domain Specific Monolingual DE − Comparison to median by topic (topics 139 to 150) 1 berkeley−2 [Run BK2GMLGG3, TD Auto, Pooled] unine [Run UniNEgde1, TD Auto, Pooled] Difference (average precision) hagen [Run FUHggyydbf, TD Auto, Pooled] 0.5 u.glasgow [Run gladetdqe, TD Auto, Pooled] berkeley [Run BERK1MLDE01, TD Auto, Pooled] 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number # of Relevant Retrieved Docs @ 100 # of Relevant Retrieved Docs @ 1000 Average Precision % Topic ID Best Median Worst Best Median Worst Best Median Worst 126 64 49 29 162 135 101 44.02 28.15 14.52 127 93 80 6 290 265 48 70.02 61.75 01.39 128 91 83 64 250 203 159 66.53 53.38 34.83 129 7 4 2 8 7 4 51.79 20.62 04.07 130 55 12 1 75 31 8 74.01 05.20 00.12 131 73 35 12 106 62 32 70.00 27.14 03.33 132 95 90 54 152 149 117 90.23 80.31 47.85 133 14 8 5 27 22 10 16.03 07.96 03.46 134 20 15 10 24 23 20 45.08 34.53 15.33 135 9 3 0 13 7 3 09.35 01.76 00.11 136 81 57 36 151 127 85 72.65 43.74 15.82 137 75 52 24 101 82 42 75.42 48.01 10.57 138 29 6 0 44 11 2 42.19 05.89 00.01 139 84 44 15 180 134 86 63.13 23.99 06.50 140 64 20 0 92 39 3 57.68 11.84 00.02 141 61 47 0 70 68 0 83.59 67.92 00.00 142 41 25 14 64 55 43 56.70 22.68 09.00 143 17 12 9 18 17 11 37.88 24.66 09.90 144 9 8 0 15 13 10 24.56 09.62 01.37 145 87 72 38 156 151 87 76.68 63.72 23.43 146 31 25 14 32 31 21 87.72 70.41 31.57 147 65 45 0 99 63 0 66.16 30.54 00.00 148 31 20 9 42 35 22 57.13 32.47 07.94 149 34 22 10 47 45 28 49.23 29.57 12.62 150 94 85 4 290 234 47 65.09 52.01 00.80 A.78 Domain-Specific Overview Graphs DS-Monolingual-DE CLEF 2005 − Top 5 participants of Domain Specific Monolingual DE − Interpolated Recall vs Average Precision 100% berkeley−2 [Avg. Prec. 49.36%; Run BK2GMLGG3, TD Auto, Pooled] unine [Avg. Prec. 49.21%; Run UniNEgde1, TD Auto, Pooled] 90% hagen [Avg. Prec. 30.31%; Run FUHggyydbf, TD Auto, Pooled] u.glasgow [Avg. Prec. 30.29%; Run gladetdqe, TD Auto, Pooled] berkeley [Avg. Prec. 23.14%; Run BERK1MLDE01, TD Auto, Pooled] 80% 70% Average Precision 60% 50% 40% 30% 20% 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 − Top 5 participants of Domain Specific Monolingual DE − Retrieved documents vs Precision 100% berkeley−2 [Exact Prec. 48.89%, Run BK2GMLGG3, TD Auto, Pooled] unine [Exact Prec. 49.02%, Run UniNEgde1, TD Auto, Pooled] 90% hagen [Exact Prec. 32.71%, Run FUHggyydbf, TD Auto, Pooled] u.glasgow [Exact Prec. 32.44%, Run gladetdqe, TD Auto, Pooled] berkeley [Exact Prec. 26.87%, Run BERK1MLDE01, TD Auto, Pooled] 80% 70% 60% R−Precision 50% 40% 30% 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) A.79 Domain-Specific Overview Graphs DS-Monolingual-DE CLEF 2005 − Top 5 participants of Domain Specific Monolingual DE − Comparison to median by topic (topics 126 to 138) 1 berkeley−2 [Run BK2GMLGG3, TD Auto, Pooled] unine [Run UniNEgde1, TD Auto, Pooled] Difference (average precision) hagen [Run FUHggyydbf, TD Auto, Pooled] 0.5 u.glasgow [Run gladetdqe, TD Auto, Pooled] berkeley [Run BERK1MLDE01, TD Auto, Pooled] 0 −0.5 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic Number CLEF 2005 − Top 5 participants of Domain Specific Monolingual DE − Comparison to median by topic (topics 139 to 150) 1 berkeley−2 [Run BK2GMLGG3, TD Auto, Pooled] unine [Run UniNEgde1, TD Auto, Pooled] Difference (average precision) hagen [Run FUHggyydbf, TD Auto, Pooled] 0.5 u.glasgow [Run gladetdqe, TD Auto, Pooled] berkeley [Run BERK1MLDE01, TD Auto, Pooled] 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number A.80 Domain-Specific Overview Graphs DS-Monolingual-EN CLEF 2005 − Top 5 participants of Domain Specific Monolingual EN − Interpolated Recall vs Average Precision 100% unine [Avg. Prec. 50.65%; Run UniNEgen1, TD Auto, Pooled] berkeley−2 [Avg. Prec. 46.97%; Run BK2GMLEE3, TD Auto, Pooled] 90% u.glasgow [Avg. Prec. 34.84%; Run glaentd, TD Auto, Pooled] berkeley [Avg. Prec. 32.91%; Run BERK1MLEN01, TD Auto, Pooled] irit [Avg. Prec. 32.35%; Run CWNSETD, TD Auto, Pooled] 80% 70% Average Precision 60% 50% 40% 30% 20% 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 − Top 5 participants of Domain Specific Monolingual EN − Retrieved documents vs Precision 100% unine [Exact Prec. 49.15%, Run UniNEgen1, TD Auto, Pooled] berkeley−2 [Exact Prec. 46.33%, Run BK2GMLEE3, TD Auto, Pooled] 90% u.glasgow [Exact Prec. 36.98%, Run glaentd, TD Auto, Pooled] berkeley [Exact Prec. 36.46%, Run BERK1MLEN01, TD Auto, Pooled] irit [Exact Prec. 34.03%, Run CWNSETD, TD Auto, Pooled] 80% 70% 60% R−Precision 50% 40% 30% 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) A.81 Domain-Specific Overview Graphs DS-Monolingual-EN CLEF 2005 − Top 5 participants of Domain Specific Monolingual EN − Comparison to median by topic (topics 126 to 138) 1 unine [Run UniNEgen1, TD Auto, Pooled] berkeley−2 [Run BK2GMLEE3, TD Auto, Pooled] Difference (average precision) u.glasgow [Run glaentd, TD Auto, Pooled] 0.5 berkeley [Run BERK1MLEN01, TD Auto, Pooled] irit [Run CWNSETD, TD Auto, Pooled] 0 −0.5 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic Number CLEF 2005 − Top 5 participants of Domain Specific Monolingual EN − Comparison to median by topic (topics 139 to 150) 1 unine [Run UniNEgen1, TD Auto, Pooled] berkeley−2 [Run BK2GMLEE3, TD Auto, Pooled] Difference (average precision) u.glasgow [Run glaentd, TD Auto, Pooled] 0.5 berkeley [Run BERK1MLEN01, TD Auto, Pooled] irit [Run CWNSETD, TD Auto, Pooled] 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number # of Relevant Retrieved Docs @ 100 # of Relevant Retrieved Docs @ 1000 Average Precision % Topic ID Best Median Worst Best Median Worst Best Median Worst 126 51 46 2 91 83 18 48.01 41.73 00.43 127 78 59 30 218 189 88 57.43 40.59 14.17 128 97 85 1 217 213 12 81.44 69.28 00.16 129 5 1 0 6 5 1 08.14 01.02 00.13 130 39 30 25 48 48 41 66.75 52.93 37.38 131 65 36 2 89 54 2 76.00 38.59 02.20 132 98 92 0 149 144 0 93.40 87.84 00.00 133 8 2 0 10 7 4 25.19 02.58 00.36 134 19 14 4 24 23 11 49.03 32.19 04.28 135 9 5 1 11 10 7 48.13 15.38 03.94 136 65 51 22 105 102 45 69.99 54.33 12.06 137 45 15 1 54 17 4 74.42 21.91 00.22 138 29 17 4 41 20 8 32.01 12.56 04.01 139 69 38 20 148 115 56 56.83 19.80 09.60 140 58 54 34 65 64 54 68.20 54.40 37.17 141 54 50 35 58 55 52 86.29 79.91 40.93 142 43 36 5 46 44 40 79.79 60.35 06.42 143 30 25 19 32 27 27 41.28 32.80 19.39 144 39 32 9 50 47 38 56.25 38.69 08.98 145 75 61 15 134 122 51 63.20 50.67 03.96 146 28 26 21 28 28 21 92.89 87.75 69.34 147 68 56 36 103 102 76 76.03 60.58 35.68 148 15 9 5 24 22 9 20.47 09.87 03.49 149 32 8 4 42 18 11 69.91 05.20 01.47 150 92 72 15 225 182 27 71.08 45.05 02.72 A.82 Domain-Specific Overview Graphs DS-Monolingual-EN CLEF 2005 − Top 5 participants of Domain Specific Monolingual EN − Interpolated Recall vs Average Precision 100% unine [Avg. Prec. 50.65%; Run UniNEgen1, TD Auto, Pooled] berkeley−2 [Avg. Prec. 46.97%; Run BK2GMLEE3, TD Auto, Pooled] 90% u.glasgow [Avg. Prec. 41.71%; Run glaentdnqe, TDN Auto, Pooled] irit [Avg. Prec. 34.11%; Run CWNT, T Auto, Pooled] 80% berkeley [Avg. Prec. 32.91%; Run BERK1MLEN01, TD Auto, Pooled] 70% Average Precision 60% 50% 40% 30% 20% 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 − Top 5 participants of Domain Specific Monolingual EN − Retrieved documents vs Precision 100% unine [Exact Prec. 49.15%, Run UniNEgen1, TD Auto, Pooled] berkeley−2 [Exact Prec. 46.33%, Run BK2GMLEE3, TD Auto, Pooled] 90% u.glasgow [Exact Prec. 42.11%, Run glaentdnqe, TDN Auto, Pooled] irit [Exact Prec. 35.06%, Run CWNT, T Auto, Pooled] 80% berkeley [Exact Prec. 36.46%, Run BERK1MLEN01, TD Auto, Pooled] 70% 60% R−Precision 50% 40% 30% 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) A.83 Domain-Specific Overview Graphs DS-Monolingual-EN CLEF 2005 − Top 5 participants of Domain Specific Monolingual EN − Comparison to median by topic (topics 126 to 138) 1 unine [Run UniNEgen1, TD Auto, Pooled] berkeley−2 [Run BK2GMLEE3, TD Auto, Pooled] Difference (average precision) u.glasgow [Run glaentdnqe, TDN Auto, Pooled] 0.5 irit [Run CWNT, T Auto, Pooled] berkeley [Run BERK1MLEN01, TD Auto, Pooled] 0 −0.5 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic Number CLEF 2005 − Top 5 participants of Domain Specific Monolingual EN − Comparison to median by topic (topics 139 to 150) 1 unine [Run UniNEgen1, TD Auto, Pooled] berkeley−2 [Run BK2GMLEE3, TD Auto, Pooled] Difference (average precision) u.glasgow [Run glaentdnqe, TDN Auto, Pooled] 0.5 irit [Run CWNT, T Auto, Pooled] berkeley [Run BERK1MLEN01, TD Auto, Pooled] 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number A.84 Domain-Specific Overview Graphs DS-Monolingual-RU CLEF 2005 − Top 4 participants of Domain Specific Monolingual RU − Interpolated Recall vs Average Precision 100% berkeley−2 [Avg. Prec. 30.38%; Run BK2GMLRU1, TD Auto, Pooled] unine [Avg. Prec. 27.74%; Run UniNEgru2, TD Auto, Pooled] 90% berkeley [Avg. Prec. 24.09%; Run BERK1MLRU01, TD Auto, Pooled] u.glasgow [Avg. Prec. 5.53%; Run glarutdqe, TD Auto, Pooled] 80% 70% Average Precision 60% 50% 40% 30% 20% 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 − Top 4 participants of Domain Specific Monolingual RU − Retrieved documents vs Precision 100% berkeley−2 [Exact Prec. 29.42%, Run BK2GMLRU1, TD Auto, Pooled] unine [Exact Prec. 28.32%, Run UniNEgru2, TD Auto, Pooled] 90% berkeley [Exact Prec. 24.71%, Run BERK1MLRU01, TD Auto, Pooled] u.glasgow [Exact Prec. 6.89%, Run glarutdqe, TD Auto, Pooled] 80% 70% 60% R−Precision 50% 40% 30% 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) A.85 Domain-Specific Overview Graphs DS-Monolingual-RU CLEF 2005 − Top 4 participants of Domain Specific Monolingual RU − Comparison to median by topic (topics 126 to 138) 1 berkeley−2 [Run BK2GMLRU1, TD Auto, Pooled] unine [Run UniNEgru2, TD Auto, Pooled] Difference (average precision) berkeley [Run BERK1MLRU01, TD Auto, Pooled] 0.5 u.glasgow [Run glarutdqe, TD Auto, Pooled] 0 −0.5 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic Number CLEF 2005 − Top 4 participants of Domain Specific Monolingual RU − Comparison to median by topic (topics 139 to 150) 1 berkeley−2 [Run BK2GMLRU1, TD Auto, Pooled] unine [Run UniNEgru2, TD Auto, Pooled] Difference (average precision) berkeley [Run BERK1MLRU01, TD Auto, Pooled] 0.5 u.glasgow [Run glarutdqe, TD Auto, Pooled] 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number # of Relevant Retrieved Docs @ 100 # of Relevant Retrieved Docs @ 1000 Average Precision % Topic ID Best Median Worst Best Median Worst Best Median Worst 126 27 15 3 30 26 3 54.37 20.04 00.75 127 88 84 15 113 110 19 90.36 82.95 10.38 128 38 23 3 46 44 7 70.85 26.12 00.59 129 3 3 0 3 3 0 05.96 02.79 00.00 130 4 1 0 6 2 1 12.27 01.43 00.01 131 2 0 0 2 0 0 100.00 00.05 00.00 132 1 1 0 3 1 0 12.50 02.70 00.00 133 7 2 0 7 6 0 17.91 06.06 00.00 134 23 6 0 25 12 1 39.17 09.92 00.18 135 45 18 0 56 48 2 53.40 14.63 00.01 136 62 37 5 85 76 7 69.05 50.87 00.50 137 15 8 0 20 17 0 28.70 17.96 00.00 138 27 21 2 28 28 2 53.13 47.02 02.41 139 71 51 13 124 115 14 61.60 42.82 02.54 140 7 4 1 10 9 2 05.03 03.68 00.72 141 15 1 0 19 3 0 28.47 04.54 00.00 142 62 29 12 81 80 13 76.98 30.85 06.80 143 2 2 0 2 2 0 100.00 26.66 00.00 144 4 0 0 6 4 3 04.02 00.89 00.43 145 75 64 2 108 98 22 65.53 58.08 00.87 146 1 0 0 1 1 0 04.35 01.97 00.00 147 1 0 0 1 0 0 12.50 00.00 00.00 148 7 5 0 8 6 0 39.39 24.92 00.00 149 3 1 0 5 4 0 20.66 01.10 00.00 150 0 0 0 0 0 0 00.00 00.00 00.00 A.86 Domain-Specific Overview Graphs DS-Monolingual-RU CLEF 2005 − Top 5 participants of Domain Specific Monolingual RU − Interpolated Recall vs Average Precision 100% berkeley−2 [Avg. Prec. 30.38%; Run BK2GMLRU1, TD Auto, Pooled] unine [Avg. Prec. 27.74%; Run UniNEgru2, TD Auto, Pooled] 90% berkeley [Avg. Prec. 24.09%; Run BERK1MLRU01, TD Auto, Pooled] u.glasgow [Avg. Prec. 5.53%; Run glarutdqe, TD Auto, Pooled] msu−nivc [Avg. Prec. 2.09%; Run cirRSSCru2ru, TDN Auto, Pooled] 80% 70% Average Precision 60% 50% 40% 30% 20% 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 − Top 5 participants of Domain Specific Monolingual RU − Retrieved documents vs Precision 100% berkeley−2 [Exact Prec. 29.42%, Run BK2GMLRU1, TD Auto, Pooled] unine [Exact Prec. 28.32%, Run UniNEgru2, TD Auto, Pooled] 90% berkeley [Exact Prec. 24.71%, Run BERK1MLRU01, TD Auto, Pooled] u.glasgow [Exact Prec. 6.89%, Run glarutdqe, TD Auto, Pooled] msu−nivc [Exact Prec. 3.74%, Run cirRSSCru2ru, TDN Auto, Pooled] 80% 70% 60% R−Precision 50% 40% 30% 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) A.87 Domain-Specific Overview Graphs DS-Monolingual-RU CLEF 2005 − Top 5 participants of Domain Specific Monolingual RU − Comparison to median by topic (topics 126 to 138) 1 berkeley−2 [Run BK2GMLRU1, TD Auto, Pooled] unine [Run UniNEgru2, TD Auto, Pooled] Difference (average precision) berkeley [Run BERK1MLRU01, TD Auto, Pooled] 0.5 u.glasgow [Run glarutdqe, TD Auto, Pooled] msu−nivc [Run cirRSSCru2ru, TDN Auto, Pooled] 0 −0.5 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic Number CLEF 2005 − Top 5 participants of Domain Specific Monolingual RU − Comparison to median by topic (topics 139 to 150) 1 berkeley−2 [Run BK2GMLRU1, TD Auto, Pooled] unine [Run UniNEgru2, TD Auto, Pooled] Difference (average precision) berkeley [Run BERK1MLRU01, TD Auto, Pooled] 0.5 u.glasgow [Run glarutdqe, TD Auto, Pooled] msu−nivc [Run cirRSSCru2ru, TDN Auto, Pooled] 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number A.88 Individual Results A.89 A.90 cmu adhocM3Trntest AH-2-years-on Overall statistics for 40 queries : General info: Total number of documents over all queries Track= Ad Hoc Multilingual 2-years-on Retrieved 40,000 RunType= automatic Relevant 7,153 QueryType= TD Relevant retrieved 4,807 Pooled= false CLEF 2005 AH−2−years−on − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 86.49 adhocM3Trntest 90% 10 72.16 20 64.25 80% 30 58.40 70% 40 51.33 50 44.30 Average Precision 60% 60 38.43 50% 70 29.43 80 21.68 40% 90 14.40 30% 100 4.15 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 43.06 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−2−years−on − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 72.50 adhocM3Trntest 90% 10 docs 67.00 15 docs 61.83 80% 20 docs 59.25 70% 30 docs 55.42 100 docs 39.75 60% R−Precision 200 docs 30.92 50% 500 docs 19.54 1000 docs 12.02 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 44.99 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 161 to 180) queries 1 adhocM3Trntest Topic 161 31.30 Topic 181 33.06 Difference (average precision) Topic 162 81.42 Topic 182 53.13 0.5 Topic 163 72.17 Topic 183 36.71 Topic 164 2.93 Topic 184 28.88 Topic 165 33.45 Topic 185 25.76 0 Topic 166 0.54 Topic 186 50.95 Topic 167 51.20 Topic 187 66.21 −0.5 Topic 168 19.61 Topic 188 36.59 Topic 169 1.94 Topic 189 66.48 Topic 170 67.67 Topic 190 7.41 −1 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 Topic 171 1.86 Topic 191 100.00 Topic Number Topic 172 6.18 Topic 192 62.18 Topic 173 62.01 Topic 193 29.56 CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 181 to 200) Topic 174 66.66 Topic 194 62.79 1 Topic 175 66.66 Topic 195 36.42 adhocM3Trntest Difference (average precision) Topic 176 86.76 Topic 196 72.22 0.5 Topic 177 31.09 Topic 197 49.49 Topic 178 5.12 Topic 198 21.43 Topic 179 49.60 Topic 199 72.29 0 Topic 180 36.54 Topic 200 35.95 −0.5 −1 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 Topic Number A.91 cmu adhocM4Trntest AH-2-years-on Overall statistics for 40 queries : General info: Total number of documents over all queries Track= Ad Hoc Multilingual 2-years-on Retrieved 40,000 RunType= automatic Relevant 7,153 QueryType= TD Relevant retrieved 4,927 Pooled= false CLEF 2005 AH−2−years−on − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 88.36 adhocM4Trntest 90% 10 71.76 20 64.78 80% 30 56.37 70% 40 51.20 50 44.28 Average Precision 60% 60 39.36 50% 70 30.10 80 22.45 40% 90 15.14 30% 100 4.29 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 43.42 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−2−years−on − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 70.00 adhocM4Trntest 90% 10 docs 65.25 15 docs 62.50 80% 20 docs 59.25 70% 30 docs 55.75 100 docs 40.45 60% R−Precision 200 docs 31.61 50% 500 docs 19.93 1000 docs 12.32 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 44.80 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 161 to 180) queries 1 adhocM4Trntest Topic 161 29.47 Topic 181 32.81 Difference (average precision) Topic 162 85.84 Topic 182 50.17 0.5 Topic 163 74.57 Topic 183 36.12 Topic 164 4.05 Topic 184 31.57 Topic 165 34.81 Topic 185 17.15 0 Topic 166 0.74 Topic 186 51.45 Topic 167 51.07 Topic 187 60.46 −0.5 Topic 168 21.41 Topic 188 34.87 Topic 169 2.15 Topic 189 67.67 Topic 170 58.68 Topic 190 7.87 −1 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 Topic 171 1.89 Topic 191 100.00 Topic Number Topic 172 6.15 Topic 192 77.60 Topic 173 56.47 Topic 193 27.91 CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 181 to 200) Topic 174 67.87 Topic 194 64.67 1 Topic 175 64.77 Topic 195 38.74 adhocM4Trntest Difference (average precision) Topic 176 88.19 Topic 196 73.08 0.5 Topic 177 35.06 Topic 197 53.64 Topic 178 6.03 Topic 198 18.91 Topic 179 52.79 Topic 199 71.29 0 Topic 180 39.61 Topic 200 39.07 −0.5 −1 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 Topic Number A.92 cmu adhocM5Trntest AH-2-years-on Overall statistics for 40 queries : General info: Total number of documents over all queries Track= Ad Hoc Multilingual 2-years-on Retrieved 40,000 RunType= automatic Relevant 7,153 QueryType= TD Relevant retrieved 5,204 Pooled= false CLEF 2005 AH−2−years−on − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 86.68 adhocM5Trntest 90% 10 72.51 20 64.83 80% 30 57.88 70% 40 52.86 50 47.37 Average Precision 60% 60 42.06 50% 70 33.86 80 24.89 40% 90 17.35 30% 100 5.49 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 44.93 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−2−years−on − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 64.50 adhocM5Trntest 90% 10 docs 64.00 15 docs 61.00 80% 20 docs 59.37 70% 30 docs 56.92 100 docs 41.52 60% R−Precision 200 docs 33.16 50% 500 docs 21.07 1000 docs 13.01 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 46.55 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 161 to 180) queries 1 adhocM5Trntest Topic 161 24.04 Topic 181 39.02 Difference (average precision) Topic 162 83.46 Topic 182 58.72 0.5 Topic 163 72.56 Topic 183 25.74 Topic 164 3.96 Topic 184 38.88 Topic 165 43.67 Topic 185 17.48 0 Topic 166 0.80 Topic 186 52.09 Topic 167 55.20 Topic 187 53.08 −0.5 Topic 168 24.65 Topic 188 35.92 Topic 169 2.05 Topic 189 72.52 Topic 170 48.02 Topic 190 12.56 −1 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 Topic 171 4.49 Topic 191 100.00 Topic Number Topic 172 13.08 Topic 192 78.95 Topic 173 62.55 Topic 193 27.32 CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 181 to 200) Topic 174 77.85 Topic 194 58.41 1 Topic 175 66.86 Topic 195 31.50 adhocM5Trntest Difference (average precision) Topic 176 92.21 Topic 196 73.78 0.5 Topic 177 32.21 Topic 197 59.71 Topic 178 8.24 Topic 198 22.09 Topic 179 61.63 Topic 199 74.95 0 Topic 180 43.34 Topic 200 43.72 −0.5 −1 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 Topic Number A.93 cmu adhocM5w1test AH-2-years-on Overall statistics for 40 queries : General info: Total number of documents over all queries Track= Ad Hoc Multilingual 2-years-on Retrieved 40,000 RunType= automatic Relevant 7,153 QueryType= TD Relevant retrieved 5,084 Pooled= false CLEF 2005 AH−2−years−on − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 87.57 adhocM5w1test 90% 10 71.94 20 65.70 80% 30 57.45 70% 40 53.15 50 45.75 Average Precision 60% 60 41.25 50% 70 32.01 80 23.60 40% 90 16.11 30% 100 3.88 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 44.56 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−2−years−on − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 66.50 adhocM5w1test 90% 10 docs 65.25 15 docs 62.67 80% 20 docs 59.62 70% 30 docs 56.33 100 docs 41.22 60% R−Precision 200 docs 32.40 50% 500 docs 20.59 1000 docs 12.71 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 46.21 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 161 to 180) queries 1 adhocM5w1test Topic 161 28.61 Topic 181 35.17 Difference (average precision) Topic 162 84.36 Topic 182 54.35 0.5 Topic 163 75.30 Topic 183 30.27 Topic 164 3.70 Topic 184 38.79 Topic 165 36.85 Topic 185 13.75 0 Topic 166 0.56 Topic 186 51.36 Topic 167 53.79 Topic 187 50.54 −0.5 Topic 168 25.61 Topic 188 45.52 Topic 169 2.77 Topic 189 65.79 Topic 170 57.45 Topic 190 10.68 −1 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 Topic 171 2.43 Topic 191 100.00 Topic Number Topic 172 9.69 Topic 192 74.00 Topic 173 67.98 Topic 193 25.68 CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 181 to 200) Topic 174 75.69 Topic 194 57.76 1 Topic 175 65.92 Topic 195 37.17 adhocM5w1test Difference (average precision) Topic 176 91.87 Topic 196 71.77 0.5 Topic 177 35.71 Topic 197 58.10 Topic 178 7.14 Topic 198 19.73 Topic 179 57.92 Topic 199 73.34 0 Topic 180 40.70 Topic 200 44.49 −0.5 −1 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 Topic Number A.94 isi-unige ADJUSTEN AH-2-years-on Overall statistics for 40 queries : General info: Total number of documents over all queries Track= Ad Hoc Multilingual 2-years-on Retrieved 22,858 RunType= manual Relevant 7,153 QueryType= TDN Relevant retrieved 2,245 Pooled= false CLEF 2005 AH−2−years−on − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 60.08 ADJUSTEN 90% 10 37.68 20 28.84 80% 30 23.90 70% 40 19.77 50 16.74 Average Precision 60% 60 13.02 50% 70 9.17 80 4.82 40% 90 2.02 30% 100 0.04 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 16.85 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−2−years−on − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 38.00 ADJUSTEN 90% 10 docs 36.00 15 docs 33.50 80% 20 docs 33.25 70% 30 docs 31.25 100 docs 22.40 60% R−Precision 200 docs 16.46 50% 500 docs 9.48 1000 docs 5.61 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 24.26 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 161 to 180) queries 1 ADJUSTEN Topic 161 43.33 Topic 181 11.00 Difference (average precision) Topic 162 7.05 Topic 182 26.47 0.5 Topic 163 37.73 Topic 183 19.59 Topic 164 0.99 Topic 184 2.90 Topic 165 6.81 Topic 185 13.43 0 Topic 166 0.05 Topic 186 8.53 Topic 167 18.92 Topic 187 19.75 −0.5 Topic 168 7.04 Topic 188 56.81 Topic 169 0.56 Topic 189 75.91 Topic 170 1.34 Topic 190 0.01 −1 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 Topic 171 3.26 Topic 191 1.52 Topic Number Topic 172 1.06 Topic 192 19.76 Topic 173 29.27 Topic 193 4.36 CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 181 to 200) Topic 174 37.53 Topic 194 1.84 1 Topic 175 12.43 Topic 195 4.56 ADJUSTEN Difference (average precision) Topic 176 68.27 Topic 196 57.15 0.5 Topic 177 2.38 Topic 197 7.06 Topic 178 2.11 Topic 198 2.86 Topic 179 4.56 Topic 199 43.36 0 Topic 180 2.16 Topic 200 10.32 −0.5 −1 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 Topic Number A.95 isi-unige AUTOEN AH-2-years-on Overall statistics for 40 queries : General info: Total number of documents over all queries Track= Ad Hoc Multilingual 2-years-on Retrieved 20,405 RunType= automatic Relevant 7,153 QueryType= TD Relevant retrieved 1,544 Pooled= false CLEF 2005 AH−2−years−on − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 51.00 AUTOEN 90% 10 26.63 20 15.92 80% 30 13.05 70% 40 11.43 50 8.26 Average Precision 60% 60 7.69 50% 70 2.35 80 2.07 40% 90 2.07 30% 100 0.08 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 10.33 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−2−years−on − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 27.50 AUTOEN 90% 10 docs 28.50 15 docs 27.83 80% 20 docs 27.75 70% 30 docs 26.08 100 docs 16.23 60% R−Precision 200 docs 11.49 50% 500 docs 6.55 1000 docs 3.86 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 16.29 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 161 to 180) queries 1 AUTOEN Topic 161 5.56 Topic 181 7.30 Difference (average precision) Topic 162 4.19 Topic 182 0.20 0.5 Topic 163 15.71 Topic 183 4.34 Topic 164 0.02 Topic 184 4.01 Topic 165 3.20 Topic 185 13.10 0 Topic 166 0.32 Topic 186 7.51 Topic 167 22.12 Topic 187 8.88 −0.5 Topic 168 8.31 Topic 188 56.13 Topic 169 0.00 Topic 189 75.91 Topic 170 0.01 Topic 190 0.02 −1 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 Topic 171 1.26 Topic 191 3.33 Topic Number Topic 172 1.13 Topic 192 20.58 Topic 173 2.89 Topic 193 3.57 CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 181 to 200) Topic 174 14.79 Topic 194 1.26 1 Topic 175 5.51 Topic 195 0.08 AUTOEN Difference (average precision) Topic 176 16.29 Topic 196 47.29 0.5 Topic 177 0.83 Topic 197 7.17 Topic 178 0.28 Topic 198 2.86 Topic 179 4.54 Topic 199 33.30 0 Topic 180 0.65 Topic 200 8.65 −0.5 −1 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 Topic Number A.96 isi-unige FEEDBCKEN AH-2-years-on Overall statistics for 40 queries : General info: Total number of documents over all queries Track= Ad Hoc Multilingual 2-years-on Retrieved 23,075 RunType= manual Relevant 7,153 QueryType= TDN Relevant retrieved 2,221 Pooled= false CLEF 2005 AH−2−years−on − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 90.21 FEEDBCKEN 90% 10 44.45 20 35.10 80% 30 29.46 70% 40 24.17 50 18.30 Average Precision 60% 60 14.57 50% 70 10.06 80 4.83 40% 90 1.61 30% 100 0.04 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 21.02 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−2−years−on − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 54.00 FEEDBCKEN 90% 10 docs 50.00 15 docs 46.33 80% 20 docs 43.50 70% 30 docs 39.58 100 docs 24.88 60% R−Precision 200 docs 18.05 50% 500 docs 9.59 1000 docs 5.55 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 27.41 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 161 to 180) queries 1 FEEDBCKEN Topic 161 39.87 Topic 181 10.55 Difference (average precision) Topic 162 8.83 Topic 182 19.94 0.5 Topic 163 38.30 Topic 183 31.80 Topic 164 1.33 Topic 184 1.89 Topic 165 43.19 Topic 185 14.25 0 Topic 166 0.05 Topic 186 13.76 Topic 167 21.26 Topic 187 16.99 −0.5 Topic 168 25.54 Topic 188 51.29 Topic 169 0.56 Topic 189 71.95 Topic 170 5.15 Topic 190 0.01 −1 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 Topic 171 9.16 Topic 191 1.52 Topic Number Topic 172 3.99 Topic 192 35.43 Topic 173 36.69 Topic 193 3.01 CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 181 to 200) Topic 174 62.31 Topic 194 6.07 1 Topic 175 19.41 Topic 195 32.20 FEEDBCKEN Difference (average precision) Topic 176 68.20 Topic 196 60.02 0.5 Topic 177 3.14 Topic 197 7.92 Topic 178 2.57 Topic 198 2.86 Topic 179 5.20 Topic 199 45.16 0 Topic 180 3.41 Topic 200 16.20 −0.5 −1 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 Topic Number A.97 isi-unige ADJUSTSP AH-2-years-on Overall statistics for 40 queries : General info: Total number of documents over all queries Track= Ad Hoc Multilingual 2-years-on Retrieved 23,075 RunType= manual Relevant 7,153 QueryType= TDN Relevant retrieved 2,312 Pooled= false CLEF 2005 AH−2−years−on − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 51.33 ADJUSTSP 90% 10 36.76 20 25.04 80% 30 18.34 70% 40 14.45 50 10.25 Average Precision 60% 60 7.66 50% 70 5.84 80 4.02 40% 90 0.03 30% 100 0.03 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 13.80 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−2−years−on − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 34.50 ADJUSTSP 90% 10 docs 34.25 15 docs 32.50 80% 20 docs 32.62 70% 30 docs 29.83 100 docs 20.78 60% R−Precision 200 docs 16.10 50% 500 docs 9.41 1000 docs 5.78 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 20.97 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 161 to 180) queries 1 ADJUSTSP Topic 161 45.11 Topic 181 9.07 Difference (average precision) Topic 162 0.78 Topic 182 23.41 0.5 Topic 163 9.04 Topic 183 5.71 Topic 164 1.58 Topic 184 2.32 Topic 165 6.00 Topic 185 0.33 0 Topic 166 0.12 Topic 186 10.23 Topic 167 12.02 Topic 187 19.30 −0.5 Topic 168 7.59 Topic 188 0.00 Topic 169 0.14 Topic 189 5.78 Topic 170 3.46 Topic 190 0.01 −1 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 Topic 171 2.95 Topic 191 1.28 Topic Number Topic 172 0.64 Topic 192 26.21 Topic 173 36.78 Topic 193 7.29 CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 181 to 200) Topic 174 41.10 Topic 194 15.99 1 Topic 175 13.40 Topic 195 0.43 ADJUSTSP Difference (average precision) Topic 176 68.28 Topic 196 51.12 0.5 Topic 177 1.09 Topic 197 13.66 Topic 178 18.74 Topic 198 9.06 Topic 179 13.79 Topic 199 25.51 0 Topic 180 34.04 Topic 200 8.46 −0.5 −1 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 Topic Number A.98 isi-unige ADJUSTFR AH-2-years-on Overall statistics for 40 queries : General info: Total number of documents over all queries Track= Ad Hoc Multilingual 2-years-on Retrieved 21,875 RunType= manual Relevant 7,153 QueryType= TDN Relevant retrieved 2,134 Pooled= false CLEF 2005 AH−2−years−on − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 60.91 ADJUSTFR 90% 10 31.51 20 23.28 80% 30 18.13 70% 40 14.64 50 12.14 Average Precision 60% 60 8.67 50% 70 5.80 80 3.27 40% 90 0.22 30% 100 0.07 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 13.47 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−2−years−on − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 36.50 ADJUSTFR 90% 10 docs 33.25 15 docs 31.50 80% 20 docs 30.37 70% 30 docs 29.17 100 docs 19.85 60% R−Precision 200 docs 15.25 50% 500 docs 8.89 1000 docs 5.33 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 19.44 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 161 to 180) queries 1 ADJUSTFR Topic 161 26.42 Topic 181 7.57 Difference (average precision) Topic 162 41.96 Topic 182 5.31 0.5 Topic 163 10.97 Topic 183 27.02 Topic 164 8.95 Topic 184 2.99 Topic 165 11.22 Topic 185 0.00 0 Topic 166 0.01 Topic 186 0.88 Topic 167 22.53 Topic 187 18.50 −0.5 Topic 168 6.79 Topic 188 52.45 Topic 169 0.50 Topic 189 6.67 Topic 170 0.51 Topic 190 0.15 −1 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 Topic 171 1.01 Topic 191 2.78 Topic Number Topic 172 1.42 Topic 192 23.89 Topic 173 51.19 Topic 193 6.69 CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 181 to 200) Topic 174 38.06 Topic 194 1.02 1 Topic 175 24.85 Topic 195 2.90 ADJUSTFR Difference (average precision) Topic 176 66.24 Topic 196 3.75 0.5 Topic 177 4.50 Topic 197 16.32 Topic 178 1.26 Topic 198 1.43 Topic 179 8.03 Topic 199 5.70 0 Topic 180 26.26 Topic 200 0.15 −0.5 −1 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 Topic Number A.99 isi-unige ADJUSTDU AH-2-years-on Overall statistics for 40 queries : General info: Total number of documents over all queries Track= Ad Hoc Multilingual 2-years-on Retrieved 15,366 RunType= manual Relevant 7,153 QueryType= TDN Relevant retrieved 1,445 Pooled= false CLEF 2005 AH−2−years−on − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 62.54 ADJUSTDU 90% 10 32.85 20 23.20 80% 30 14.95 70% 40 13.15 50 11.80 Average Precision 60% 60 10.77 50% 70 8.26 80 5.40 40% 90 3.54 30% 100 0.00 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 13.90 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−2−years−on − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 39.00 ADJUSTDU 90% 10 docs 36.25 15 docs 32.83 80% 20 docs 30.13 70% 30 docs 28.25 100 docs 17.88 60% R−Precision 200 docs 11.70 50% 500 docs 6.30 1000 docs 3.61 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 18.36 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 161 to 180) queries 1 ADJUSTDU Topic 161 27.57 Topic 181 0.24 Difference (average precision) Topic 162 30.08 Topic 182 8.97 0.5 Topic 163 16.02 Topic 183 0.48 Topic 164 1.64 Topic 184 1.21 Topic 165 6.91 Topic 185 25.61 0 Topic 166 0.00 Topic 186 0.00 Topic 167 18.72 Topic 187 12.60 −0.5 Topic 168 7.30 Topic 188 36.23 Topic 169 0.01 Topic 189 66.39 Topic 170 16.89 Topic 190 4.03 −1 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 Topic 171 4.94 Topic 191 0.00 Topic Number Topic 172 0.28 Topic 192 17.56 Topic 173 29.67 Topic 193 16.57 CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 181 to 200) Topic 174 42.99 Topic 194 0.00 1 Topic 175 10.86 Topic 195 1.35 ADJUSTDU Difference (average precision) Topic 176 65.24 Topic 196 57.50 0.5 Topic 177 0.50 Topic 197 2.84 Topic 178 0.00 Topic 198 1.43 Topic 179 6.44 Topic 199 11.56 0 Topic 180 2.98 Topic 200 2.56 −0.5 −1 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 Topic Number A.100 jaen UJAPRFRSV2RR AH-2-years-on Overall statistics for 40 queries : General info: Total number of documents over all queries Track= Ad Hoc Multilingual 2-years-on Retrieved 40,000 RunType= automatic Relevant 7,153 QueryType= TD Relevant retrieved 4,108 Pooled= false CLEF 2005 AH−2−years−on − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 75.73 UJAPRFRSV2RR 90% 10 59.59 20 52.08 80% 30 41.98 70% 40 33.33 50 27.92 Average Precision 60% 60 19.99 50% 70 15.24 80 9.66 40% 90 5.58 30% 100 1.63 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 29.57 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−2−years−on − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 59.50 UJAPRFRSV2RR 90% 10 docs 54.25 15 docs 53.67 80% 20 docs 50.88 70% 30 docs 47.75 100 docs 34.38 60% R−Precision 200 docs 26.39 50% 500 docs 16.42 1000 docs 10.27 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 33.85 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 161 to 180) queries 1 UJAPRFRSV2RR Topic 161 0.02 Topic 181 30.04 Difference (average precision) Topic 162 51.29 Topic 182 42.30 0.5 Topic 163 59.92 Topic 183 23.98 Topic 164 0.93 Topic 184 23.64 Topic 165 36.09 Topic 185 9.15 0 Topic 166 0.03 Topic 186 28.68 Topic 167 47.57 Topic 187 19.98 −0.5 Topic 168 19.87 Topic 188 37.00 Topic 169 0.73 Topic 189 35.86 Topic 170 31.60 Topic 190 23.22 −1 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 Topic 171 7.55 Topic 191 25.00 Topic Number Topic 172 7.54 Topic 192 55.21 Topic 173 60.32 Topic 193 20.45 CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 181 to 200) Topic 174 82.44 Topic 194 27.11 1 Topic 175 16.16 Topic 195 17.98 UJAPRFRSV2RR Difference (average precision) Topic 176 91.16 Topic 196 49.35 0.5 Topic 177 16.66 Topic 197 44.15 Topic 178 7.60 Topic 198 2.67 Topic 179 21.91 Topic 199 73.00 0 Topic 180 4.57 Topic 200 29.97 −0.5 −1 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 Topic Number A.101 jaen UJARSV2 AH-2-years-on Overall statistics for 40 queries : General info: Total number of documents over all queries Track= Ad Hoc Multilingual 2-years-on Retrieved 40,000 RunType= automatic Relevant 7,153 QueryType= TD Relevant retrieved 3,774 Pooled= false CLEF 2005 AH−2−years−on − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 76.45 UJARSV2 90% 10 57.83 20 49.79 80% 30 41.08 70% 40 31.36 50 26.12 Average Precision 60% 60 19.21 50% 70 14.17 80 9.56 40% 90 5.88 30% 100 2.50 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 28.78 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−2−years−on − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 60.50 UJARSV2 90% 10 docs 56.00 15 docs 51.83 80% 20 docs 49.38 70% 30 docs 45.08 100 docs 30.42 60% R−Precision 200 docs 23.80 50% 500 docs 15.07 1000 docs 9.44 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 33.22 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 161 to 180) queries 1 UJARSV2 Topic 161 0.01 Topic 181 29.19 Difference (average precision) Topic 162 45.85 Topic 182 43.64 0.5 Topic 163 60.40 Topic 183 19.31 Topic 164 1.27 Topic 184 25.78 Topic 165 22.72 Topic 185 14.01 0 Topic 166 0.16 Topic 186 16.81 Topic 167 35.84 Topic 187 17.34 −0.5 Topic 168 12.40 Topic 188 42.44 Topic 169 0.96 Topic 189 48.53 Topic 170 21.45 Topic 190 18.93 −1 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 Topic 171 5.39 Topic 191 100.00 Topic Number Topic 172 7.07 Topic 192 29.55 Topic 173 66.72 Topic 193 15.33 CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 181 to 200) Topic 174 66.41 Topic 194 26.55 1 Topic 175 27.98 Topic 195 14.67 UJARSV2 Difference (average precision) Topic 176 84.31 Topic 196 57.55 0.5 Topic 177 23.72 Topic 197 46.06 Topic 178 0.54 Topic 198 7.48 Topic 179 10.37 Topic 199 66.93 0 Topic 180 2.13 Topic 200 15.40 −0.5 −1 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 Topic Number A.102 jaen UJARSV2RR AH-2-years-on Overall statistics for 40 queries : General info: Total number of documents over all queries Track= Ad Hoc Multilingual 2-years-on Retrieved 40,000 RunType= automatic Relevant 7,153 QueryType= TD Relevant retrieved 3,884 Pooled= false CLEF 2005 AH−2−years−on − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 75.82 UJARSV2RR 90% 10 56.71 20 50.47 80% 30 41.76 70% 40 33.19 50 27.73 Average Precision 60% 60 21.04 50% 70 14.41 80 9.84 40% 90 5.98 30% 100 2.50 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 29.19 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−2−years−on − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 58.50 UJARSV2RR 90% 10 docs 54.00 15 docs 50.67 80% 20 docs 49.12 70% 30 docs 44.83 100 docs 31.00 60% R−Precision 200 docs 24.45 50% 500 docs 15.56 1000 docs 9.71 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 34.15 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 161 to 180) queries 1 UJARSV2RR Topic 161 0.02 Topic 181 30.00 Difference (average precision) Topic 162 45.72 Topic 182 40.85 0.5 Topic 163 62.88 Topic 183 20.06 Topic 164 1.03 Topic 184 25.64 Topic 165 23.05 Topic 185 14.18 0 Topic 166 0.23 Topic 186 20.34 Topic 167 40.39 Topic 187 20.77 −0.5 Topic 168 13.17 Topic 188 48.55 Topic 169 0.77 Topic 189 49.70 Topic 170 20.44 Topic 190 19.07 −1 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 Topic 171 5.98 Topic 191 100.00 Topic Number Topic 172 7.10 Topic 192 28.72 Topic 173 63.57 Topic 193 17.38 CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 181 to 200) Topic 174 66.79 Topic 194 27.74 1 Topic 175 26.56 Topic 195 14.83 UJARSV2RR Difference (average precision) Topic 176 85.12 Topic 196 50.78 0.5 Topic 177 20.41 Topic 197 50.31 Topic 178 0.53 Topic 198 4.63 Topic 179 11.75 Topic 199 68.67 0 Topic 180 2.48 Topic 200 17.35 −0.5 −1 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 Topic Number A.103 jaen UJAUARSV2RR AH-2-years-on Overall statistics for 40 queries : General info: Total number of documents over all queries Track= Ad Hoc Multilingual 2-years-on Retrieved 40,000 RunType= automatic Relevant 7,153 QueryType= TD Relevant retrieved 3,884 Pooled= false CLEF 2005 AH−2−years−on − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 75.88 UJAUARSV2RR 90% 10 56.69 20 50.67 80% 30 41.89 70% 40 33.06 50 27.32 Average Precision 60% 60 20.90 50% 70 14.41 80 9.83 40% 90 5.98 30% 100 2.50 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 29.18 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−2−years−on − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 58.50 UJAUARSV2RR 90% 10 docs 53.50 15 docs 51.17 80% 20 docs 49.00 70% 30 docs 45.00 100 docs 31.08 60% R−Precision 200 docs 24.51 50% 500 docs 15.65 1000 docs 9.71 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 34.26 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 161 to 180) queries 1 UJAUARSV2RR Topic 161 0.02 Topic 181 30.01 Difference (average precision) Topic 162 45.28 Topic 182 40.80 0.5 Topic 163 62.58 Topic 183 20.04 Topic 164 1.06 Topic 184 25.63 Topic 165 23.08 Topic 185 14.23 0 Topic 166 0.23 Topic 186 20.34 Topic 167 40.52 Topic 187 20.36 −0.5 Topic 168 13.32 Topic 188 48.68 Topic 169 0.84 Topic 189 49.27 Topic 170 20.48 Topic 190 18.16 −1 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 Topic 171 5.99 Topic 191 100.00 Topic Number Topic 172 6.96 Topic 192 28.79 Topic 173 63.68 Topic 193 17.38 CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 181 to 200) Topic 174 66.60 Topic 194 27.99 1 Topic 175 26.65 Topic 195 14.72 UJAUARSV2RR Difference (average precision) Topic 176 85.08 Topic 196 50.85 0.5 Topic 177 20.40 Topic 197 50.19 Topic 178 0.53 Topic 198 4.81 Topic 179 13.02 Topic 199 68.66 0 Topic 180 2.49 Topic 200 17.45 −0.5 −1 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 Topic Number A.104 miracle enml0XSRpHL AH-2-years-on Overall statistics for 40 queries : General info: Total number of documents over all queries Track= Ad Hoc Multilingual 2-years-on Retrieved 40,000 RunType= automatic Relevant 7,153 QueryType= TDN Relevant retrieved 4,373 Pooled= false CLEF 2005 AH−2−years−on − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 75.43 enml0XSRpHL 90% 10 57.91 20 48.62 80% 30 43.19 70% 40 38.41 50 31.91 Average Precision 60% 60 25.04 50% 70 18.07 80 12.63 40% 90 7.26 30% 100 1.86 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 30.78 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−2−years−on − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 57.50 enml0XSRpHL 90% 10 docs 51.25 15 docs 51.17 80% 20 docs 50.13 70% 30 docs 47.50 100 docs 36.17 60% R−Precision 200 docs 27.70 50% 500 docs 17.45 1000 docs 10.93 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 36.60 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 161 to 180) queries 1 enml0XSRpHL Topic 161 3.08 Topic 181 35.00 Difference (average precision) Topic 162 53.98 Topic 182 54.80 0.5 Topic 163 37.32 Topic 183 27.84 Topic 164 0.54 Topic 184 32.68 Topic 165 35.41 Topic 185 20.82 0 Topic 166 0.82 Topic 186 9.06 Topic 167 31.69 Topic 187 36.73 −0.5 Topic 168 15.99 Topic 188 36.14 Topic 169 1.19 Topic 189 66.24 Topic 170 39.66 Topic 190 25.72 −1 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 Topic 171 11.75 Topic 191 9.09 Topic Number Topic 172 2.81 Topic 192 45.88 Topic 173 40.04 Topic 193 25.04 CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 181 to 200) Topic 174 85.74 Topic 194 15.33 1 Topic 175 22.70 Topic 195 22.37 enml0XSRpHL Difference (average precision) Topic 176 84.13 Topic 196 65.36 0.5 Topic 177 15.37 Topic 197 43.64 Topic 178 4.22 Topic 198 10.26 Topic 179 19.75 Topic 199 71.21 0 Topic 180 45.55 Topic 200 26.17 −0.5 −1 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 Topic Number A.105 miracle enmlSTpH AH-2-years-on Overall statistics for 40 queries : General info: Total number of documents over all queries Track= Ad Hoc Multilingual 2-years-on Retrieved 40,000 RunType= automatic Relevant 7,153 QueryType= TD Relevant retrieved 2,896 Pooled= false CLEF 2005 AH−2−years−on − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 79.78 enmlSTpH 90% 10 52.73 20 40.67 80% 30 30.05 70% 40 23.50 50 16.06 Average Precision 60% 60 9.96 50% 70 7.18 80 4.19 40% 90 3.47 30% 100 2.50 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 21.97 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−2−years−on − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 55.50 enmlSTpH 90% 10 docs 51.75 15 docs 47.50 80% 20 docs 44.12 70% 30 docs 39.92 100 docs 26.82 60% R−Precision 200 docs 19.90 50% 500 docs 11.54 1000 docs 7.24 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 27.83 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 161 to 180) queries 1 enmlSTpH Topic 161 0.07 Topic 181 15.50 Difference (average precision) Topic 162 45.77 Topic 182 34.71 0.5 Topic 163 17.01 Topic 183 9.21 Topic 164 0.16 Topic 184 30.95 Topic 165 35.63 Topic 185 9.33 0 Topic 166 0.18 Topic 186 4.50 Topic 167 24.53 Topic 187 11.19 −0.5 Topic 168 1.11 Topic 188 29.45 Topic 169 0.70 Topic 189 36.28 Topic 170 13.01 Topic 190 5.33 −1 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 Topic 171 2.58 Topic 191 100.00 Topic Number Topic 172 4.59 Topic 192 8.10 Topic 173 47.91 Topic 193 13.45 CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 181 to 200) Topic 174 53.12 Topic 194 14.35 1 Topic 175 27.10 Topic 195 7.04 enmlSTpH Difference (average precision) Topic 176 74.77 Topic 196 44.47 0.5 Topic 177 12.15 Topic 197 32.25 Topic 178 4.00 Topic 198 12.27 Topic 179 5.15 Topic 199 52.38 0 Topic 180 23.81 Topic 200 14.73 −0.5 −1 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 Topic Number A.106 miracle enmlSTpHL AH-2-years-on Overall statistics for 40 queries : General info: Total number of documents over all queries Track= Ad Hoc Multilingual 2-years-on Retrieved 40,000 RunType= automatic Relevant 7,153 QueryType= TD Relevant retrieved 4,106 Pooled= false CLEF 2005 AH−2−years−on − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 73.07 enmlSTpHL 90% 10 49.81 20 38.98 80% 30 32.44 70% 40 27.25 50 23.05 Average Precision 60% 60 19.92 50% 70 14.91 80 10.53 40% 90 5.53 30% 100 1.72 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 24.83 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−2−years−on − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 54.50 enmlSTpHL 90% 10 docs 48.00 15 docs 44.33 80% 20 docs 42.50 70% 30 docs 39.58 100 docs 30.30 60% R−Precision 200 docs 23.80 50% 500 docs 15.77 1000 docs 10.26 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 29.97 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 161 to 180) queries 1 enmlSTpHL Topic 161 0.07 Topic 181 24.20 Difference (average precision) Topic 162 49.26 Topic 182 38.49 0.5 Topic 163 50.88 Topic 183 10.54 Topic 164 0.50 Topic 184 24.69 Topic 165 17.96 Topic 185 15.82 0 Topic 166 0.77 Topic 186 9.72 Topic 167 32.55 Topic 187 9.82 −0.5 Topic 168 13.33 Topic 188 18.81 Topic 169 0.91 Topic 189 60.60 Topic 170 32.88 Topic 190 12.62 −1 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 Topic 171 14.97 Topic 191 16.67 Topic Number Topic 172 3.40 Topic 192 16.25 Topic 173 21.95 Topic 193 25.64 CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 181 to 200) Topic 174 77.79 Topic 194 8.58 1 Topic 175 18.88 Topic 195 16.03 enmlSTpHL Difference (average precision) Topic 176 82.72 Topic 196 62.37 0.5 Topic 177 17.51 Topic 197 51.64 Topic 178 2.62 Topic 198 7.98 Topic 179 14.52 Topic 199 65.58 0 Topic 180 30.90 Topic 200 12.63 −0.5 −1 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 Topic Number A.107 miracle enmlXSRpA AH-2-years-on Overall statistics for 40 queries : General info: Total number of documents over all queries Track= Ad Hoc Multilingual 2-years-on Retrieved 40,000 RunType= automatic Relevant 7,153 QueryType= TDN Relevant retrieved 4,208 Pooled= false CLEF 2005 AH−2−years−on − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 84.87 enmlXSRpA 90% 10 54.60 20 43.48 80% 30 33.85 70% 40 29.44 50 22.15 Average Precision 60% 60 17.06 50% 70 12.09 80 6.41 40% 90 3.63 30% 100 1.33 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 25.53 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−2−years−on − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 58.50 enmlXSRpA 90% 10 docs 56.25 15 docs 53.50 80% 20 docs 49.50 70% 30 docs 44.08 100 docs 29.55 60% R−Precision 200 docs 22.50 50% 500 docs 13.84 1000 docs 10.52 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 28.75 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 161 to 180) queries 1 enmlXSRpA Topic 161 5.68 Topic 181 30.35 Difference (average precision) Topic 162 51.36 Topic 182 59.60 0.5 Topic 163 24.40 Topic 183 23.25 Topic 164 1.71 Topic 184 24.93 Topic 165 37.38 Topic 185 8.54 0 Topic 166 1.02 Topic 186 6.50 Topic 167 21.33 Topic 187 27.00 −0.5 Topic 168 8.33 Topic 188 32.44 Topic 169 0.15 Topic 189 29.35 Topic 170 21.15 Topic 190 10.16 −1 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 Topic 171 3.38 Topic 191 50.00 Topic Number Topic 172 4.86 Topic 192 31.02 Topic 173 57.22 Topic 193 13.20 CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 181 to 200) Topic 174 68.92 Topic 194 22.58 1 Topic 175 5.48 Topic 195 11.04 enmlXSRpA Difference (average precision) Topic 176 76.21 Topic 196 42.69 0.5 Topic 177 12.39 Topic 197 41.74 Topic 178 3.49 Topic 198 18.14 Topic 179 14.59 Topic 199 61.34 0 Topic 180 36.34 Topic 200 21.93 −0.5 −1 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 Topic Number A.108 miracle esml9XnteSRp AH-2-years-on Overall statistics for 40 queries : General info: Total number of documents over all queries Track= Ad Hoc Multilingual 2-years-on Retrieved 40,000 RunType= automatic Relevant 7,153 QueryType= TDN Relevant retrieved 4,101 Pooled= false CLEF 2005 AH−2−years−on − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 82.32 esml9XnteSRp 90% 10 59.63 20 48.38 80% 30 38.83 70% 40 33.13 50 25.98 Average Precision 60% 60 18.77 50% 70 13.99 80 8.97 40% 90 4.57 30% 100 0.94 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 28.28 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−2−years−on − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 66.00 esml9XnteSRp 90% 10 docs 59.50 15 docs 54.00 80% 20 docs 49.75 70% 30 docs 44.58 100 docs 29.98 60% R−Precision 200 docs 23.71 50% 500 docs 15.71 1000 docs 10.25 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 32.08 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 161 to 180) queries 1 esml9XnteSRp Topic 161 27.90 Topic 181 33.00 Difference (average precision) Topic 162 59.63 Topic 182 58.40 0.5 Topic 163 39.76 Topic 183 15.74 Topic 164 9.38 Topic 184 16.76 Topic 165 33.69 Topic 185 8.33 0 Topic 166 0.13 Topic 186 11.86 Topic 167 44.85 Topic 187 29.21 −0.5 Topic 168 13.50 Topic 188 24.85 Topic 169 0.72 Topic 189 55.15 Topic 170 63.54 Topic 190 0.86 −1 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 Topic 171 3.72 Topic 191 14.29 Topic Number Topic 172 5.19 Topic 192 12.03 Topic 173 55.86 Topic 193 9.19 CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 181 to 200) Topic 174 31.58 Topic 194 20.17 1 Topic 175 42.41 Topic 195 3.76 esml9XnteSRp Difference (average precision) Topic 176 80.41 Topic 196 66.13 0.5 Topic 177 16.58 Topic 197 36.21 Topic 178 8.18 Topic 198 13.74 Topic 179 21.22 Topic 199 67.44 0 Topic 180 40.20 Topic 200 35.48 −0.5 −1 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 Topic Number A.109 miracle esml9XstiSTp AH-2-years-on Overall statistics for 40 queries : General info: Total number of documents over all queries Track= Ad Hoc Multilingual 2-years-on Retrieved 40,000 RunType= automatic Relevant 7,153 QueryType= TD Relevant retrieved 3,679 Pooled= false CLEF 2005 AH−2−years−on − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 84.08 esml9XstiSTp 90% 10 56.43 20 46.95 80% 30 37.15 70% 40 27.12 50 21.71 Average Precision 60% 60 15.98 50% 70 12.20 80 7.54 40% 90 4.63 30% 100 1.25 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 26.06 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−2−years−on − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 63.00 esml9XstiSTp 90% 10 docs 56.25 15 docs 51.00 80% 20 docs 46.75 70% 30 docs 43.17 100 docs 28.77 60% R−Precision 200 docs 21.76 50% 500 docs 14.32 1000 docs 9.20 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 30.50 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 161 to 180) queries 1 esml9XstiSTp Topic 161 30.93 Topic 181 26.25 Difference (average precision) Topic 162 42.27 Topic 182 37.61 0.5 Topic 163 40.57 Topic 183 9.38 Topic 164 5.61 Topic 184 20.52 Topic 165 33.55 Topic 185 5.51 0 Topic 166 0.07 Topic 186 13.24 Topic 167 44.22 Topic 187 13.56 −0.5 Topic 168 10.54 Topic 188 28.30 Topic 169 0.10 Topic 189 60.57 Topic 170 28.70 Topic 190 1.13 −1 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 Topic 171 3.28 Topic 191 12.50 Topic Number Topic 172 6.10 Topic 192 42.13 Topic 173 56.13 Topic 193 9.08 CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 181 to 200) Topic 174 20.23 Topic 194 47.88 1 Topic 175 48.75 Topic 195 8.47 esml9XstiSTp Difference (average precision) Topic 176 75.86 Topic 196 73.70 0.5 Topic 177 13.41 Topic 197 42.87 Topic 178 22.23 Topic 198 9.41 Topic 179 4.69 Topic 199 63.20 0 Topic 180 9.02 Topic 200 20.91 −0.5 −1 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 Topic Number A.110 miracle frml9XntfSRp AH-2-years-on Overall statistics for 40 queries : General info: Total number of documents over all queries Track= Ad Hoc Multilingual 2-years-on Retrieved 40,000 RunType= automatic Relevant 7,153 QueryType= TDN Relevant retrieved 4,136 Pooled= false CLEF 2005 AH−2−years−on − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 78.28 frml9XntfSRp 90% 10 63.31 20 54.96 80% 30 47.30 70% 40 40.26 50 33.88 Average Precision 60% 60 25.51 50% 70 17.92 80 11.38 40% 90 6.49 30% 100 2.50 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 33.32 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−2−years−on − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 65.00 frml9XntfSRp 90% 10 docs 61.50 15 docs 58.67 80% 20 docs 56.50 70% 30 docs 51.50 100 docs 34.55 60% R−Precision 200 docs 26.36 50% 500 docs 16.38 1000 docs 10.34 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 37.99 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 161 to 180) queries 1 frml9XntfSRp Topic 161 0.08 Topic 181 34.78 Difference (average precision) Topic 162 59.63 Topic 182 42.20 0.5 Topic 163 40.13 Topic 183 24.67 Topic 164 10.08 Topic 184 45.23 Topic 165 33.45 Topic 185 6.93 0 Topic 166 0.79 Topic 186 3.30 Topic 167 47.05 Topic 187 24.34 −0.5 Topic 168 13.32 Topic 188 34.38 Topic 169 0.96 Topic 189 55.00 Topic 170 60.15 Topic 190 5.56 −1 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 Topic 171 5.79 Topic 191 100.00 Topic Number Topic 172 0.81 Topic 192 40.45 Topic 173 58.93 Topic 193 24.97 CLEF 2005 AH−2−years−on − Comparison to median by topic (topics 181 to 200) Topic 174 67.94 Topic 194 46.13 1 Topic 175 45.51 Topic 195 7.94 frml9XntfSRp Difference (average precision) Topic 176 89.51 Topic 196 64.44 0.5 Topic 177 16.21 Topic 197 42.64 Topic 178 4.64 Topic 198 9.61 Topic 179 23.70 Topic 199 61.71 0 Topic 180 54.46 Topic 200 25.41 −0.5 −1 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 Topic Number A.111 cmu HBC1000test AH-Merging Overall statistics for 40 queries : General info: Total number of documents over all queries Track= Ad Hoc Multilingual Merging Retrieved 39,759 RunType= automatic Relevant 7,153 QueryType= TD Relevant retrieved 3,905 Pooled= false CLEF 2005 AH−Merging − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 86.90 HBC1000test 90% 10 63.34 20 54.68 80% 30 49.49 70% 40 42.89 50 30.92 Average Precision 60% 60 24.72 50% 70 19.66 80 13.74 40% 90 8.06 30% 100 2.50 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 34.27 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Merging − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 65.50 HBC1000test 90% 10 docs 58.50 15 docs 56.67 80% 20 docs 54.25 70% 30 docs 50.50 100 docs 34.75 60% R−Precision 200 docs 26.55 50% 500 docs 16.48 1000 docs 9.76 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 39.06 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Merging − Comparison to median by topic (topics 161 to 180) queries 1 HBC1000test Topic 161 5.57 Topic 181 29.03 Difference (average precision) Topic 162 72.41 Topic 182 50.37 0.5 Topic 163 59.04 Topic 183 23.35 Topic 164 2.19 Topic 184 22.84 Topic 165 25.59 Topic 185 29.69 0 Topic 166 0.56 Topic 186 28.34 Topic 167 29.26 Topic 187 42.86 −0.5 Topic 168 15.24 Topic 188 25.59 Topic 169 1.55 Topic 189 68.25 Topic 170 61.94 Topic 190 6.55 −1 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 Topic 171 3.43 Topic 191 100.00 Topic Number Topic 172 5.10 Topic 192 38.58 Topic 173 64.21 Topic 193 32.37 CLEF 2005 AH−Merging − Comparison to median by topic (topics 181 to 200) Topic 174 53.87 Topic 194 47.53 1 Topic 175 37.53 Topic 195 24.15 HBC1000test Difference (average precision) Topic 176 82.14 Topic 196 73.48 0.5 Topic 177 14.68 Topic 197 37.86 Topic 178 1.48 Topic 198 22.96 Topic 179 27.14 Topic 199 73.28 0 Topic 180 4.80 Topic 200 26.07 −0.5 −1 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 Topic Number A.112 cmu HBC150test AH-Merging Overall statistics for 40 queries : General info: Total number of documents over all queries Track= Ad Hoc Multilingual Merging Retrieved 24,108 RunType= automatic Relevant 7,153 QueryType= TD Relevant retrieved 3,078 Pooled= false CLEF 2005 AH−Merging − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 85.30 HBC150test 90% 10 62.03 20 52.93 80% 30 42.48 70% 40 32.59 50 24.40 Average Precision 60% 60 21.47 50% 70 15.50 80 8.83 40% 90 5.95 30% 100 2.50 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 30.16 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Merging − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 63.00 HBC150test 90% 10 docs 56.75 15 docs 55.17 80% 20 docs 53.13 70% 30 docs 49.75 100 docs 32.95 60% R−Precision 200 docs 24.35 50% 500 docs 14.10 1000 docs 7.69 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 36.18 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Merging − Comparison to median by topic (topics 161 to 180) queries 1 HBC150test Topic 161 5.59 Topic 181 27.84 Difference (average precision) Topic 162 56.44 Topic 182 50.27 0.5 Topic 163 55.63 Topic 183 25.29 Topic 164 0.96 Topic 184 23.20 Topic 165 23.67 Topic 185 21.38 0 Topic 166 0.44 Topic 186 8.93 Topic 167 26.04 Topic 187 31.04 −0.5 Topic 168 7.70 Topic 188 28.17 Topic 169 1.69 Topic 189 66.08 Topic 170 50.68 Topic 190 8.22 −1 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 Topic 171 5.88 Topic 191 100.00 Topic Number Topic 172 3.88 Topic 192 30.04 Topic 173 60.67 Topic 193 29.21 CLEF 2005 AH−Merging − Comparison to median by topic (topics 181 to 200) Topic 174 60.32 Topic 194 27.89 1 Topic 175 32.15 Topic 195 14.87 HBC150test Difference (average precision) Topic 176 82.27 Topic 196 69.20 0.5 Topic 177 11.30 Topic 197 20.36 Topic 178 0.50 Topic 198 22.25 Topic 179 19.85 Topic 199 72.78 0 Topic 180 2.56 Topic 200 21.02 −0.5 −1 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 Topic Number A.113 cmu HBT150w05test AH-Merging Overall statistics for 40 queries : General info: Total number of documents over all queries Track= Ad Hoc Multilingual Merging Retrieved 40,000 RunType= automatic Relevant 7,153 QueryType= TD Relevant retrieved 3,172 Pooled= false CLEF 2005 AH−Merging − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 85.46 HBT150w05test 90% 10 59.31 20 50.32 80% 30 41.13 70% 40 31.63 50 25.70 Average Precision 60% 60 21.64 50% 70 16.69 80 9.09 40% 90 5.83 30% 100 2.50 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 29.66 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Merging − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 61.00 HBT150w05test 90% 10 docs 57.25 15 docs 55.00 80% 20 docs 52.63 70% 30 docs 48.83 100 docs 32.68 60% R−Precision 200 docs 24.01 50% 500 docs 14.11 1000 docs 7.93 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 35.36 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Merging − Comparison to median by topic (topics 161 to 180) queries 1 HBT150w05test Topic 161 5.58 Topic 181 26.63 Difference (average precision) Topic 162 50.93 Topic 182 54.71 0.5 Topic 163 58.26 Topic 183 21.55 Topic 164 1.27 Topic 184 26.01 Topic 165 21.27 Topic 185 17.50 0 Topic 166 0.36 Topic 186 7.58 Topic 167 24.73 Topic 187 26.21 −0.5 Topic 168 7.86 Topic 188 27.72 Topic 169 1.88 Topic 189 69.58 Topic 170 53.44 Topic 190 10.17 −1 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 Topic 171 6.25 Topic 191 100.00 Topic Number Topic 172 3.12 Topic 192 27.61 Topic 173 65.58 Topic 193 28.63 CLEF 2005 AH−Merging − Comparison to median by topic (topics 181 to 200) Topic 174 63.90 Topic 194 23.92 1 Topic 175 33.50 Topic 195 14.39 HBT150w05test Difference (average precision) Topic 176 80.85 Topic 196 64.69 0.5 Topic 177 10.39 Topic 197 21.12 Topic 178 0.75 Topic 198 15.25 Topic 179 20.43 Topic 199 68.46 0 Topic 180 3.70 Topic 200 20.75 −0.5 −1 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 Topic Number A.114 cmu HBT15w05test AH-Merging Overall statistics for 40 queries : General info: Total number of documents over all queries Track= Ad Hoc Multilingual Merging Retrieved 40,000 RunType= automatic Relevant 7,153 QueryType= TD Relevant retrieved 3,031 Pooled= false CLEF 2005 AH−Merging − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 82.74 HBT15w05test 90% 10 55.87 20 42.18 80% 30 34.36 70% 40 26.41 50 21.83 Average Precision 60% 60 17.92 50% 70 10.57 80 5.74 40% 90 4.51 30% 100 2.50 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 25.32 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Merging − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 62.00 HBT15w05test 90% 10 docs 56.75 15 docs 54.83 80% 20 docs 51.13 70% 30 docs 46.25 100 docs 27.92 60% R−Precision 200 docs 19.19 50% 500 docs 11.73 1000 docs 7.58 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 30.46 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Merging − Comparison to median by topic (topics 161 to 180) queries 1 HBT15w05test Topic 161 0.03 Topic 181 23.82 Difference (average precision) Topic 162 27.84 Topic 182 48.56 0.5 Topic 163 38.90 Topic 183 13.16 Topic 164 1.57 Topic 184 19.68 Topic 165 23.61 Topic 185 10.33 0 Topic 166 0.34 Topic 186 4.70 Topic 167 26.53 Topic 187 20.33 −0.5 Topic 168 4.62 Topic 188 32.15 Topic 169 2.65 Topic 189 69.30 Topic 170 47.14 Topic 190 8.86 −1 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 Topic 171 7.49 Topic 191 100.00 Topic Number Topic 172 3.07 Topic 192 14.48 Topic 173 65.43 Topic 193 20.16 CLEF 2005 AH−Merging − Comparison to median by topic (topics 181 to 200) Topic 174 62.43 Topic 194 24.88 1 Topic 175 27.21 Topic 195 8.24 HBT15w05test Difference (average precision) Topic 176 63.96 Topic 196 55.71 0.5 Topic 177 8.80 Topic 197 18.45 Topic 178 0.42 Topic 198 8.00 Topic 179 16.46 Topic 199 63.19 0 Topic 180 2.88 Topic 200 17.39 −0.5 −1 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 Topic Number A.115 cmu UNEC1000test AH-Merging Overall statistics for 40 queries : General info: Total number of documents over all queries Track= Ad Hoc Multilingual Merging Retrieved 39,938 RunType= automatic Relevant 7,153 QueryType= TD Relevant retrieved 4,671 Pooled= false CLEF 2005 AH−Merging − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 86.36 UNEC1000test 90% 10 65.21 20 56.53 80% 30 51.19 70% 40 46.15 50 39.29 Average Precision 60% 60 34.10 50% 70 25.52 80 17.94 40% 90 12.23 30% 100 3.88 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 38.16 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Merging − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 64.50 UNEC1000test 90% 10 docs 60.00 15 docs 58.00 80% 20 docs 55.25 70% 30 docs 51.08 100 docs 36.27 60% R−Precision 200 docs 28.25 50% 500 docs 18.68 1000 docs 11.68 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 41.73 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Merging − Comparison to median by topic (topics 161 to 180) queries 1 UNEC1000test Topic 161 5.79 Topic 181 31.34 Difference (average precision) Topic 162 73.28 Topic 182 50.60 0.5 Topic 163 60.14 Topic 183 27.41 Topic 164 2.01 Topic 184 20.04 Topic 165 28.17 Topic 185 29.70 0 Topic 166 0.52 Topic 186 40.96 Topic 167 48.79 Topic 187 55.65 −0.5 Topic 168 18.65 Topic 188 26.04 Topic 169 2.13 Topic 189 73.84 Topic 170 65.45 Topic 190 6.61 −1 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 Topic 171 3.43 Topic 191 100.00 Topic Number Topic 172 7.02 Topic 192 49.71 Topic 173 50.35 Topic 193 32.94 CLEF 2005 AH−Merging − Comparison to median by topic (topics 181 to 200) Topic 174 43.15 Topic 194 60.29 1 Topic 175 59.89 Topic 195 29.73 UNEC1000test Difference (average precision) Topic 176 82.06 Topic 196 72.60 0.5 Topic 177 20.03 Topic 197 49.67 Topic 178 3.16 Topic 198 22.82 Topic 179 44.69 Topic 199 73.41 0 Topic 180 25.82 Topic 200 28.37 −0.5 −1 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 Topic Number A.116 cmu UNEC150test AH-Merging Overall statistics for 40 queries : General info: Total number of documents over all queries Track= Ad Hoc Multilingual Merging Retrieved 30,384 RunType= automatic Relevant 7,153 QueryType= TD Relevant retrieved 4,644 Pooled= false CLEF 2005 AH−Merging − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 86.52 UNEC150test 90% 10 67.49 20 58.34 80% 30 53.79 70% 40 48.14 50 41.14 Average Precision 60% 60 34.35 50% 70 24.67 80 17.65 40% 90 9.86 30% 100 4.17 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 39.08 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Merging − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 65.50 UNEC150test 90% 10 docs 61.50 15 docs 58.67 80% 20 docs 56.88 70% 30 docs 52.67 100 docs 37.17 60% R−Precision 200 docs 29.10 50% 500 docs 19.14 1000 docs 11.61 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 42.65 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Merging − Comparison to median by topic (topics 161 to 180) queries 1 UNEC150test Topic 161 5.59 Topic 181 38.97 Difference (average precision) Topic 162 68.91 Topic 182 51.12 0.5 Topic 163 62.73 Topic 183 29.74 Topic 164 1.11 Topic 184 23.97 Topic 165 29.35 Topic 185 23.99 0 Topic 166 0.30 Topic 186 38.98 Topic 167 48.58 Topic 187 50.00 −0.5 Topic 168 20.10 Topic 188 29.64 Topic 169 1.28 Topic 189 73.86 Topic 170 65.80 Topic 190 8.30 −1 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 Topic 171 5.16 Topic 191 100.00 Topic Number Topic 172 10.18 Topic 192 49.67 Topic 173 51.67 Topic 193 30.66 CLEF 2005 AH−Merging − Comparison to median by topic (topics 181 to 200) Topic 174 53.07 Topic 194 60.39 1 Topic 175 60.96 Topic 195 29.12 UNEC150test Difference (average precision) Topic 176 82.63 Topic 196 72.96 0.5 Topic 177 21.56 Topic 197 55.96 Topic 178 4.49 Topic 198 21.63 Topic 179 49.49 Topic 199 73.69 0 Topic 180 25.99 Topic 200 31.59 −0.5 −1 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 Topic Number A.117 cmu UNET150w05test AH-Merging Overall statistics for 40 queries : General info: Total number of documents over all queries Track= Ad Hoc Multilingual Merging Retrieved 40,000 RunType= automatic Relevant 7,153 QueryType= TD Relevant retrieved 4,914 Pooled= false CLEF 2005 AH−Merging − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 85.78 UNET150w05test 90% 10 67.22 20 60.71 80% 30 56.28 70% 40 51.13 50 43.76 Average Precision 60% 60 37.56 50% 70 27.87 80 20.89 40% 90 11.37 30% 100 4.26 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 41.19 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Merging − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 66.00 UNET150w05test 90% 10 docs 62.75 15 docs 60.00 80% 20 docs 58.00 70% 30 docs 53.00 100 docs 39.40 60% R−Precision 200 docs 30.41 50% 500 docs 19.62 1000 docs 12.28 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 43.32 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Merging − Comparison to median by topic (topics 161 to 180) queries 1 UNET150w05test Topic 161 5.58 Topic 181 39.87 Difference (average precision) Topic 162 72.06 Topic 182 59.77 0.5 Topic 163 67.77 Topic 183 23.99 Topic 164 1.37 Topic 184 34.15 Topic 165 30.96 Topic 185 15.67 0 Topic 166 0.28 Topic 186 40.04 Topic 167 48.19 Topic 187 47.61 −0.5 Topic 168 22.24 Topic 188 39.49 Topic 169 1.68 Topic 189 74.24 Topic 170 61.07 Topic 190 14.90 −1 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 Topic 171 6.70 Topic 191 100.00 Topic Number Topic 172 8.63 Topic 192 52.24 Topic 173 61.88 Topic 193 29.17 CLEF 2005 AH−Merging − Comparison to median by topic (topics 181 to 200) Topic 174 74.22 Topic 194 54.39 1 Topic 175 64.48 Topic 195 31.38 UNET150w05test Difference (average precision) Topic 176 84.19 Topic 196 75.31 0.5 Topic 177 22.71 Topic 197 56.57 Topic 178 5.20 Topic 198 20.61 Topic 179 52.42 Topic 199 74.43 0 Topic 180 31.66 Topic 200 40.61 −0.5 −1 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 Topic Number A.118 cmu UNET15w05test AH-Merging Overall statistics for 40 queries : General info: Total number of documents over all queries Track= Ad Hoc Multilingual Merging Retrieved 40,000 RunType= automatic Relevant 7,153 QueryType= TD Relevant retrieved 4,820 Pooled= false CLEF 2005 AH−Merging − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 82.61 UNET15w05test 90% 10 66.14 20 60.56 80% 30 55.39 70% 40 49.72 50 44.16 Average Precision 60% 60 36.61 50% 70 27.43 80 19.43 40% 90 11.18 30% 100 3.40 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 40.19 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Merging − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 65.00 UNET15w05test 90% 10 docs 61.25 15 docs 59.17 80% 20 docs 56.75 70% 30 docs 53.50 100 docs 39.27 60% R−Precision 200 docs 29.70 50% 500 docs 18.33 1000 docs 12.05 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 43.03 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Merging − Comparison to median by topic (topics 161 to 180) queries 1 UNET15w05test Topic 161 0.04 Topic 181 38.55 Difference (average precision) Topic 162 68.88 Topic 182 56.61 0.5 Topic 163 63.53 Topic 183 18.45 Topic 164 1.67 Topic 184 43.81 Topic 165 30.36 Topic 185 11.34 0 Topic 166 0.19 Topic 186 38.14 Topic 167 53.64 Topic 187 49.03 −0.5 Topic 168 22.97 Topic 188 56.72 Topic 169 1.85 Topic 189 72.59 Topic 170 62.75 Topic 190 10.59 −1 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 Topic 171 7.13 Topic 191 100.00 Topic Number Topic 172 4.81 Topic 192 37.41 Topic 173 59.77 Topic 193 27.62 CLEF 2005 AH−Merging − Comparison to median by topic (topics 181 to 200) Topic 174 88.99 Topic 194 45.61 1 Topic 175 66.79 Topic 195 33.44 UNET15w05test Difference (average precision) Topic 176 77.85 Topic 196 76.04 0.5 Topic 177 19.43 Topic 197 52.37 Topic 178 2.41 Topic 198 18.11 Topic 179 45.56 Topic 199 73.36 0 Topic 180 29.56 Topic 200 39.77 −0.5 −1 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 Topic Number A.119 dcu dcu.Prositqgm1 AH-Merging Overall statistics for 40 queries : General info: Total number of documents over all queries Track= Ad Hoc Multilingual Merging Retrieved 40,000 RunType= automatic Relevant 7,153 QueryType= TD Relevant retrieved 4,486 Pooled= false CLEF 2005 AH−Merging − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 68.77 dcu.Prositqgm1 90% 10 54.97 20 49.60 80% 30 45.46 70% 40 39.61 50 36.02 Average Precision 60% 60 29.13 50% 70 22.59 80 15.03 40% 90 8.56 30% 100 1.90 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 32.41 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Merging − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 46.50 dcu.Prositqgm1 90% 10 docs 47.50 15 docs 47.50 80% 20 docs 47.00 70% 30 docs 45.92 100 docs 34.10 60% R−Precision 200 docs 26.84 50% 500 docs 17.71 1000 docs 11.21 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 35.87 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Merging − Comparison to median by topic (topics 161 to 180) queries 1 dcu.Prositqgm1 Topic 161 0.03 Topic 181 20.38 Difference (average precision) Topic 162 43.82 Topic 182 54.29 0.5 Topic 163 38.42 Topic 183 13.33 Topic 164 0.33 Topic 184 42.24 Topic 165 17.26 Topic 185 3.68 0 Topic 166 0.17 Topic 186 27.13 Topic 167 32.93 Topic 187 48.15 −0.5 Topic 168 9.50 Topic 188 69.81 Topic 169 1.22 Topic 189 57.29 Topic 170 35.03 Topic 190 42.83 −1 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 Topic 171 6.43 Topic 191 14.29 Topic Number Topic 172 1.47 Topic 192 58.51 Topic 173 72.76 Topic 193 30.12 CLEF 2005 AH−Merging − Comparison to median by topic (topics 181 to 200) Topic 174 81.53 Topic 194 30.17 1 Topic 175 38.93 Topic 195 37.75 dcu.Prositqgm1 Difference (average precision) Topic 176 83.69 Topic 196 50.84 0.5 Topic 177 16.59 Topic 197 30.32 Topic 178 1.34 Topic 198 6.57 Topic 179 27.56 Topic 199 66.50 0 Topic 180 53.70 Topic 200 29.46 −0.5 −1 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 Topic Number A.120 dcu dcu.Prositqgm2 AH-Merging Overall statistics for 40 queries : General info: Total number of documents over all queries Track= Ad Hoc Multilingual Merging Retrieved 40,000 RunType= automatic Relevant 7,153 QueryType= TD Relevant retrieved 4,512 Pooled= false CLEF 2005 AH−Merging − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 69.75 dcu.Prositqgm2 90% 10 55.59 20 50.02 80% 30 46.58 70% 40 39.91 50 36.79 Average Precision 60% 60 29.39 50% 70 22.96 80 15.38 40% 90 8.57 30% 100 1.80 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 32.86 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Merging − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 48.00 dcu.Prositqgm2 90% 10 docs 47.00 15 docs 47.33 80% 20 docs 47.25 70% 30 docs 46.08 100 docs 34.80 60% R−Precision 200 docs 27.21 50% 500 docs 17.77 1000 docs 11.28 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 36.25 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Merging − Comparison to median by topic (topics 161 to 180) queries 1 dcu.Prositqgm2 Topic 161 0.03 Topic 181 22.64 Difference (average precision) Topic 162 43.89 Topic 182 57.63 0.5 Topic 163 43.04 Topic 183 13.56 Topic 164 0.42 Topic 184 43.77 Topic 165 17.10 Topic 185 3.30 0 Topic 166 0.12 Topic 186 25.68 Topic 167 34.19 Topic 187 44.48 −0.5 Topic 168 8.71 Topic 188 67.84 Topic 169 1.20 Topic 189 62.97 Topic 170 37.44 Topic 190 42.51 −1 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 Topic 171 6.15 Topic 191 14.29 Topic Number Topic 172 1.56 Topic 192 58.25 Topic 173 73.64 Topic 193 27.44 CLEF 2005 AH−Merging − Comparison to median by topic (topics 181 to 200) Topic 174 80.46 Topic 194 31.72 1 Topic 175 39.68 Topic 195 35.94 dcu.Prositqgm2 Difference (average precision) Topic 176 86.01 Topic 196 51.67 0.5 Topic 177 17.04 Topic 197 30.16 Topic 178 1.50 Topic 198 6.38 Topic 179 30.06 Topic 199 67.06 0 Topic 180 53.76 Topic 200 30.88 −0.5 −1 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 Topic Number A.121 dcu dcu.Prositqgp AH-Merging Overall statistics for 40 queries : General info: Total number of documents over all queries Track= Ad Hoc Multilingual Merging Retrieved 40,000 RunType= automatic Relevant 7,153 QueryType= TD Relevant retrieved 4,404 Pooled= false CLEF 2005 AH−Merging − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 67.33 dcu.Prositqgp 90% 10 54.51 20 48.79 80% 30 44.33 70% 40 37.69 50 33.18 Average Precision 60% 60 26.87 50% 70 20.56 80 14.70 40% 90 7.91 30% 100 1.68 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 31.03 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Merging − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 45.50 dcu.Prositqgp 90% 10 docs 45.00 15 docs 46.17 80% 20 docs 46.37 70% 30 docs 44.58 100 docs 33.00 60% R−Precision 200 docs 26.09 50% 500 docs 17.27 1000 docs 11.01 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 35.05 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Merging − Comparison to median by topic (topics 161 to 180) queries 1 dcu.Prositqgp Topic 161 0.03 Topic 181 15.80 Difference (average precision) Topic 162 45.76 Topic 182 51.91 0.5 Topic 163 39.15 Topic 183 13.33 Topic 164 0.06 Topic 184 23.02 Topic 165 16.65 Topic 185 4.86 0 Topic 166 0.29 Topic 186 33.84 Topic 167 33.54 Topic 187 48.90 −0.5 Topic 168 12.37 Topic 188 56.79 Topic 169 0.84 Topic 189 55.38 Topic 170 33.53 Topic 190 29.61 −1 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 Topic 171 6.63 Topic 191 12.50 Topic Number Topic 172 1.81 Topic 192 47.26 Topic 173 72.23 Topic 193 29.12 CLEF 2005 AH−Merging − Comparison to median by topic (topics 181 to 200) Topic 174 83.10 Topic 194 29.45 1 Topic 175 33.76 Topic 195 35.64 dcu.Prositqgp Difference (average precision) Topic 176 83.28 Topic 196 53.04 0.5 Topic 177 17.17 Topic 197 34.69 Topic 178 0.99 Topic 198 7.57 Topic 179 27.53 Topic 199 68.10 0 Topic 180 53.13 Topic 200 28.60 −0.5 −1 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 Topic Number A.122 dcu dcu.Prositqgt AH-Merging Overall statistics for 40 queries : General info: Total number of documents over all queries Track= Ad Hoc Multilingual Merging Retrieved 40,000 RunType= automatic Relevant 7,153 QueryType= TD Relevant retrieved 4,477 Pooled= false CLEF 2005 AH−Merging − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 69.00 dcu.Prositqgt 90% 10 55.00 20 49.99 80% 30 46.31 70% 40 39.00 50 34.67 Average Precision 60% 60 27.50 50% 70 22.22 80 14.54 40% 90 7.86 30% 100 1.63 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 32.01 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Merging − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 46.50 dcu.Prositqgt 90% 10 docs 46.00 15 docs 46.83 80% 20 docs 46.50 70% 30 docs 44.58 100 docs 33.98 60% R−Precision 200 docs 27.07 50% 500 docs 17.67 1000 docs 11.19 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 35.86 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Merging − Comparison to median by topic (topics 161 to 180) queries 1 dcu.Prositqgt Topic 161 0.04 Topic 181 20.17 Difference (average precision) Topic 162 47.23 Topic 182 56.46 0.5 Topic 163 46.40 Topic 183 13.48 Topic 164 0.14 Topic 184 26.11 Topic 165 16.38 Topic 185 4.25 0 Topic 166 0.14 Topic 186 32.17 Topic 167 34.41 Topic 187 44.58 −0.5 Topic 168 12.04 Topic 188 56.21 Topic 169 0.79 Topic 189 61.06 Topic 170 35.88 Topic 190 29.76 −1 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 Topic 171 6.31 Topic 191 14.29 Topic Number Topic 172 2.06 Topic 192 49.60 Topic 173 73.76 Topic 193 27.04 CLEF 2005 AH−Merging − Comparison to median by topic (topics 181 to 200) Topic 174 81.79 Topic 194 31.15 1 Topic 175 36.48 Topic 195 32.99 dcu.Prositqgt Difference (average precision) Topic 176 85.79 Topic 196 54.05 0.5 Topic 177 17.58 Topic 197 37.42 Topic 178 1.38 Topic 198 6.91 Topic 179 31.93 Topic 199 69.13 0 Topic 180 52.88 Topic 200 30.23 −0.5 −1 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 Topic Number A.123 dcu dcu.humm1 AH-Merging Overall statistics for 40 queries : General info: Total number of documents over all queries Track= Ad Hoc Multilingual Merging Retrieved 40,000 RunType= automatic Relevant 7,153 QueryType= TD Relevant retrieved 2,873 Pooled= false CLEF 2005 AH−Merging − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 76.90 dcu.humm1 90% 10 45.67 20 32.68 80% 30 24.69 70% 40 20.37 50 16.42 Average Precision 60% 60 11.94 50% 70 8.38 80 4.61 40% 90 3.64 30% 100 0.83 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 19.88 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Merging − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 55.00 dcu.humm1 90% 10 docs 48.00 15 docs 44.33 80% 20 docs 42.62 70% 30 docs 38.17 100 docs 25.85 60% R−Precision 200 docs 18.60 50% 500 docs 11.10 1000 docs 7.18 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 23.80 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Merging − Comparison to median by topic (topics 161 to 180) queries 1 dcu.humm1 Topic 161 0.02 Topic 181 18.05 Difference (average precision) Topic 162 18.41 Topic 182 40.40 0.5 Topic 163 51.35 Topic 183 12.76 Topic 164 1.39 Topic 184 20.97 Topic 165 19.08 Topic 185 8.10 0 Topic 166 2.70 Topic 186 1.99 Topic 167 19.26 Topic 187 10.37 −0.5 Topic 168 3.74 Topic 188 20.75 Topic 169 0.24 Topic 189 55.03 Topic 170 28.69 Topic 190 12.74 −1 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 Topic 171 6.44 Topic 191 33.33 Topic Number Topic 172 1.38 Topic 192 16.52 Topic 173 56.64 Topic 193 20.04 CLEF 2005 AH−Merging − Comparison to median by topic (topics 181 to 200) Topic 174 46.08 Topic 194 9.14 1 Topic 175 24.02 Topic 195 3.55 dcu.humm1 Difference (average precision) Topic 176 81.80 Topic 196 42.85 0.5 Topic 177 6.11 Topic 197 16.01 Topic 178 0.10 Topic 198 7.21 Topic 179 9.36 Topic 199 54.84 0 Topic 180 2.50 Topic 200 11.14 −0.5 −1 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 Topic Number A.124 dcu dcu.humm2 AH-Merging Overall statistics for 40 queries : General info: Total number of documents over all queries Track= Ad Hoc Multilingual Merging Retrieved 40,000 RunType= automatic Relevant 7,153 QueryType= TD Relevant retrieved 2,846 Pooled= false CLEF 2005 AH−Merging − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 77.14 dcu.humm2 90% 10 41.42 20 30.08 80% 30 23.21 70% 40 19.56 50 15.11 Average Precision 60% 60 10.98 50% 70 8.34 80 4.55 40% 90 3.56 30% 100 0.83 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 18.46 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Merging − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 48.50 dcu.humm2 90% 10 docs 46.50 15 docs 43.00 80% 20 docs 41.00 70% 30 docs 36.25 100 docs 24.35 60% R−Precision 200 docs 17.94 50% 500 docs 11.00 1000 docs 7.12 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 21.72 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Merging − Comparison to median by topic (topics 161 to 180) queries 1 dcu.humm2 Topic 161 0.02 Topic 181 17.45 Difference (average precision) Topic 162 18.40 Topic 182 35.00 0.5 Topic 163 54.39 Topic 183 12.75 Topic 164 1.70 Topic 184 20.34 Topic 165 17.26 Topic 185 8.04 0 Topic 166 1.45 Topic 186 1.70 Topic 167 17.70 Topic 187 8.60 −0.5 Topic 168 3.69 Topic 188 19.00 Topic 169 0.27 Topic 189 53.31 Topic 170 21.20 Topic 190 10.31 −1 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 Topic 171 5.91 Topic 191 33.33 Topic Number Topic 172 1.64 Topic 192 15.29 Topic 173 53.19 Topic 193 17.17 CLEF 2005 AH−Merging − Comparison to median by topic (topics 181 to 200) Topic 174 29.52 Topic 194 11.57 1 Topic 175 25.36 Topic 195 2.42 dcu.humm2 Difference (average precision) Topic 176 79.35 Topic 196 37.08 0.5 Topic 177 6.95 Topic 197 13.44 Topic 178 0.16 Topic 198 6.87 Topic 179 7.67 Topic 199 53.44 0 Topic 180 5.71 Topic 200 9.93 −0.5 −1 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 Topic Number A.125 dcu dcu.hump AH-Merging Overall statistics for 40 queries : General info: Total number of documents over all queries Track= Ad Hoc Multilingual Merging Retrieved 40,000 RunType= automatic Relevant 7,153 QueryType= TD Relevant retrieved 2,892 Pooled= false CLEF 2005 AH−Merging − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 82.31 dcu.hump 90% 10 46.94 20 33.49 80% 30 26.59 70% 40 21.02 50 17.18 Average Precision 60% 60 13.31 50% 70 8.76 80 4.49 40% 90 2.99 30% 100 1.25 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 20.86 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Merging − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 57.00 dcu.hump 90% 10 docs 51.75 15 docs 47.33 80% 20 docs 44.62 70% 30 docs 39.58 100 docs 25.98 60% R−Precision 200 docs 19.24 50% 500 docs 11.68 1000 docs 7.23 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 23.93 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Merging − Comparison to median by topic (topics 161 to 180) queries 1 dcu.hump Topic 161 0.03 Topic 181 21.22 Difference (average precision) Topic 162 25.85 Topic 182 38.27 0.5 Topic 163 57.94 Topic 183 15.61 Topic 164 1.83 Topic 184 20.55 Topic 165 19.83 Topic 185 8.51 0 Topic 166 2.40 Topic 186 3.15 Topic 167 21.78 Topic 187 8.58 −0.5 Topic 168 3.77 Topic 188 19.88 Topic 169 0.34 Topic 189 55.83 Topic 170 22.61 Topic 190 4.48 −1 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 Topic 171 7.66 Topic 191 50.00 Topic Number Topic 172 0.98 Topic 192 16.56 Topic 173 65.73 Topic 193 17.23 CLEF 2005 AH−Merging − Comparison to median by topic (topics 181 to 200) Topic 174 49.54 Topic 194 17.29 1 Topic 175 16.46 Topic 195 4.46 dcu.hump Difference (average precision) Topic 176 83.91 Topic 196 39.62 0.5 Topic 177 6.16 Topic 197 16.11 Topic 178 0.20 Topic 198 7.08 Topic 179 11.72 Topic 199 50.98 0 Topic 180 5.53 Topic 200 14.93 −0.5 −1 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 Topic Number A.126 dcu dcu.humt AH-Merging Overall statistics for 40 queries : General info: Total number of documents over all queries Track= Ad Hoc Multilingual Merging Retrieved 40,000 RunType= automatic Relevant 7,153 QueryType= TD Relevant retrieved 2,442 Pooled= false CLEF 2005 AH−Merging − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 74.87 dcu.humt 90% 10 37.31 20 27.79 80% 30 20.95 70% 40 16.75 50 14.03 Average Precision 60% 60 11.53 50% 70 7.67 80 5.78 40% 90 3.75 30% 100 2.50 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 17.34 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Merging − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 44.50 dcu.humt 90% 10 docs 40.75 15 docs 38.17 80% 20 docs 36.38 70% 30 docs 32.75 100 docs 21.10 60% R−Precision 200 docs 15.60 50% 500 docs 9.61 1000 docs 6.11 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 22.38 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Merging − Comparison to median by topic (topics 161 to 180) queries 1 dcu.humt Topic 161 0.02 Topic 181 18.43 Difference (average precision) Topic 162 20.26 Topic 182 29.31 0.5 Topic 163 51.86 Topic 183 8.07 Topic 164 1.57 Topic 184 10.91 Topic 165 13.10 Topic 185 4.89 0 Topic 166 0.37 Topic 186 0.57 Topic 167 20.68 Topic 187 4.99 −0.5 Topic 168 3.62 Topic 188 10.01 Topic 169 0.34 Topic 189 43.53 Topic 170 6.53 Topic 190 2.30 −1 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 Topic 171 4.60 Topic 191 100.00 Topic Number Topic 172 1.61 Topic 192 4.81 Topic 173 62.23 Topic 193 9.04 CLEF 2005 AH−Merging − Comparison to median by topic (topics 181 to 200) Topic 174 38.42 Topic 194 10.56 1 Topic 175 20.87 Topic 195 0.42 dcu.humt Difference (average precision) Topic 176 78.28 Topic 196 23.99 0.5 Topic 177 7.05 Topic 197 7.93 Topic 178 0.18 Topic 198 6.08 Topic 179 5.16 Topic 199 44.50 0 Topic 180 8.26 Topic 200 8.28 −0.5 −1 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 Topic Number A.127 jaen UJAMENEDF AH-Merging Overall statistics for 40 queries : General info: Total number of documents over all queries Track= Ad Hoc Multilingual Merging Retrieved 40,000 RunType= automatic Relevant 7,153 QueryType= TD Relevant retrieved 3,862 Pooled= false CLEF 2005 AH−Merging − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 76.50 UJAMENEDF 90% 10 58.65 20 51.03 80% 30 42.58 70% 40 32.39 50 26.96 Average Precision 60% 60 19.71 50% 70 14.46 80 9.16 40% 90 5.91 30% 100 3.37 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 29.42 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Merging − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 60.00 UJAMENEDF 90% 10 docs 56.25 15 docs 52.17 80% 20 docs 49.88 70% 30 docs 45.58 100 docs 31.72 60% R−Precision 200 docs 24.51 50% 500 docs 15.34 1000 docs 9.66 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 33.82 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Merging − Comparison to median by topic (topics 161 to 180) queries 1 UJAMENEDF Topic 161 0.02 Topic 181 29.32 Difference (average precision) Topic 162 46.09 Topic 182 43.77 0.5 Topic 163 61.88 Topic 183 19.34 Topic 164 1.41 Topic 184 26.32 Topic 165 22.92 Topic 185 14.42 0 Topic 166 0.20 Topic 186 18.53 Topic 167 36.08 Topic 187 17.37 −0.5 Topic 168 12.41 Topic 188 43.86 Topic 169 1.52 Topic 189 49.44 Topic 170 21.62 Topic 190 20.93 −1 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 Topic 171 5.39 Topic 191 100.00 Topic Number Topic 172 7.21 Topic 192 33.27 Topic 173 63.58 Topic 193 15.20 CLEF 2005 AH−Merging − Comparison to median by topic (topics 181 to 200) Topic 174 67.44 Topic 194 26.99 1 Topic 175 28.75 Topic 195 14.82 UJAMENEDF Difference (average precision) Topic 176 85.52 Topic 196 57.58 0.5 Topic 177 20.96 Topic 197 46.27 Topic 178 0.57 Topic 198 7.82 Topic 179 10.67 Topic 199 66.93 0 Topic 180 2.52 Topic 200 27.73 −0.5 −1 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 Topic Number A.128 jaen UJAMENEDFRR AH-Merging Overall statistics for 40 queries : General info: Total number of documents over all queries Track= Ad Hoc Multilingual Merging Retrieved 40,000 RunType= automatic Relevant 7,153 QueryType= TD Relevant retrieved 4,071 Pooled= false CLEF 2005 AH−Merging − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 75.60 UJAMENEDFRR 90% 10 58.47 20 52.00 80% 30 43.55 70% 40 34.21 50 28.39 Average Precision 60% 60 22.35 50% 70 15.41 80 10.63 40% 90 6.09 30% 100 3.64 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 30.37 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Merging − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 58.50 UJAMENEDFRR 90% 10 docs 54.50 15 docs 51.67 80% 20 docs 50.00 70% 30 docs 46.17 100 docs 32.57 60% R−Precision 200 docs 25.34 50% 500 docs 16.10 1000 docs 10.18 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 35.24 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Merging − Comparison to median by topic (topics 161 to 180) queries 1 UJAMENEDFRR Topic 161 0.02 Topic 181 30.22 Difference (average precision) Topic 162 47.21 Topic 182 41.26 0.5 Topic 163 63.65 Topic 183 20.22 Topic 164 1.05 Topic 184 25.24 Topic 165 22.88 Topic 185 14.39 0 Topic 166 0.40 Topic 186 24.62 Topic 167 40.79 Topic 187 24.29 −0.5 Topic 168 11.53 Topic 188 54.85 Topic 169 1.53 Topic 189 50.60 Topic 170 20.51 Topic 190 24.93 −1 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 Topic 171 6.27 Topic 191 100.00 Topic Number Topic 172 6.90 Topic 192 32.36 Topic 173 63.52 Topic 193 18.39 CLEF 2005 AH−Merging − Comparison to median by topic (topics 181 to 200) Topic 174 69.31 Topic 194 28.76 1 Topic 175 25.74 Topic 195 15.14 UJAMENEDFRR Difference (average precision) Topic 176 85.55 Topic 196 51.38 0.5 Topic 177 20.34 Topic 197 53.52 Topic 178 0.91 Topic 198 5.33 Topic 179 12.55 Topic 199 67.45 0 Topic 180 3.65 Topic 200 27.65 −0.5 −1 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 Topic Number A.129 jaen UJAMENEOK AH-Merging Overall statistics for 40 queries : General info: Total number of documents over all queries Track= Ad Hoc Multilingual Merging Retrieved 40,000 RunType= automatic Relevant 7,153 QueryType= TD Relevant retrieved 3,764 Pooled= false CLEF 2005 AH−Merging − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 76.57 UJAMENEOK 90% 10 57.73 20 50.78 80% 30 40.92 70% 40 30.94 50 26.10 Average Precision 60% 60 19.05 50% 70 14.01 80 8.95 40% 90 5.92 30% 100 3.32 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 28.87 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Merging − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 60.50 UJAMENEOK 90% 10 docs 56.00 15 docs 51.83 80% 20 docs 49.50 70% 30 docs 45.33 100 docs 31.28 60% R−Precision 200 docs 24.04 50% 500 docs 15.02 1000 docs 9.41 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 33.13 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Merging − Comparison to median by topic (topics 161 to 180) queries 1 UJAMENEOK Topic 161 0.01 Topic 181 29.20 Difference (average precision) Topic 162 46.09 Topic 182 43.77 0.5 Topic 163 61.49 Topic 183 18.58 Topic 164 1.41 Topic 184 23.61 Topic 165 23.15 Topic 185 14.26 0 Topic 166 0.18 Topic 186 17.37 Topic 167 36.83 Topic 187 17.25 −0.5 Topic 168 12.40 Topic 188 42.96 Topic 169 1.12 Topic 189 48.93 Topic 170 21.71 Topic 190 17.60 −1 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 Topic 171 5.30 Topic 191 100.00 Topic Number Topic 172 7.48 Topic 192 29.14 Topic 173 63.27 Topic 193 15.20 CLEF 2005 AH−Merging − Comparison to median by topic (topics 181 to 200) Topic 174 67.10 Topic 194 27.50 1 Topic 175 29.56 Topic 195 14.81 UJAMENEOK Difference (average precision) Topic 176 85.54 Topic 196 57.57 0.5 Topic 177 18.13 Topic 197 46.04 Topic 178 0.55 Topic 198 7.54 Topic 179 10.37 Topic 199 66.93 0 Topic 180 2.26 Topic 200 22.68 −0.5 −1 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 Topic Number A.130 jaen UJAMENEOKRR AH-Merging Overall statistics for 40 queries : General info: Total number of documents over all queries Track= Ad Hoc Multilingual Merging Retrieved 40,000 RunType= automatic Relevant 7,153 QueryType= TD Relevant retrieved 3,764 Pooled= false CLEF 2005 AH−Merging − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 76.57 UJAMENEOKRR 90% 10 57.73 20 50.78 80% 30 40.92 70% 40 30.94 50 26.10 Average Precision 60% 60 19.05 50% 70 14.01 80 8.95 40% 90 5.92 30% 100 3.32 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 28.87 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Merging − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 60.50 UJAMENEOKRR 90% 10 docs 56.00 15 docs 51.83 80% 20 docs 49.50 70% 30 docs 45.33 100 docs 31.28 60% R−Precision 200 docs 24.04 50% 500 docs 15.02 1000 docs 9.41 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 33.13 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Merging − Comparison to median by topic (topics 161 to 180) queries 1 UJAMENEOKRR Topic 161 0.01 Topic 181 29.20 Difference (average precision) Topic 162 46.09 Topic 182 43.77 0.5 Topic 163 61.49 Topic 183 18.58 Topic 164 1.41 Topic 184 23.61 Topic 165 23.15 Topic 185 14.26 0 Topic 166 0.18 Topic 186 17.37 Topic 167 36.83 Topic 187 17.25 −0.5 Topic 168 12.40 Topic 188 42.96 Topic 169 1.12 Topic 189 48.93 Topic 170 21.71 Topic 190 17.60 −1 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 Topic 171 5.30 Topic 191 100.00 Topic Number Topic 172 7.48 Topic 192 29.14 Topic 173 63.27 Topic 193 15.20 CLEF 2005 AH−Merging − Comparison to median by topic (topics 181 to 200) Topic 174 67.10 Topic 194 27.50 1 Topic 175 29.56 Topic 195 14.81 UJAMENEOKRR Difference (average precision) Topic 176 85.54 Topic 196 57.57 0.5 Topic 177 18.13 Topic 197 46.04 Topic 178 0.55 Topic 198 7.54 Topic 179 10.37 Topic 199 66.93 0 Topic 180 2.26 Topic 200 22.68 −0.5 −1 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 Topic Number A.131 jhu-apl aplbienbga AH-Bilingual-X2BG Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual English to Bulgarian Retrieved 50,000 RunType= automatic Relevant 778 QueryType= TD Relevant retrieved 438 Pooled= true CLEF 2005 AH−Bilingual−X2BG − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 22.23 aplbienbga 90% 10 17.07 20 14.73 80% 30 10.54 70% 40 9.24 50 7.77 Average Precision 60% 60 6.07 50% 70 4.98 80 4.14 40% 90 1.96 30% 100 1.65 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 8.33 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2BG − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 10.80 aplbienbga 90% 10 docs 9.60 15 docs 8.40 80% 20 docs 7.70 70% 30 docs 6.73 100 docs 4.44 60% R−Precision 200 docs 2.97 50% 500 docs 1.50 1000 docs 0.88 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 7.56 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2BG − Comparison to median by topic (topics 251 to 275) queries 1 aplbienbga Topic 251 12.71 Topic 276 0.47 Difference (average precision) Topic 252 2.31 Topic 277 0.02 0.5 Topic 253 7.16 Topic 278 0.01 Topic 254 31.98 Topic 279 66.50 Topic 255 0.18 Topic 280 0.00 0 Topic 256 3.79 Topic 281 1.42 Topic 257 3.06 Topic 282 0.45 −0.5 Topic 258 0.00 Topic 283 0.00 Topic 259 0.13 Topic 284 15.42 Topic 260 0.00 Topic 285 0.00 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.41 Topic 286 1.11 Topic Number Topic 262 6.69 Topic 287 24.88 Topic 263 23.42 Topic 288 0.01 CLEF 2005 AH−Bilingual−X2BG − Comparison to median by topic (topics 276 to 300) Topic 264 10.49 Topic 289 4.78 1 Topic 265 0.02 Topic 290 0.10 aplbienbga Difference (average precision) Topic 266 0.17 Topic 291 15.40 0.5 Topic 267 13.63 Topic 292 0.00 Topic 268 0.38 Topic 293 6.21 Topic 269 31.68 Topic 294 70.15 0 Topic 270 36.28 Topic 295 0.83 Topic 271 0.00 Topic 296 0.00 Topic 272 0.00 Topic 297 0.10 −0.5 Topic 273 0.01 Topic 298 0.00 Topic 274 1.84 Topic 299 0.00 −1 Topic 275 0.89 Topic 300 21.22 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.132 jhu-apl aplbienbge AH-Bilingual-X2BG Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual English to Bulgarian Retrieved 50,000 RunType= automatic Relevant 778 QueryType= TD Relevant retrieved 423 Pooled= true CLEF 2005 AH−Bilingual−X2BG − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 21.86 aplbienbge 90% 10 18.27 20 16.13 80% 30 11.90 70% 40 11.02 50 9.23 Average Precision 60% 60 7.16 50% 70 6.54 80 5.33 40% 90 3.29 30% 100 2.67 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 9.59 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2BG − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 12.40 aplbienbge 90% 10 docs 10.80 15 docs 9.33 80% 20 docs 8.60 70% 30 docs 7.53 100 docs 4.62 60% R−Precision 200 docs 3.09 50% 500 docs 1.46 1000 docs 0.85 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 9.93 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2BG − Comparison to median by topic (topics 251 to 275) queries 1 aplbienbge Topic 251 11.29 Topic 276 0.46 Difference (average precision) Topic 252 1.76 Topic 277 0.18 0.5 Topic 253 28.52 Topic 278 0.00 Topic 254 33.78 Topic 279 94.44 Topic 255 0.17 Topic 280 0.03 0 Topic 256 12.84 Topic 281 1.51 Topic 257 3.50 Topic 282 0.01 −0.5 Topic 258 0.00 Topic 283 0.07 Topic 259 0.33 Topic 284 18.59 Topic 260 0.00 Topic 285 0.00 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.60 Topic 286 1.53 Topic Number Topic 262 0.24 Topic 287 14.47 Topic 263 26.07 Topic 288 0.01 CLEF 2005 AH−Bilingual−X2BG − Comparison to median by topic (topics 276 to 300) Topic 264 11.59 Topic 289 0.06 1 Topic 265 0.09 Topic 290 0.00 aplbienbge Difference (average precision) Topic 266 0.00 Topic 291 23.85 0.5 Topic 267 11.69 Topic 292 0.00 Topic 268 0.27 Topic 293 4.43 Topic 269 9.69 Topic 294 72.61 0 Topic 270 34.97 Topic 295 1.96 Topic 271 0.00 Topic 296 0.00 Topic 272 0.00 Topic 297 0.18 −0.5 Topic 273 0.09 Topic 298 0.00 Topic 274 25.94 Topic 299 0.00 −1 Topic 275 3.52 Topic 300 28.08 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.133 miracle ENXHT AH-Bilingual-X2BG Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual English to Bulgarian Retrieved 50,000 RunType= automatic Relevant 778 QueryType= TD Relevant retrieved 650 Pooled= true CLEF 2005 AH−Bilingual−X2BG − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 42.92 ENXHT 90% 10 33.41 20 29.71 80% 30 24.73 70% 40 20.12 50 16.76 Average Precision 60% 60 9.46 50% 70 7.98 80 5.66 40% 90 3.63 30% 100 2.08 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 16.35 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2BG − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 18.00 ENXHT 90% 10 docs 17.20 15 docs 16.00 80% 20 docs 14.30 70% 30 docs 12.40 100 docs 7.00 60% R−Precision 200 docs 4.41 50% 500 docs 2.20 1000 docs 1.30 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 17.25 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2BG − Comparison to median by topic (topics 251 to 275) queries 1 ENXHT Topic 251 23.49 Topic 276 9.87 Difference (average precision) Topic 252 2.13 Topic 277 4.66 0.5 Topic 253 7.98 Topic 278 1.06 Topic 254 28.64 Topic 279 12.39 Topic 255 0.95 Topic 280 3.01 0 Topic 256 50.72 Topic 281 11.33 Topic 257 14.70 Topic 282 3.92 −0.5 Topic 258 1.92 Topic 283 62.84 Topic 259 66.66 Topic 284 2.47 Topic 260 18.01 Topic 285 36.59 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 30.94 Topic 286 0.52 Topic Number Topic 262 25.13 Topic 287 21.59 Topic 263 1.51 Topic 288 0.79 CLEF 2005 AH−Bilingual−X2BG − Comparison to median by topic (topics 276 to 300) Topic 264 15.33 Topic 289 56.67 1 Topic 265 7.99 Topic 290 6.19 ENXHT Difference (average precision) Topic 266 7.34 Topic 291 20.31 0.5 Topic 267 9.71 Topic 292 0.00 Topic 268 48.65 Topic 293 63.84 Topic 269 0.84 Topic 294 33.32 0 Topic 270 20.69 Topic 295 48.40 Topic 271 1.58 Topic 296 0.00 Topic 272 0.00 Topic 297 3.52 −0.5 Topic 273 4.19 Topic 298 7.05 Topic 274 7.36 Topic 299 0.75 −1 Topic 275 6.04 Topic 300 4.07 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.134 miracle ENXST AH-Bilingual-X2BG Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual English to Bulgarian Retrieved 50,000 RunType= automatic Relevant 778 QueryType= TD Relevant retrieved 694 Pooled= true CLEF 2005 AH−Bilingual−X2BG − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 58.01 ENXST 90% 10 48.81 20 39.28 80% 30 32.85 70% 40 25.92 50 23.41 Average Precision 60% 60 15.71 50% 70 14.07 80 10.88 40% 90 6.82 30% 100 4.32 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 23.55 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2BG − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 27.20 ENXST 90% 10 docs 22.00 15 docs 18.53 80% 20 docs 17.50 70% 30 docs 15.73 100 docs 8.72 60% R−Precision 200 docs 5.12 50% 500 docs 2.42 1000 docs 1.39 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 23.38 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2BG − Comparison to median by topic (topics 251 to 275) queries 1 ENXST Topic 251 32.28 Topic 276 10.02 Difference (average precision) Topic 252 6.34 Topic 277 8.33 0.5 Topic 253 13.00 Topic 278 13.69 Topic 254 34.00 Topic 279 90.48 Topic 255 33.51 Topic 280 14.37 0 Topic 256 51.59 Topic 281 28.58 Topic 257 32.41 Topic 282 3.05 −0.5 Topic 258 20.00 Topic 283 71.72 Topic 259 65.12 Topic 284 4.27 Topic 260 27.51 Topic 285 43.06 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 24.77 Topic 286 0.95 Topic Number Topic 262 49.01 Topic 287 22.75 Topic 263 2.68 Topic 288 2.04 CLEF 2005 AH−Bilingual−X2BG − Comparison to median by topic (topics 276 to 300) Topic 264 17.30 Topic 289 53.85 1 Topic 265 16.61 Topic 290 7.03 ENXST Difference (average precision) Topic 266 20.80 Topic 291 29.37 0.5 Topic 267 11.62 Topic 292 0.00 Topic 268 44.63 Topic 293 49.16 Topic 269 0.99 Topic 294 50.73 0 Topic 270 10.95 Topic 295 54.76 Topic 271 6.12 Topic 296 0.00 Topic 272 3.23 Topic 297 2.19 −0.5 Topic 273 6.99 Topic 298 51.47 Topic 274 9.55 Topic 299 3.58 −1 Topic 275 16.01 Topic 300 5.17 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.135 u.glasgow glaenbgtd AH-Bilingual-X2BG Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual English to Bulgarian Retrieved 50,000 RunType= automatic Relevant 778 QueryType= TD Relevant retrieved 475 Pooled= true CLEF 2005 AH−Bilingual−X2BG − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 33.90 glaenbgtd 90% 10 25.62 20 20.45 80% 30 17.09 70% 40 13.78 50 10.13 Average Precision 60% 60 7.26 50% 70 6.18 80 4.07 40% 90 2.12 30% 100 1.60 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 12.04 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2BG − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 18.80 glaenbgtd 90% 10 docs 17.00 15 docs 14.40 80% 20 docs 12.60 70% 30 docs 10.47 100 docs 5.42 60% R−Precision 200 docs 3.36 50% 500 docs 1.68 1000 docs 0.95 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 13.36 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2BG − Comparison to median by topic (topics 251 to 275) queries 1 glaenbgtd Topic 251 6.97 Topic 276 2.14 Difference (average precision) Topic 252 0.48 Topic 277 36.38 0.5 Topic 253 15.54 Topic 278 5.43 Topic 254 11.89 Topic 279 7.70 Topic 255 0.95 Topic 280 4.96 0 Topic 256 0.79 Topic 281 23.61 Topic 257 23.44 Topic 282 1.56 −0.5 Topic 258 16.67 Topic 283 65.60 Topic 259 68.45 Topic 284 3.05 Topic 260 7.38 Topic 285 0.00 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 20.18 Topic 286 0.53 Topic Number Topic 262 5.69 Topic 287 10.23 Topic 263 1.47 Topic 288 0.85 CLEF 2005 AH−Bilingual−X2BG − Comparison to median by topic (topics 276 to 300) Topic 264 7.86 Topic 289 25.76 1 Topic 265 0.93 Topic 290 0.45 glaenbgtd Difference (average precision) Topic 266 5.00 Topic 291 20.41 0.5 Topic 267 5.20 Topic 292 0.00 Topic 268 39.44 Topic 293 49.83 Topic 269 0.00 Topic 294 35.31 0 Topic 270 0.85 Topic 295 36.64 Topic 271 1.64 Topic 296 0.00 Topic 272 0.00 Topic 297 12.40 −0.5 Topic 273 3.85 Topic 298 0.00 Topic 274 4.39 Topic 299 3.11 −1 Topic 275 1.15 Topic 300 5.60 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.136 u.glasgow glaenbgtdn1 AH-Bilingual-X2BG Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual English to Bulgarian Retrieved 50,000 RunType= automatic Relevant 778 QueryType= TDN Relevant retrieved 505 Pooled= true CLEF 2005 AH−Bilingual−X2BG − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 38.11 glaenbgtdn1 90% 10 32.66 20 23.95 80% 30 18.68 70% 40 15.27 50 11.90 Average Precision 60% 60 8.03 50% 70 6.02 80 3.84 40% 90 1.60 30% 100 1.25 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 13.44 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2BG − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 23.20 glaenbgtdn1 90% 10 docs 18.60 15 docs 15.60 80% 20 docs 14.30 70% 30 docs 11.73 100 docs 5.88 60% R−Precision 200 docs 3.51 50% 500 docs 1.74 1000 docs 1.01 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 14.51 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2BG − Comparison to median by topic (topics 251 to 275) queries 1 glaenbgtdn1 Topic 251 2.56 Topic 276 2.14 Difference (average precision) Topic 252 9.05 Topic 277 45.68 0.5 Topic 253 18.97 Topic 278 3.15 Topic 254 18.97 Topic 279 43.88 Topic 255 2.16 Topic 280 4.79 0 Topic 256 1.87 Topic 281 19.84 Topic 257 28.22 Topic 282 2.18 −0.5 Topic 258 0.78 Topic 283 62.36 Topic 259 68.98 Topic 284 4.09 Topic 260 9.04 Topic 285 0.00 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 12.04 Topic 286 1.60 Topic Number Topic 262 4.17 Topic 287 19.86 Topic 263 1.37 Topic 288 0.99 CLEF 2005 AH−Bilingual−X2BG − Comparison to median by topic (topics 276 to 300) Topic 264 4.77 Topic 289 14.29 1 Topic 265 0.51 Topic 290 2.19 glaenbgtdn1 Difference (average precision) Topic 266 6.12 Topic 291 20.32 0.5 Topic 267 6.53 Topic 292 0.00 Topic 268 38.47 Topic 293 41.00 Topic 269 0.18 Topic 294 39.41 0 Topic 270 0.74 Topic 295 39.83 Topic 271 0.37 Topic 296 0.00 Topic 272 0.00 Topic 297 28.23 −0.5 Topic 273 12.96 Topic 298 0.16 Topic 274 4.25 Topic 299 6.66 −1 Topic 275 13.50 Topic 300 2.73 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.137 u.glasgow glaenbgtdn2 AH-Bilingual-X2BG Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual English to Bulgarian Retrieved 50,000 RunType= automatic Relevant 778 QueryType= TDN Relevant retrieved 491 Pooled= true CLEF 2005 AH−Bilingual−X2BG − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 37.70 glaenbgtdn2 90% 10 32.02 20 22.27 80% 30 17.98 70% 40 14.84 50 11.39 Average Precision 60% 60 7.51 50% 70 5.56 80 3.69 40% 90 1.61 30% 100 1.27 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 12.90 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2BG − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 20.40 glaenbgtdn2 90% 10 docs 19.20 15 docs 15.87 80% 20 docs 14.00 70% 30 docs 11.00 100 docs 5.74 60% R−Precision 200 docs 3.51 50% 500 docs 1.72 1000 docs 0.98 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 14.22 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2BG − Comparison to median by topic (topics 251 to 275) queries 1 glaenbgtdn2 Topic 251 3.24 Topic 276 2.95 Difference (average precision) Topic 252 7.15 Topic 277 36.18 0.5 Topic 253 14.93 Topic 278 2.36 Topic 254 18.82 Topic 279 33.17 Topic 255 2.72 Topic 280 4.43 0 Topic 256 1.42 Topic 281 19.98 Topic 257 25.59 Topic 282 1.49 −0.5 Topic 258 0.40 Topic 283 58.99 Topic 259 69.84 Topic 284 3.57 Topic 260 6.96 Topic 285 0.00 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 26.60 Topic 286 0.94 Topic Number Topic 262 5.40 Topic 287 17.67 Topic 263 1.46 Topic 288 1.41 CLEF 2005 AH−Bilingual−X2BG − Comparison to median by topic (topics 276 to 300) Topic 264 4.12 Topic 289 26.67 1 Topic 265 0.68 Topic 290 1.59 glaenbgtdn2 Difference (average precision) Topic 266 6.33 Topic 291 16.59 0.5 Topic 267 5.64 Topic 292 0.00 Topic 268 36.68 Topic 293 45.37 Topic 269 0.08 Topic 294 39.25 0 Topic 270 1.11 Topic 295 34.09 Topic 271 0.14 Topic 296 0.00 Topic 272 0.00 Topic 297 22.89 −0.5 Topic 273 10.42 Topic 298 0.12 Topic 274 4.32 Topic 299 6.51 −1 Topic 275 12.32 Topic 300 2.21 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.138 u.glasgow glaenbgtdnqe1 AH-Bilingual-X2BG Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual English to Bulgarian Retrieved 50,000 RunType= automatic Relevant 778 QueryType= TDN Relevant retrieved 583 Pooled= false CLEF 2005 AH−Bilingual−X2BG − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 43.14 glaenbgtdnqe1 90% 10 36.76 20 30.09 80% 30 24.15 70% 40 21.04 50 18.47 Average Precision 60% 60 13.23 50% 70 11.11 80 7.80 40% 90 4.00 30% 100 2.25 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 17.99 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2BG − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 24.00 glaenbgtdnqe1 90% 10 docs 21.20 15 docs 18.27 80% 20 docs 16.10 70% 30 docs 13.73 100 docs 7.38 60% R−Precision 200 docs 4.46 50% 500 docs 2.11 1000 docs 1.17 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 17.10 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2BG − Comparison to median by topic (topics 251 to 275) queries 1 glaenbgtdnqe1 Topic 251 4.47 Topic 276 1.66 Difference (average precision) Topic 252 8.94 Topic 277 53.63 0.5 Topic 253 27.74 Topic 278 1.20 Topic 254 28.05 Topic 279 64.55 Topic 255 1.29 Topic 280 5.16 0 Topic 256 4.35 Topic 281 31.89 Topic 257 28.67 Topic 282 3.01 −0.5 Topic 258 0.13 Topic 283 76.27 Topic 259 69.84 Topic 284 5.57 Topic 260 28.96 Topic 285 0.38 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 24.89 Topic 286 0.61 Topic Number Topic 262 2.73 Topic 287 20.12 Topic 263 0.89 Topic 288 1.20 CLEF 2005 AH−Bilingual−X2BG − Comparison to median by topic (topics 276 to 300) Topic 264 7.86 Topic 289 26.67 1 Topic 265 0.52 Topic 290 2.48 glaenbgtdnqe1 Difference (average precision) Topic 266 7.27 Topic 291 37.31 0.5 Topic 267 7.53 Topic 292 0.00 Topic 268 51.38 Topic 293 40.03 Topic 269 0.16 Topic 294 54.94 0 Topic 270 1.22 Topic 295 57.30 Topic 271 0.19 Topic 296 0.00 Topic 272 0.00 Topic 297 39.65 −0.5 Topic 273 22.81 Topic 298 0.11 Topic 274 6.94 Topic 299 18.76 −1 Topic 275 15.43 Topic 300 4.60 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.139 u.glasgow glaenbgtdnqe2 AH-Bilingual-X2BG Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual English to Bulgarian Retrieved 50,000 RunType= automatic Relevant 778 QueryType= TDN Relevant retrieved 588 Pooled= false CLEF 2005 AH−Bilingual−X2BG − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 37.67 glaenbgtdnqe2 90% 10 32.34 20 27.06 80% 30 23.32 70% 40 20.25 50 17.42 Average Precision 60% 60 13.07 50% 70 10.88 80 7.98 40% 90 4.60 30% 100 2.39 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 16.68 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2BG − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 23.20 glaenbgtdnqe2 90% 10 docs 21.20 15 docs 17.87 80% 20 docs 15.90 70% 30 docs 14.27 100 docs 7.22 60% R−Precision 200 docs 4.50 50% 500 docs 2.14 1000 docs 1.18 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 16.76 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2BG − Comparison to median by topic (topics 251 to 275) queries 1 glaenbgtdnqe2 Topic 251 4.25 Topic 276 1.61 Difference (average precision) Topic 252 17.68 Topic 277 44.00 0.5 Topic 253 24.64 Topic 278 1.00 Topic 254 27.70 Topic 279 41.92 Topic 255 1.62 Topic 280 3.91 0 Topic 256 2.45 Topic 281 30.87 Topic 257 22.66 Topic 282 3.04 −0.5 Topic 258 0.00 Topic 283 73.01 Topic 259 71.20 Topic 284 5.89 Topic 260 29.61 Topic 285 0.08 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 31.83 Topic 286 0.89 Topic Number Topic 262 3.86 Topic 287 18.75 Topic 263 1.07 Topic 288 1.46 CLEF 2005 AH−Bilingual−X2BG − Comparison to median by topic (topics 276 to 300) Topic 264 7.92 Topic 289 32.50 1 Topic 265 0.92 Topic 290 2.20 glaenbgtdnqe2 Difference (average precision) Topic 266 6.92 Topic 291 33.82 0.5 Topic 267 8.07 Topic 292 0.00 Topic 268 44.56 Topic 293 24.58 Topic 269 0.18 Topic 294 53.60 0 Topic 270 1.84 Topic 295 52.96 Topic 271 0.05 Topic 296 0.00 Topic 272 0.00 Topic 297 41.44 −0.5 Topic 273 15.83 Topic 298 0.11 Topic 274 6.22 Topic 299 18.89 −1 Topic 275 12.90 Topic 300 3.35 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.140 unine UniNEbibg1 AH-Bilingual-X2BG Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual English to Bulgarian Retrieved 50,000 RunType= automatic Relevant 778 QueryType= TD Relevant retrieved 536 Pooled= true CLEF 2005 AH−Bilingual−X2BG − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 29.36 UniNEbibg1 90% 10 24.46 20 16.87 80% 30 14.98 70% 40 13.64 50 12.22 Average Precision 60% 60 7.52 50% 70 5.77 80 3.74 40% 90 1.99 30% 100 0.84 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 10.62 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2BG − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 16.40 UniNEbibg1 90% 10 docs 14.20 15 docs 12.53 80% 20 docs 11.50 70% 30 docs 10.47 100 docs 6.06 60% R−Precision 200 docs 3.68 50% 500 docs 1.88 1000 docs 1.07 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 9.95 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2BG − Comparison to median by topic (topics 251 to 275) queries 1 UniNEbibg1 Topic 251 19.04 Topic 276 3.63 Difference (average precision) Topic 252 16.95 Topic 277 0.22 0.5 Topic 253 19.03 Topic 278 0.03 Topic 254 44.95 Topic 279 9.49 Topic 255 0.29 Topic 280 0.14 0 Topic 256 17.30 Topic 281 22.50 Topic 257 0.38 Topic 282 18.09 −0.5 Topic 258 0.00 Topic 283 0.53 Topic 259 69.19 Topic 284 10.06 Topic 260 3.37 Topic 285 0.00 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 13.20 Topic 286 0.81 Topic Number Topic 262 12.19 Topic 287 26.77 Topic 263 29.43 Topic 288 3.04 CLEF 2005 AH−Bilingual−X2BG − Comparison to median by topic (topics 276 to 300) Topic 264 14.72 Topic 289 11.36 1 Topic 265 0.08 Topic 290 26.18 UniNEbibg1 Difference (average precision) Topic 266 0.15 Topic 291 28.77 0.5 Topic 267 0.19 Topic 292 0.00 Topic 268 0.34 Topic 293 2.36 Topic 269 1.93 Topic 294 49.74 0 Topic 270 10.81 Topic 295 0.97 Topic 271 0.15 Topic 296 0.35 Topic 272 2.17 Topic 297 3.75 −0.5 Topic 273 13.70 Topic 298 0.12 Topic 274 2.16 Topic 299 0.00 −1 Topic 275 9.06 Topic 300 11.15 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.141 unine UniNEbibg2 AH-Bilingual-X2BG Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual English to Bulgarian Retrieved 50,000 RunType= automatic Relevant 778 QueryType= TD Relevant retrieved 549 Pooled= true CLEF 2005 AH−Bilingual−X2BG − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 26.66 UniNEbibg2 90% 10 22.44 20 18.58 80% 30 16.34 70% 40 14.78 50 13.56 Average Precision 60% 60 9.39 50% 70 7.88 80 5.23 40% 90 3.04 30% 100 2.14 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 12.00 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2BG − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 16.80 UniNEbibg2 90% 10 docs 12.80 15 docs 10.93 80% 20 docs 10.40 70% 30 docs 9.60 100 docs 5.74 60% R−Precision 200 docs 3.79 50% 500 docs 1.95 1000 docs 1.10 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 11.97 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2BG − Comparison to median by topic (topics 251 to 275) queries 1 UniNEbibg2 Topic 251 2.09 Topic 276 1.45 Difference (average precision) Topic 252 5.22 Topic 277 0.02 0.5 Topic 253 31.45 Topic 278 0.02 Topic 254 41.97 Topic 279 8.94 Topic 255 4.84 Topic 280 0.16 0 Topic 256 10.40 Topic 281 40.41 Topic 257 0.47 Topic 282 17.96 −0.5 Topic 258 0.00 Topic 283 0.32 Topic 259 80.75 Topic 284 20.48 Topic 260 5.77 Topic 285 0.00 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 16.86 Topic 286 0.59 Topic Number Topic 262 0.31 Topic 287 21.56 Topic 263 32.34 Topic 288 1.37 CLEF 2005 AH−Bilingual−X2BG − Comparison to median by topic (topics 276 to 300) Topic 264 15.64 Topic 289 2.66 1 Topic 265 1.83 Topic 290 2.55 UniNEbibg2 Difference (average precision) Topic 266 1.30 Topic 291 38.25 0.5 Topic 267 0.05 Topic 292 0.00 Topic 268 1.33 Topic 293 1.99 Topic 269 0.56 Topic 294 63.97 0 Topic 270 20.69 Topic 295 1.39 Topic 271 0.25 Topic 296 1.61 Topic 272 2.44 Topic 297 6.58 −0.5 Topic 273 20.74 Topic 298 0.06 Topic 274 3.35 Topic 299 0.00 −1 Topic 275 14.27 Topic 300 52.98 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.142 unine UniNEbibg3 AH-Bilingual-X2BG Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual English to Bulgarian Retrieved 50,000 RunType= automatic Relevant 778 QueryType= TD Relevant retrieved 574 Pooled= false CLEF 2005 AH−Bilingual−X2BG − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 30.44 UniNEbibg3 90% 10 26.17 20 21.62 80% 30 18.57 70% 40 16.91 50 14.56 Average Precision 60% 60 12.46 50% 70 10.17 80 7.90 40% 90 4.51 30% 100 2.72 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 13.99 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2BG − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 20.00 UniNEbibg3 90% 10 docs 17.00 15 docs 14.53 80% 20 docs 13.30 70% 30 docs 11.60 100 docs 6.52 60% R−Precision 200 docs 4.30 50% 500 docs 2.08 1000 docs 1.15 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 14.30 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2BG − Comparison to median by topic (topics 251 to 275) queries 1 UniNEbibg3 Topic 251 20.53 Topic 276 0.70 Difference (average precision) Topic 252 4.35 Topic 277 0.01 0.5 Topic 253 31.12 Topic 278 0.00 Topic 254 32.90 Topic 279 2.05 Topic 255 4.29 Topic 280 0.22 0 Topic 256 1.81 Topic 281 34.06 Topic 257 1.30 Topic 282 3.19 −0.5 Topic 258 0.00 Topic 283 0.55 Topic 259 73.59 Topic 284 19.79 Topic 260 24.87 Topic 285 0.00 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 18.18 Topic 286 0.98 Topic Number Topic 262 0.09 Topic 287 19.18 Topic 263 40.93 Topic 288 1.86 CLEF 2005 AH−Bilingual−X2BG − Comparison to median by topic (topics 276 to 300) Topic 264 21.09 Topic 289 0.00 1 Topic 265 6.64 Topic 290 77.11 UniNEbibg3 Difference (average precision) Topic 266 3.23 Topic 291 43.03 0.5 Topic 267 0.00 Topic 292 0.00 Topic 268 0.59 Topic 293 2.04 Topic 269 0.35 Topic 294 60.28 0 Topic 270 27.43 Topic 295 3.37 Topic 271 6.97 Topic 296 0.30 Topic 272 1.20 Topic 297 5.91 −0.5 Topic 273 19.56 Topic 298 0.05 Topic 274 5.03 Topic 299 0.00 −1 Topic 275 29.38 Topic 300 49.63 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.143 depok UI-DESC10 AH-Bilingual-X2EN Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual Indonesian to English Retrieved 50,000 RunType= automatic Relevant 2,063 QueryType= D Relevant retrieved 1,030 Pooled= true CLEF 2005 AH−Bilingual−X2EN − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 34.50 UI−DESC10 90% 10 18.41 20 14.91 80% 30 11.56 70% 40 9.85 50 8.56 Average Precision 60% 60 6.63 50% 70 4.95 80 3.42 40% 90 2.58 30% 100 0.76 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 9.36 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2EN − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 19.60 UI−DESC10 90% 10 docs 17.40 15 docs 15.87 80% 20 docs 14.40 70% 30 docs 12.47 100 docs 7.64 60% R−Precision 200 docs 5.45 50% 500 docs 3.20 1000 docs 2.06 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 10.94 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2EN − Comparison to median by topic (topics 251 to 275) queries 1 UI−DESC10 Topic 251 21.70 Topic 276 4.95 Difference (average precision) Topic 252 0.37 Topic 277 0.18 0.5 Topic 253 8.20 Topic 278 0.05 Topic 254 13.34 Topic 279 0.34 Topic 255 17.61 Topic 280 0.02 0 Topic 256 85.93 Topic 281 10.70 Topic 257 3.24 Topic 282 1.30 −0.5 Topic 258 0.00 Topic 283 15.49 Topic 259 0.14 Topic 284 0.04 Topic 260 2.41 Topic 285 36.56 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.01 Topic 286 0.33 Topic Number Topic 262 5.81 Topic 287 0.50 Topic 263 0.49 Topic 288 11.27 CLEF 2005 AH−Bilingual−X2EN − Comparison to median by topic (topics 276 to 300) Topic 264 1.38 Topic 289 1.09 1 Topic 265 1.73 Topic 290 7.17 UI−DESC10 Difference (average precision) Topic 266 0.00 Topic 291 2.08 0.5 Topic 267 24.83 Topic 292 3.15 Topic 268 27.49 Topic 293 27.79 Topic 269 0.02 Topic 294 0.38 0 Topic 270 48.45 Topic 295 0.13 Topic 271 8.43 Topic 296 10.98 Topic 272 34.35 Topic 297 0.51 −0.5 Topic 273 16.13 Topic 298 1.98 Topic 274 0.31 Topic 299 0.24 −1 Topic 275 8.32 Topic 300 0.00 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.144 depok UI-DESC20 AH-Bilingual-X2EN Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual Indonesian to English Retrieved 50,000 RunType= automatic Relevant 2,063 QueryType= D Relevant retrieved 1,036 Pooled= false CLEF 2005 AH−Bilingual−X2EN − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 34.30 UI−DESC20 90% 10 19.31 20 15.10 80% 30 11.71 70% 40 9.68 50 7.89 Average Precision 60% 60 6.05 50% 70 4.33 80 3.42 40% 90 1.69 30% 100 0.47 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 9.07 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2EN − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 18.80 UI−DESC20 90% 10 docs 16.60 15 docs 15.33 80% 20 docs 14.10 70% 30 docs 12.60 100 docs 7.90 60% R−Precision 200 docs 5.65 50% 500 docs 3.38 1000 docs 2.07 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 11.38 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2EN − Comparison to median by topic (topics 251 to 275) queries 1 UI−DESC20 Topic 251 20.82 Topic 276 10.95 Difference (average precision) Topic 252 0.85 Topic 277 0.03 0.5 Topic 253 3.70 Topic 278 0.04 Topic 254 8.72 Topic 279 0.64 Topic 255 13.21 Topic 280 0.05 0 Topic 256 80.34 Topic 281 9.15 Topic 257 3.13 Topic 282 0.63 −0.5 Topic 258 0.00 Topic 283 10.61 Topic 259 0.05 Topic 284 0.03 Topic 260 1.26 Topic 285 38.92 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.00 Topic 286 0.21 Topic Number Topic 262 5.31 Topic 287 0.37 Topic 263 0.09 Topic 288 14.63 CLEF 2005 AH−Bilingual−X2EN − Comparison to median by topic (topics 276 to 300) Topic 264 1.16 Topic 289 0.69 1 Topic 265 0.44 Topic 290 10.90 UI−DESC20 Difference (average precision) Topic 266 0.00 Topic 291 1.58 0.5 Topic 267 21.42 Topic 292 2.50 Topic 268 25.08 Topic 293 20.38 Topic 269 0.07 Topic 294 0.97 0 Topic 270 39.94 Topic 295 0.08 Topic 271 7.97 Topic 296 5.01 Topic 272 18.83 Topic 297 0.46 −0.5 Topic 273 17.51 Topic 298 1.64 Topic 274 0.01 Topic 299 22.67 −1 Topic 275 30.34 Topic 300 0.00 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.145 depok UI-TD10 AH-Bilingual-X2EN Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual Indonesian to English Retrieved 50,000 RunType= automatic Relevant 2,063 QueryType= TD Relevant retrieved 1,254 Pooled= true CLEF 2005 AH−Bilingual−X2EN − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 39.89 UI−TD10 90% 10 24.19 20 21.62 80% 30 17.77 70% 40 14.08 50 12.48 Average Precision 60% 60 10.34 50% 70 7.49 80 5.70 40% 90 3.68 30% 100 1.02 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 12.85 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2EN − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 22.40 UI−TD10 90% 10 docs 20.60 15 docs 18.67 80% 20 docs 17.70 70% 30 docs 15.80 100 docs 9.64 60% R−Precision 200 docs 6.75 50% 500 docs 3.96 1000 docs 2.51 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 14.43 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2EN − Comparison to median by topic (topics 251 to 275) queries 1 UI−TD10 Topic 251 21.93 Topic 276 3.34 Difference (average precision) Topic 252 2.82 Topic 277 21.62 0.5 Topic 253 5.33 Topic 278 2.30 Topic 254 18.76 Topic 279 5.26 Topic 255 8.64 Topic 280 0.00 0 Topic 256 86.12 Topic 281 13.66 Topic 257 1.18 Topic 282 1.92 −0.5 Topic 258 0.09 Topic 283 27.21 Topic 259 1.94 Topic 284 0.41 Topic 260 0.54 Topic 285 32.96 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.00 Topic 286 0.12 Topic Number Topic 262 6.26 Topic 287 1.69 Topic 263 0.46 Topic 288 28.97 CLEF 2005 AH−Bilingual−X2EN − Comparison to median by topic (topics 276 to 300) Topic 264 12.19 Topic 289 39.80 1 Topic 265 3.32 Topic 290 9.34 UI−TD10 Difference (average precision) Topic 266 0.00 Topic 291 0.73 0.5 Topic 267 23.76 Topic 292 2.16 Topic 268 54.55 Topic 293 26.30 Topic 269 0.04 Topic 294 12.06 0 Topic 270 48.45 Topic 295 0.08 Topic 271 25.81 Topic 296 23.28 Topic 272 18.42 Topic 297 3.72 −0.5 Topic 273 8.50 Topic 298 2.10 Topic 274 0.44 Topic 299 12.46 −1 Topic 275 21.29 Topic 300 0.00 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.146 depok UI-TD20 AH-Bilingual-X2EN Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual Indonesian to English Retrieved 50,000 RunType= automatic Relevant 2,063 QueryType= TD Relevant retrieved 1,180 Pooled= false CLEF 2005 AH−Bilingual−X2EN − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 34.50 UI−TD20 90% 10 23.06 20 20.12 80% 30 16.19 70% 40 13.16 50 11.07 Average Precision 60% 60 9.19 50% 70 6.79 80 5.07 40% 90 3.07 30% 100 0.75 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 11.90 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2EN − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 22.80 UI−TD20 90% 10 docs 18.00 15 docs 18.00 80% 20 docs 16.90 70% 30 docs 14.40 100 docs 9.02 60% R−Precision 200 docs 6.24 50% 500 docs 3.71 1000 docs 2.36 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 13.10 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2EN − Comparison to median by topic (topics 251 to 275) queries 1 UI−TD20 Topic 251 24.19 Topic 276 6.47 Difference (average precision) Topic 252 4.08 Topic 277 19.16 0.5 Topic 253 2.76 Topic 278 2.04 Topic 254 19.66 Topic 279 5.04 Topic 255 4.29 Topic 280 0.01 0 Topic 256 83.51 Topic 281 11.85 Topic 257 0.37 Topic 282 1.43 −0.5 Topic 258 0.00 Topic 283 16.95 Topic 259 0.74 Topic 284 0.00 Topic 260 0.15 Topic 285 41.44 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.00 Topic 286 0.15 Topic Number Topic 262 2.60 Topic 287 0.99 Topic 263 0.27 Topic 288 32.49 CLEF 2005 AH−Bilingual−X2EN − Comparison to median by topic (topics 276 to 300) Topic 264 10.66 Topic 289 49.94 1 Topic 265 0.95 Topic 290 5.99 UI−TD20 Difference (average precision) Topic 266 0.00 Topic 291 0.98 0.5 Topic 267 24.73 Topic 292 1.13 Topic 268 56.67 Topic 293 21.34 Topic 269 0.01 Topic 294 3.45 0 Topic 270 39.94 Topic 295 0.08 Topic 271 28.56 Topic 296 14.94 Topic 272 11.26 Topic 297 1.71 −0.5 Topic 273 7.10 Topic 298 2.14 Topic 274 0.21 Topic 299 13.79 −1 Topic 275 18.90 Topic 300 0.00 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.147 depok UI-TITLE10 AH-Bilingual-X2EN Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual Indonesian to English Retrieved 50,000 RunType= automatic Relevant 2,063 QueryType= T Relevant retrieved 972 Pooled= false CLEF 2005 AH−Bilingual−X2EN − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 33.78 UI−TITLE10 90% 10 22.88 20 18.10 80% 30 15.32 70% 40 12.92 50 10.20 Average Precision 60% 60 8.75 50% 70 5.27 80 3.78 40% 90 2.54 30% 100 0.44 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 11.35 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2EN − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 23.60 UI−TITLE10 90% 10 docs 18.00 15 docs 17.33 80% 20 docs 15.70 70% 30 docs 13.87 100 docs 7.52 60% R−Precision 200 docs 5.12 50% 500 docs 3.01 1000 docs 1.94 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 13.58 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2EN − Comparison to median by topic (topics 251 to 275) queries 1 UI−TITLE10 Topic 251 0.61 Topic 276 4.85 Difference (average precision) Topic 252 1.94 Topic 277 19.95 0.5 Topic 253 8.25 Topic 278 21.06 Topic 254 8.72 Topic 279 3.00 Topic 255 1.08 Topic 280 0.02 0 Topic 256 87.94 Topic 281 15.73 Topic 257 11.12 Topic 282 0.03 −0.5 Topic 258 0.00 Topic 283 9.17 Topic 259 0.00 Topic 284 0.03 Topic 260 26.35 Topic 285 31.79 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.01 Topic 286 0.00 Topic Number Topic 262 0.13 Topic 287 0.99 Topic 263 0.00 Topic 288 20.14 CLEF 2005 AH−Bilingual−X2EN − Comparison to median by topic (topics 276 to 300) Topic 264 35.14 Topic 289 33.25 1 Topic 265 23.82 Topic 290 3.18 UI−TITLE10 Difference (average precision) Topic 266 0.00 Topic 291 0.70 0.5 Topic 267 15.27 Topic 292 0.00 Topic 268 71.93 Topic 293 0.00 Topic 269 0.00 Topic 294 32.12 0 Topic 270 26.98 Topic 295 0.00 Topic 271 22.14 Topic 296 10.37 Topic 272 2.95 Topic 297 0.97 −0.5 Topic 273 0.69 Topic 298 0.33 Topic 274 0.09 Topic 299 5.83 −1 Topic 275 8.73 Topic 300 0.00 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.148 depok UI-TITLE20 AH-Bilingual-X2EN Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual Indonesian to English Retrieved 50,000 RunType= automatic Relevant 2,063 QueryType= T Relevant retrieved 1,002 Pooled= true CLEF 2005 AH−Bilingual−X2EN − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 38.83 UI−TITLE20 90% 10 26.16 20 20.65 80% 30 17.35 70% 40 14.58 50 11.61 Average Precision 60% 60 9.08 50% 70 5.30 80 3.99 40% 90 2.04 30% 100 0.27 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 12.48 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2EN − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 23.20 UI−TITLE20 90% 10 docs 19.60 15 docs 19.47 80% 20 docs 18.50 70% 30 docs 15.53 100 docs 8.42 60% R−Precision 200 docs 5.49 50% 500 docs 3.10 1000 docs 2.00 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 15.47 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2EN − Comparison to median by topic (topics 251 to 275) queries 1 UI−TITLE20 Topic 251 0.43 Topic 276 1.21 Difference (average precision) Topic 252 3.54 Topic 277 7.65 0.5 Topic 253 6.48 Topic 278 24.26 Topic 254 18.97 Topic 279 1.20 Topic 255 1.07 Topic 280 0.09 0 Topic 256 84.22 Topic 281 15.59 Topic 257 11.69 Topic 282 0.12 −0.5 Topic 258 0.00 Topic 283 9.40 Topic 259 0.00 Topic 284 0.01 Topic 260 5.65 Topic 285 48.58 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.02 Topic 286 0.00 Topic Number Topic 262 0.12 Topic 287 10.04 Topic 263 0.00 Topic 288 35.97 CLEF 2005 AH−Bilingual−X2EN − Comparison to median by topic (topics 276 to 300) Topic 264 37.29 Topic 289 45.57 1 Topic 265 14.60 Topic 290 7.56 UI−TITLE20 Difference (average precision) Topic 266 0.00 Topic 291 0.27 0.5 Topic 267 21.20 Topic 292 0.04 Topic 268 71.01 Topic 293 0.05 Topic 269 0.02 Topic 294 26.28 0 Topic 270 39.17 Topic 295 0.00 Topic 271 35.17 Topic 296 13.71 Topic 272 0.66 Topic 297 1.90 −0.5 Topic 273 3.16 Topic 298 0.44 Topic 274 0.05 Topic 299 9.71 −1 Topic 275 9.65 Topic 300 0.00 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.149 jhu-apl aplbigrena AH-Bilingual-X2EN Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual Greek to English Retrieved 50,000 RunType= automatic Relevant 2,063 QueryType= TD Relevant retrieved 1,388 Pooled= true CLEF 2005 AH−Bilingual−X2EN − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 54.83 aplbigrena 90% 10 46.13 20 38.88 80% 30 33.76 70% 40 26.92 50 24.20 Average Precision 60% 60 19.56 50% 70 14.61 80 11.13 40% 90 7.87 30% 100 4.51 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 24.18 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2EN − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 34.80 aplbigrena 90% 10 docs 32.40 15 docs 29.87 80% 20 docs 28.10 70% 30 docs 24.67 100 docs 14.88 60% R−Precision 200 docs 9.55 50% 500 docs 4.80 1000 docs 2.78 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 25.78 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2EN − Comparison to median by topic (topics 251 to 275) queries 1 aplbigrena Topic 251 56.83 Topic 276 40.15 Difference (average precision) Topic 252 6.75 Topic 277 12.06 0.5 Topic 253 8.47 Topic 278 2.46 Topic 254 34.74 Topic 279 4.14 Topic 255 42.20 Topic 280 3.75 0 Topic 256 47.07 Topic 281 24.01 Topic 257 12.34 Topic 282 33.47 −0.5 Topic 258 5.88 Topic 283 0.45 Topic 259 34.29 Topic 284 25.89 Topic 260 60.16 Topic 285 0.42 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 9.37 Topic 286 0.83 Topic Number Topic 262 0.31 Topic 287 46.41 Topic 263 0.05 Topic 288 24.72 CLEF 2005 AH−Bilingual−X2EN − Comparison to median by topic (topics 276 to 300) Topic 264 12.72 Topic 289 1.52 1 Topic 265 38.99 Topic 290 3.31 aplbigrena Difference (average precision) Topic 266 0.00 Topic 291 6.25 0.5 Topic 267 12.46 Topic 292 88.75 Topic 268 67.10 Topic 293 66.72 Topic 269 10.58 Topic 294 53.70 0 Topic 270 70.00 Topic 295 0.00 Topic 271 27.56 Topic 296 0.00 Topic 272 1.51 Topic 297 27.81 −0.5 Topic 273 70.84 Topic 298 25.27 Topic 274 25.02 Topic 299 28.33 −1 Topic 275 33.32 Topic 300 0.03 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.150 jhu-apl aplbihuena AH-Bilingual-X2EN Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual Hungarian to English Retrieved 50,000 RunType= automatic Relevant 2,063 QueryType= TD Relevant retrieved 1,363 Pooled= true CLEF 2005 AH−Bilingual−X2EN − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 43.53 aplbihuena 90% 10 30.46 20 28.51 80% 30 25.94 70% 40 23.58 50 21.59 Average Precision 60% 60 17.86 50% 70 14.63 80 12.13 40% 90 9.29 30% 100 6.52 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 19.44 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2EN − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 24.00 aplbihuena 90% 10 docs 21.80 15 docs 21.47 80% 20 docs 21.20 70% 30 docs 19.73 100 docs 11.56 60% R−Precision 200 docs 7.73 50% 500 docs 4.33 1000 docs 2.73 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 19.86 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2EN − Comparison to median by topic (topics 251 to 275) queries 1 aplbihuena Topic 251 6.56 Topic 276 0.02 Difference (average precision) Topic 252 0.01 Topic 277 7.34 0.5 Topic 253 30.33 Topic 278 0.01 Topic 254 8.66 Topic 279 0.15 Topic 255 18.98 Topic 280 6.59 0 Topic 256 93.62 Topic 281 17.77 Topic 257 14.89 Topic 282 2.03 −0.5 Topic 258 9.76 Topic 283 1.71 Topic 259 0.00 Topic 284 23.84 Topic 260 0.05 Topic 285 4.98 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 27.92 Topic 286 0.00 Topic Number Topic 262 1.83 Topic 287 0.74 Topic 263 15.84 Topic 288 23.09 CLEF 2005 AH−Bilingual−X2EN − Comparison to median by topic (topics 276 to 300) Topic 264 10.31 Topic 289 53.05 1 Topic 265 48.88 Topic 290 1.65 aplbihuena Difference (average precision) Topic 266 2.64 Topic 291 1.84 0.5 Topic 267 5.33 Topic 292 64.88 Topic 268 57.09 Topic 293 1.82 Topic 269 14.35 Topic 294 66.90 0 Topic 270 62.40 Topic 295 26.50 Topic 271 0.01 Topic 296 2.51 Topic 272 29.07 Topic 297 57.94 −0.5 Topic 273 72.00 Topic 298 24.46 Topic 274 0.00 Topic 299 6.19 −1 Topic 275 44.88 Topic 300 0.60 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.151 jhu-apl aplbiidena AH-Bilingual-X2EN Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual Indonesian to English Retrieved 50,000 RunType= automatic Relevant 2,063 QueryType= TD Relevant retrieved 1,698 Pooled= true CLEF 2005 AH−Bilingual−X2EN − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 68.33 aplbiidena 90% 10 58.55 20 51.53 80% 30 46.42 70% 40 37.90 50 32.62 Average Precision 60% 60 27.52 50% 70 22.42 80 18.58 40% 90 13.56 30% 100 7.03 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 33.13 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2EN − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 43.20 aplbiidena 90% 10 docs 41.80 15 docs 39.47 80% 20 docs 36.70 70% 30 docs 32.53 100 docs 19.50 60% R−Precision 200 docs 12.25 50% 500 docs 6.12 1000 docs 3.40 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 34.15 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2EN − Comparison to median by topic (topics 251 to 275) queries 1 aplbiidena Topic 251 54.68 Topic 276 47.11 Difference (average precision) Topic 252 15.74 Topic 277 23.86 0.5 Topic 253 32.47 Topic 278 2.08 Topic 254 29.38 Topic 279 10.88 Topic 255 60.71 Topic 280 10.88 0 Topic 256 78.26 Topic 281 27.09 Topic 257 14.13 Topic 282 38.99 −0.5 Topic 258 0.23 Topic 283 63.65 Topic 259 36.36 Topic 284 51.09 Topic 260 12.06 Topic 285 65.35 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.82 Topic 286 0.91 Topic Number Topic 262 0.15 Topic 287 45.61 Topic 263 19.99 Topic 288 26.83 CLEF 2005 AH−Bilingual−X2EN − Comparison to median by topic (topics 276 to 300) Topic 264 29.07 Topic 289 72.52 1 Topic 265 43.84 Topic 290 4.22 aplbiidena Difference (average precision) Topic 266 0.00 Topic 291 45.92 0.5 Topic 267 33.20 Topic 292 51.63 Topic 268 68.28 Topic 293 67.99 Topic 269 5.37 Topic 294 44.05 0 Topic 270 65.27 Topic 295 0.11 Topic 271 35.03 Topic 296 43.40 Topic 272 28.81 Topic 297 38.60 −0.5 Topic 273 79.66 Topic 298 18.50 Topic 274 24.74 Topic 299 36.30 −1 Topic 275 33.74 Topic 300 16.99 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.152 jhu-apl aplbiidend AH-Bilingual-X2EN Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual Indonesian to English Retrieved 50,000 RunType= automatic Relevant 2,063 QueryType= TDN Relevant retrieved 1,796 Pooled= false CLEF 2005 AH−Bilingual−X2EN − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 75.49 aplbiidend 90% 10 63.36 20 56.45 80% 30 49.84 70% 40 42.66 50 38.29 Average Precision 60% 60 32.27 50% 70 24.87 80 20.94 40% 90 15.61 30% 100 9.37 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 37.28 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2EN − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 50.40 aplbiidend 90% 10 docs 46.00 15 docs 43.33 80% 20 docs 41.70 70% 30 docs 36.60 100 docs 21.50 60% R−Precision 200 docs 13.74 50% 500 docs 6.61 1000 docs 3.59 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 35.47 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2EN − Comparison to median by topic (topics 251 to 275) queries 1 aplbiidend Topic 251 54.36 Topic 276 59.67 Difference (average precision) Topic 252 21.57 Topic 277 27.29 0.5 Topic 253 38.12 Topic 278 2.20 Topic 254 36.13 Topic 279 35.59 Topic 255 40.10 Topic 280 1.77 0 Topic 256 90.82 Topic 281 40.01 Topic 257 15.69 Topic 282 23.69 −0.5 Topic 258 3.12 Topic 283 55.93 Topic 259 41.93 Topic 284 51.52 Topic 260 17.78 Topic 285 77.70 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 21.49 Topic 286 0.42 Topic Number Topic 262 4.07 Topic 287 47.31 Topic 263 20.62 Topic 288 51.24 CLEF 2005 AH−Bilingual−X2EN − Comparison to median by topic (topics 276 to 300) Topic 264 42.06 Topic 289 74.82 1 Topic 265 50.31 Topic 290 25.71 aplbiidend Difference (average precision) Topic 266 5.69 Topic 291 55.89 0.5 Topic 267 27.63 Topic 292 27.25 Topic 268 68.84 Topic 293 69.85 Topic 269 9.60 Topic 294 47.14 0 Topic 270 69.66 Topic 295 0.68 Topic 271 42.44 Topic 296 62.00 Topic 272 26.11 Topic 297 65.02 −0.5 Topic 273 87.75 Topic 298 26.16 Topic 274 5.08 Topic 299 38.58 −1 Topic 275 38.20 Topic 300 17.45 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.153 msu-nivc cirGHLAru2en AH-Bilingual-X2EN Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual Russian to English Retrieved 49,370 RunType= automatic Relevant 2,063 QueryType= TDN Relevant retrieved 1,441 Pooled= true CLEF 2005 AH−Bilingual−X2EN − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 59.86 cirGHLAru2en 90% 10 46.02 20 39.95 80% 30 31.24 70% 40 27.43 50 24.64 Average Precision 60% 60 19.34 50% 70 12.94 80 8.05 40% 90 5.11 30% 100 2.48 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 22.82 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2EN − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 34.00 cirGHLAru2en 90% 10 docs 32.80 15 docs 29.60 80% 20 docs 28.40 70% 30 docs 25.20 100 docs 15.60 60% R−Precision 200 docs 10.22 50% 500 docs 5.13 1000 docs 2.88 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 26.05 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2EN − Comparison to median by topic (topics 251 to 275) queries 1 cirGHLAru2en Topic 251 37.36 Topic 276 29.71 Difference (average precision) Topic 252 15.53 Topic 277 36.78 0.5 Topic 253 33.98 Topic 278 15.44 Topic 254 7.25 Topic 279 43.41 Topic 255 9.00 Topic 280 8.05 0 Topic 256 53.21 Topic 281 16.07 Topic 257 37.57 Topic 282 0.34 −0.5 Topic 258 14.37 Topic 283 23.62 Topic 259 0.00 Topic 284 12.99 Topic 260 28.13 Topic 285 41.50 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.98 Topic 286 1.03 Topic Number Topic 262 14.08 Topic 287 12.56 Topic 263 5.21 Topic 288 13.41 CLEF 2005 AH−Bilingual−X2EN − Comparison to median by topic (topics 276 to 300) Topic 264 70.55 Topic 289 41.29 1 Topic 265 51.16 Topic 290 29.68 cirGHLAru2en Difference (average precision) Topic 266 0.00 Topic 291 48.53 0.5 Topic 267 17.87 Topic 292 36.91 Topic 268 66.67 Topic 293 49.88 Topic 269 4.73 Topic 294 25.77 0 Topic 270 19.62 Topic 295 10.34 Topic 271 36.78 Topic 296 0.29 Topic 272 0.06 Topic 297 0.62 −0.5 Topic 273 19.92 Topic 298 26.31 Topic 274 4.77 Topic 299 21.09 −1 Topic 275 33.39 Topic 300 13.35 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.154 u.glasgow glagrentdn AH-Bilingual-X2EN Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual Greek to English Retrieved 50,000 RunType= automatic Relevant 2,063 QueryType= TDN Relevant retrieved 1,409 Pooled= true CLEF 2005 AH−Bilingual−X2EN − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 62.32 glagrentdn 90% 10 48.73 20 39.57 80% 30 31.54 70% 40 23.58 50 19.18 Average Precision 60% 60 16.38 50% 70 12.28 80 9.24 40% 90 5.65 30% 100 2.30 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 22.95 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2EN − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 40.00 glagrentdn 90% 10 docs 35.00 15 docs 31.07 80% 20 docs 29.10 70% 30 docs 25.20 100 docs 15.38 60% R−Precision 200 docs 9.67 50% 500 docs 4.91 1000 docs 2.82 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 25.98 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2EN − Comparison to median by topic (topics 251 to 275) queries 1 glagrentdn Topic 251 40.44 Topic 276 30.11 Difference (average precision) Topic 252 46.63 Topic 277 12.28 0.5 Topic 253 7.27 Topic 278 0.51 Topic 254 28.50 Topic 279 19.83 Topic 255 34.39 Topic 280 5.27 0 Topic 256 87.81 Topic 281 12.31 Topic 257 11.16 Topic 282 16.29 −0.5 Topic 258 0.77 Topic 283 0.48 Topic 259 34.37 Topic 284 12.51 Topic 260 63.32 Topic 285 22.33 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 9.50 Topic 286 0.03 Topic Number Topic 262 4.60 Topic 287 25.93 Topic 263 0.09 Topic 288 15.21 CLEF 2005 AH−Bilingual−X2EN − Comparison to median by topic (topics 276 to 300) Topic 264 10.16 Topic 289 7.07 1 Topic 265 22.58 Topic 290 33.14 glagrentdn Difference (average precision) Topic 266 0.00 Topic 291 35.10 0.5 Topic 267 9.97 Topic 292 16.89 Topic 268 55.68 Topic 293 63.06 Topic 269 22.14 Topic 294 30.72 0 Topic 270 65.73 Topic 295 0.51 Topic 271 12.05 Topic 296 0.00 Topic 272 0.74 Topic 297 32.64 −0.5 Topic 273 63.51 Topic 298 27.66 Topic 274 42.12 Topic 299 24.19 −1 Topic 275 29.95 Topic 300 0.05 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.155 u.glasgow glagrentdqe AH-Bilingual-X2EN Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual Greek to English Retrieved 50,000 RunType= automatic Relevant 2,063 QueryType= TD Relevant retrieved 1,543 Pooled= true CLEF 2005 AH−Bilingual−X2EN − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 56.19 glagrentdqe 90% 10 49.74 20 45.44 80% 30 41.15 70% 40 34.27 50 29.34 Average Precision 60% 60 25.71 50% 70 21.21 80 16.13 40% 90 10.36 30% 100 3.39 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 29.35 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2EN − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 40.40 glagrentdqe 90% 10 docs 40.40 15 docs 37.33 80% 20 docs 34.70 70% 30 docs 30.87 100 docs 18.10 60% R−Precision 200 docs 10.92 50% 500 docs 5.40 1000 docs 3.09 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 30.66 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2EN − Comparison to median by topic (topics 251 to 275) queries 1 glagrentdqe Topic 251 47.02 Topic 276 54.01 Difference (average precision) Topic 252 54.12 Topic 277 13.90 0.5 Topic 253 6.86 Topic 278 1.59 Topic 254 36.90 Topic 279 11.46 Topic 255 10.00 Topic 280 1.18 0 Topic 256 92.02 Topic 281 39.18 Topic 257 11.23 Topic 282 38.51 −0.5 Topic 258 0.52 Topic 283 0.31 Topic 259 17.62 Topic 284 8.02 Topic 260 68.59 Topic 285 85.64 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.43 Topic 286 0.00 Topic Number Topic 262 3.20 Topic 287 40.37 Topic 263 0.04 Topic 288 39.38 CLEF 2005 AH−Bilingual−X2EN − Comparison to median by topic (topics 276 to 300) Topic 264 7.30 Topic 289 78.82 1 Topic 265 17.42 Topic 290 35.51 glagrentdqe Difference (average precision) Topic 266 0.00 Topic 291 11.20 0.5 Topic 267 12.61 Topic 292 37.08 Topic 268 51.54 Topic 293 67.43 Topic 269 26.70 Topic 294 53.18 0 Topic 270 66.59 Topic 295 0.51 Topic 271 57.91 Topic 296 0.00 Topic 272 1.39 Topic 297 46.86 −0.5 Topic 273 77.57 Topic 298 24.30 Topic 274 46.56 Topic 299 31.86 −1 Topic 275 32.83 Topic 300 0.04 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.156 alicante IRn-enfr-fexp AH-Bilingual-X2FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual English to French Retrieved 50,000 RunType= automatic Relevant 2,537 QueryType= TD Relevant retrieved 2,071 Pooled= false CLEF 2005 AH−Bilingual−X2FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 65.13 IRn−enfr−fexp 90% 10 48.62 20 43.51 80% 30 39.01 70% 40 34.28 50 30.64 Average Precision 60% 60 25.09 50% 70 19.92 80 14.97 40% 90 9.72 30% 100 3.84 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 29.12 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 45.20 IRn−enfr−fexp 90% 10 docs 41.40 15 docs 39.47 80% 20 docs 37.80 70% 30 docs 34.80 100 docs 21.72 60% R−Precision 200 docs 14.52 50% 500 docs 7.44 1000 docs 4.14 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 31.12 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 251 to 275) queries 1 IRn−enfr−fexp Topic 251 20.74 Topic 276 24.42 Difference (average precision) Topic 252 14.94 Topic 277 41.74 0.5 Topic 253 42.65 Topic 278 14.09 Topic 254 52.82 Topic 279 5.36 Topic 255 1.56 Topic 280 9.71 0 Topic 256 75.95 Topic 281 45.63 Topic 257 8.49 Topic 282 3.42 −0.5 Topic 258 1.48 Topic 283 15.43 Topic 259 36.32 Topic 284 66.96 Topic 260 0.90 Topic 285 65.43 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.11 Topic 286 1.65 Topic Number Topic 262 0.75 Topic 287 36.55 Topic 263 27.48 Topic 288 6.71 CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 276 to 300) Topic 264 63.28 Topic 289 71.82 1 Topic 265 36.79 Topic 290 37.92 IRn−enfr−fexp Difference (average precision) Topic 266 1.19 Topic 291 3.30 0.5 Topic 267 29.72 Topic 292 2.82 Topic 268 53.90 Topic 293 78.54 Topic 269 21.61 Topic 294 60.62 0 Topic 270 47.26 Topic 295 26.35 Topic 271 73.88 Topic 296 23.78 Topic 272 16.70 Topic 297 44.18 −0.5 Topic 273 36.72 Topic 298 33.83 Topic 274 48.36 Topic 299 5.97 −1 Topic 275 4.34 Topic 300 11.86 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.157 alicante IRn-enfr-vexp AH-Bilingual-X2FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual English to French Retrieved 50,000 RunType= automatic Relevant 2,537 QueryType= TD Relevant retrieved 2,145 Pooled= false CLEF 2005 AH−Bilingual−X2FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 70.85 IRn−enfr−vexp 90% 10 56.44 20 49.43 80% 30 45.96 70% 40 41.29 50 38.74 Average Precision 60% 60 33.54 50% 70 27.75 80 22.10 40% 90 14.04 30% 100 3.29 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 35.90 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 53.20 IRn−enfr−vexp 90% 10 docs 45.80 15 docs 45.33 80% 20 docs 42.70 70% 30 docs 38.73 100 docs 25.26 60% R−Precision 200 docs 16.10 50% 500 docs 7.90 1000 docs 4.29 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 36.15 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 251 to 275) queries 1 IRn−enfr−vexp Topic 251 11.18 Topic 276 19.41 Difference (average precision) Topic 252 11.86 Topic 277 0.17 0.5 Topic 253 53.85 Topic 278 47.90 Topic 254 63.31 Topic 279 9.60 Topic 255 2.63 Topic 280 35.71 0 Topic 256 79.74 Topic 281 50.38 Topic 257 14.37 Topic 282 0.95 −0.5 Topic 258 12.14 Topic 283 77.11 Topic 259 1.91 Topic 284 70.49 Topic 260 58.46 Topic 285 58.09 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.00 Topic 286 28.10 Topic Number Topic 262 14.43 Topic 287 9.10 Topic 263 3.41 Topic 288 8.28 CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 276 to 300) Topic 264 80.28 Topic 289 75.87 1 Topic 265 42.40 Topic 290 53.72 IRn−enfr−vexp Difference (average precision) Topic 266 0.33 Topic 291 37.93 0.5 Topic 267 26.20 Topic 292 4.89 Topic 268 62.44 Topic 293 75.99 Topic 269 22.69 Topic 294 61.45 0 Topic 270 66.92 Topic 295 43.57 Topic 271 87.57 Topic 296 24.41 Topic 272 19.42 Topic 297 45.22 −0.5 Topic 273 14.32 Topic 298 50.53 Topic 274 80.96 Topic 299 0.21 −1 Topic 275 60.18 Topic 300 15.08 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.158 alicante IRn-enfr-vnexp AH-Bilingual-X2FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual English to French Retrieved 50,000 RunType= automatic Relevant 2,537 QueryType= TD Relevant retrieved 2,080 Pooled= false CLEF 2005 AH−Bilingual−X2FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 69.46 IRn−enfr−vnexp 90% 10 50.36 20 43.30 80% 30 38.24 70% 40 34.02 50 29.43 Average Precision 60% 60 24.81 50% 70 19.81 80 15.17 40% 90 9.65 30% 100 4.21 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 29.13 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 46.40 IRn−enfr−vnexp 90% 10 docs 43.00 15 docs 39.87 80% 20 docs 37.20 70% 30 docs 34.53 100 docs 21.68 60% R−Precision 200 docs 14.41 50% 500 docs 7.29 1000 docs 4.16 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 31.40 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 251 to 275) queries 1 IRn−enfr−vnexp Topic 251 24.39 Topic 276 23.99 Difference (average precision) Topic 252 7.40 Topic 277 49.97 0.5 Topic 253 35.09 Topic 278 14.13 Topic 254 49.81 Topic 279 7.09 Topic 255 1.39 Topic 280 11.77 0 Topic 256 79.73 Topic 281 40.60 Topic 257 8.35 Topic 282 4.19 −0.5 Topic 258 0.96 Topic 283 16.54 Topic 259 50.06 Topic 284 65.23 Topic 260 4.49 Topic 285 64.71 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.11 Topic 286 2.33 Topic Number Topic 262 7.02 Topic 287 38.71 Topic 263 31.48 Topic 288 7.05 CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 276 to 300) Topic 264 62.68 Topic 289 74.27 1 Topic 265 31.97 Topic 290 32.51 IRn−enfr−vnexp Difference (average precision) Topic 266 3.91 Topic 291 4.67 0.5 Topic 267 26.76 Topic 292 2.60 Topic 268 51.28 Topic 293 72.84 Topic 269 16.90 Topic 294 63.86 0 Topic 270 38.24 Topic 295 27.41 Topic 271 76.47 Topic 296 24.41 Topic 272 13.23 Topic 297 43.72 −0.5 Topic 273 33.06 Topic 298 29.36 Topic 274 46.39 Topic 299 7.77 −1 Topic 275 10.50 Topic 300 15.06 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.159 clips CLIPS05DEFR AH-Bilingual-X2FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual German to French Retrieved 50,000 RunType= automatic Relevant 2,537 QueryType= TDN Relevant retrieved 758 Pooled= true CLEF 2005 AH−Bilingual−X2FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 21.35 CLIPS05DEFR 90% 10 12.24 20 8.81 80% 30 6.81 70% 40 4.42 50 3.55 Average Precision 60% 60 2.50 50% 70 1.71 80 0.78 40% 90 0.14 30% 100 0.00 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 4.98 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 12.80 CLIPS05DEFR 90% 10 docs 13.60 15 docs 12.53 80% 20 docs 11.30 70% 30 docs 10.07 100 docs 6.14 60% R−Precision 200 docs 4.33 50% 500 docs 2.46 1000 docs 1.52 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 6.46 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 251 to 275) queries 1 CLIPS05DEFR Topic 251 2.26 Topic 276 0.00 Difference (average precision) Topic 252 0.00 Topic 277 4.07 0.5 Topic 253 0.02 Topic 278 0.70 Topic 254 49.55 Topic 279 0.14 Topic 255 0.00 Topic 280 0.01 0 Topic 256 0.11 Topic 281 21.33 Topic 257 1.89 Topic 282 0.00 −0.5 Topic 258 0.00 Topic 283 0.01 Topic 259 0.36 Topic 284 0.00 Topic 260 0.00 Topic 285 31.86 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.43 Topic 286 0.04 Topic Number Topic 262 0.00 Topic 287 6.86 Topic 263 0.02 Topic 288 0.05 CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 276 to 300) Topic 264 39.02 Topic 289 0.00 1 Topic 265 12.87 Topic 290 0.14 CLIPS05DEFR Difference (average precision) Topic 266 0.00 Topic 291 2.62 0.5 Topic 267 0.22 Topic 292 0.78 Topic 268 1.47 Topic 293 2.07 Topic 269 2.08 Topic 294 9.51 0 Topic 270 45.15 Topic 295 0.52 Topic 271 0.07 Topic 296 0.11 Topic 272 1.77 Topic 297 5.54 −0.5 Topic 273 4.09 Topic 298 0.03 Topic 274 1.10 Topic 299 0.00 −1 Topic 275 0.03 Topic 300 0.01 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.160 clips CLIPS05DEFR0 AH-Bilingual-X2FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual German to French Retrieved 50,000 RunType= automatic Relevant 2,537 QueryType= TD Relevant retrieved 846 Pooled= false CLEF 2005 AH−Bilingual−X2FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 29.22 CLIPS05DEFR0 90% 10 16.74 20 11.03 80% 30 9.03 70% 40 6.84 50 5.36 Average Precision 60% 60 3.96 50% 70 3.12 80 2.20 40% 90 1.18 30% 100 0.09 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 6.88 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 17.20 CLIPS05DEFR0 90% 10 docs 16.00 15 docs 14.67 80% 20 docs 13.40 70% 30 docs 11.67 100 docs 7.22 60% R−Precision 200 docs 4.98 50% 500 docs 2.80 1000 docs 1.69 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 8.67 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 251 to 275) queries 1 CLIPS05DEFR0 Topic 251 13.01 Topic 276 0.00 Difference (average precision) Topic 252 0.00 Topic 277 8.73 0.5 Topic 253 0.01 Topic 278 4.24 Topic 254 65.43 Topic 279 0.10 Topic 255 0.00 Topic 280 0.01 0 Topic 256 0.17 Topic 281 21.19 Topic 257 3.06 Topic 282 0.02 −0.5 Topic 258 0.00 Topic 283 0.01 Topic 259 0.06 Topic 284 0.26 Topic 260 0.00 Topic 285 17.88 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.00 Topic 286 0.02 Topic Number Topic 262 0.00 Topic 287 9.99 Topic 263 0.02 Topic 288 1.79 CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 276 to 300) Topic 264 46.98 Topic 289 0.00 1 Topic 265 14.98 Topic 290 11.25 CLIPS05DEFR0 Difference (average precision) Topic 266 0.14 Topic 291 2.99 0.5 Topic 267 0.25 Topic 292 0.64 Topic 268 2.70 Topic 293 1.80 Topic 269 1.95 Topic 294 38.06 0 Topic 270 52.23 Topic 295 0.09 Topic 271 1.55 Topic 296 0.27 Topic 272 9.67 Topic 297 10.21 −0.5 Topic 273 0.02 Topic 298 0.15 Topic 274 1.91 Topic 299 0.04 −1 Topic 275 0.32 Topic 300 0.02 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.161 clips CLIPS05EFR AH-Bilingual-X2FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual Spanish to French Retrieved 50,000 RunType= automatic Relevant 2,537 QueryType= TDN Relevant retrieved 627 Pooled= false CLEF 2005 AH−Bilingual−X2FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 23.26 CLIPS05EFR 90% 10 8.96 20 5.93 80% 30 4.35 70% 40 3.21 50 2.37 Average Precision 60% 60 1.73 50% 70 1.02 80 0.63 40% 90 0.20 30% 100 0.10 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 3.69 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 11.60 CLIPS05EFR 90% 10 docs 9.80 15 docs 8.13 80% 20 docs 7.80 70% 30 docs 6.93 100 docs 4.28 60% R−Precision 200 docs 3.11 50% 500 docs 1.92 1000 docs 1.25 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 5.50 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 251 to 275) queries 1 CLIPS05EFR Topic 251 1.20 Topic 276 2.96 Difference (average precision) Topic 252 1.06 Topic 277 4.34 0.5 Topic 253 0.22 Topic 278 0.75 Topic 254 10.71 Topic 279 0.00 Topic 255 0.65 Topic 280 0.26 0 Topic 256 29.94 Topic 281 13.00 Topic 257 0.47 Topic 282 0.23 −0.5 Topic 258 0.00 Topic 283 0.00 Topic 259 1.69 Topic 284 0.10 Topic 260 0.00 Topic 285 2.15 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.21 Topic 286 0.10 Topic Number Topic 262 0.15 Topic 287 3.49 Topic 263 5.12 Topic 288 8.07 CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 276 to 300) Topic 264 3.82 Topic 289 0.01 1 Topic 265 1.31 Topic 290 0.04 CLIPS05EFR Difference (average precision) Topic 266 0.12 Topic 291 0.06 0.5 Topic 267 0.00 Topic 292 0.25 Topic 268 0.56 Topic 293 0.02 Topic 269 0.47 Topic 294 0.33 0 Topic 270 48.01 Topic 295 4.58 Topic 271 0.09 Topic 296 0.06 Topic 272 0.19 Topic 297 0.00 −0.5 Topic 273 8.93 Topic 298 0.00 Topic 274 20.19 Topic 299 0.95 −1 Topic 275 7.78 Topic 300 0.00 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.162 clips CLIPS05ESFR0 AH-Bilingual-X2FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual Spanish to French Retrieved 50,000 RunType= automatic Relevant 2,537 QueryType= TD Relevant retrieved 696 Pooled= false CLEF 2005 AH−Bilingual−X2FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 21.70 CLIPS05ESFR0 90% 10 10.03 20 6.71 80% 30 4.65 70% 40 3.90 50 3.25 Average Precision 60% 60 2.93 50% 70 2.10 80 1.27 40% 90 0.50 30% 100 0.12 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 4.23 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 10.80 CLIPS05ESFR0 90% 10 docs 9.40 15 docs 8.80 80% 20 docs 7.90 70% 30 docs 6.73 100 docs 4.70 60% R−Precision 200 docs 3.43 50% 500 docs 2.08 1000 docs 1.39 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 5.75 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 251 to 275) queries 1 CLIPS05ESFR0 Topic 251 1.47 Topic 276 4.15 Difference (average precision) Topic 252 0.33 Topic 277 1.82 0.5 Topic 253 0.95 Topic 278 5.27 Topic 254 2.04 Topic 279 0.00 Topic 255 0.33 Topic 280 0.05 0 Topic 256 16.62 Topic 281 8.35 Topic 257 0.47 Topic 282 0.65 −0.5 Topic 258 0.00 Topic 283 0.00 Topic 259 1.61 Topic 284 0.64 Topic 260 0.02 Topic 285 1.01 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.00 Topic 286 0.65 Topic Number Topic 262 0.13 Topic 287 1.36 Topic 263 0.65 Topic 288 3.65 CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 276 to 300) Topic 264 39.91 Topic 289 0.06 1 Topic 265 4.09 Topic 290 0.23 CLIPS05ESFR0 Difference (average precision) Topic 266 0.60 Topic 291 0.04 0.5 Topic 267 0.11 Topic 292 0.25 Topic 268 0.07 Topic 293 0.00 Topic 269 0.43 Topic 294 2.35 0 Topic 270 56.34 Topic 295 3.11 Topic 271 2.77 Topic 296 0.09 Topic 272 0.45 Topic 297 0.00 −0.5 Topic 273 9.97 Topic 298 0.01 Topic 274 32.63 Topic 299 1.54 −1 Topic 275 4.03 Topic 300 0.00 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.163 dsv-stockholm ds-am-fr-da-l AH-Bilingual-X2FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual Amharic to French Retrieved 50,000 RunType= automatic Relevant 2,537 QueryType= TD Relevant retrieved 479 Pooled= true CLEF 2005 AH−Bilingual−X2FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 16.71 ds−am−fr−da−l 90% 10 6.20 20 4.23 80% 30 2.34 70% 40 1.43 50 1.13 Average Precision 60% 60 0.87 50% 70 0.29 80 0.15 40% 90 0.05 30% 100 0.05 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 2.22 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 7.20 ds−am−fr−da−l 90% 10 docs 6.80 15 docs 5.87 80% 20 docs 5.00 70% 30 docs 4.60 100 docs 2.62 60% R−Precision 200 docs 2.11 50% 500 docs 1.36 1000 docs 0.96 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 3.84 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 251 to 275) queries 1 ds−am−fr−da−l Topic 251 10.27 Topic 276 13.71 Difference (average precision) Topic 252 0.18 Topic 277 0.83 0.5 Topic 253 2.17 Topic 278 0.00 Topic 254 17.86 Topic 279 0.01 Topic 255 0.00 Topic 280 0.47 0 Topic 256 37.70 Topic 281 0.29 Topic 257 0.01 Topic 282 1.04 −0.5 Topic 258 0.00 Topic 283 0.03 Topic 259 0.00 Topic 284 0.01 Topic 260 1.28 Topic 285 0.00 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.00 Topic 286 0.69 Topic Number Topic 262 0.02 Topic 287 0.71 Topic 263 0.13 Topic 288 6.22 CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 276 to 300) Topic 264 0.19 Topic 289 0.22 1 Topic 265 0.19 Topic 290 0.12 ds−am−fr−da−l Difference (average precision) Topic 266 0.02 Topic 291 0.12 0.5 Topic 267 0.02 Topic 292 0.00 Topic 268 1.27 Topic 293 1.36 Topic 269 1.61 Topic 294 0.05 0 Topic 270 0.10 Topic 295 1.83 Topic 271 0.20 Topic 296 0.19 Topic 272 0.08 Topic 297 2.01 −0.5 Topic 273 0.46 Topic 298 0.02 Topic 274 1.99 Topic 299 0.08 −1 Topic 275 0.18 Topic 300 4.79 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.164 dsv-stockholm ds-am-fr-da-s AH-Bilingual-X2FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual Amharic to French Retrieved 50,000 RunType= automatic Relevant 2,537 QueryType= TD Relevant retrieved 535 Pooled= true CLEF 2005 AH−Bilingual−X2FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 24.55 ds−am−fr−da−s 90% 10 9.12 20 5.13 80% 30 3.75 70% 40 2.83 50 2.02 Average Precision 60% 60 1.36 50% 70 0.76 80 0.57 40% 90 0.39 30% 100 0.27 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 3.43 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 12.80 ds−am−fr−da−s 90% 10 docs 9.60 15 docs 7.87 80% 20 docs 7.50 70% 30 docs 6.13 100 docs 3.54 60% R−Precision 200 docs 2.48 50% 500 docs 1.56 1000 docs 1.07 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 5.16 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 251 to 275) queries 1 ds−am−fr−da−s Topic 251 18.28 Topic 276 5.63 Difference (average precision) Topic 252 0.87 Topic 277 5.59 0.5 Topic 253 1.91 Topic 278 0.00 Topic 254 23.31 Topic 279 0.01 Topic 255 1.23 Topic 280 0.06 0 Topic 256 39.85 Topic 281 7.28 Topic 257 0.03 Topic 282 2.23 −0.5 Topic 258 0.00 Topic 283 7.71 Topic 259 0.89 Topic 284 0.00 Topic 260 4.43 Topic 285 0.00 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.00 Topic 286 0.64 Topic Number Topic 262 0.68 Topic 287 0.15 Topic 263 0.29 Topic 288 5.90 CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 276 to 300) Topic 264 0.06 Topic 289 0.09 1 Topic 265 1.30 Topic 290 0.11 ds−am−fr−da−s Difference (average precision) Topic 266 0.04 Topic 291 0.11 0.5 Topic 267 0.00 Topic 292 0.02 Topic 268 1.63 Topic 293 2.31 Topic 269 1.78 Topic 294 0.07 0 Topic 270 0.26 Topic 295 1.97 Topic 271 0.12 Topic 296 0.10 Topic 272 26.26 Topic 297 4.44 −0.5 Topic 273 0.38 Topic 298 0.03 Topic 274 0.33 Topic 299 0.14 −1 Topic 275 0.34 Topic 300 2.79 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.165 dsv-stockholm ds-am-fr-nonda-l AH-Bilingual-X2FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual Amharic to French Retrieved 50,000 RunType= automatic Relevant 2,537 QueryType= TD Relevant retrieved 558 Pooled= false CLEF 2005 AH−Bilingual−X2FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 18.67 ds−am−fr−nonda−l 90% 10 6.93 20 4.70 80% 30 3.76 70% 40 1.76 50 0.79 Average Precision 60% 60 0.57 50% 70 0.32 80 0.08 40% 90 0.04 30% 100 0.04 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 2.51 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 7.60 ds−am−fr−nonda−l 90% 10 docs 6.40 15 docs 5.73 80% 20 docs 5.50 70% 30 docs 5.00 100 docs 3.22 60% R−Precision 200 docs 2.38 50% 500 docs 1.61 1000 docs 1.12 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 4.38 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 251 to 275) queries 1 ds−am−fr−nonda−l Topic 251 7.69 Topic 276 12.07 Difference (average precision) Topic 252 0.19 Topic 277 0.73 0.5 Topic 253 0.99 Topic 278 0.00 Topic 254 11.24 Topic 279 0.01 Topic 255 0.00 Topic 280 0.18 0 Topic 256 42.70 Topic 281 0.10 Topic 257 0.05 Topic 282 2.02 −0.5 Topic 258 0.00 Topic 283 0.04 Topic 259 0.00 Topic 284 0.10 Topic 260 3.05 Topic 285 7.70 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.00 Topic 286 1.24 Topic Number Topic 262 0.02 Topic 287 1.62 Topic 263 5.05 Topic 288 2.96 CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 276 to 300) Topic 264 0.06 Topic 289 0.22 1 Topic 265 0.09 Topic 290 0.12 ds−am−fr−nonda−l Difference (average precision) Topic 266 0.12 Topic 291 0.31 0.5 Topic 267 0.01 Topic 292 0.08 Topic 268 0.34 Topic 293 3.98 Topic 269 10.48 Topic 294 0.05 0 Topic 270 0.07 Topic 295 0.58 Topic 271 0.51 Topic 296 0.06 Topic 272 0.06 Topic 297 2.01 −0.5 Topic 273 0.32 Topic 298 0.02 Topic 274 1.31 Topic 299 0.01 −1 Topic 275 0.13 Topic 300 4.79 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.166 dsv-stockholm ds-am-fr-nonda-s AH-Bilingual-X2FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual Amharic to French Retrieved 50,000 RunType= automatic Relevant 2,537 QueryType= TD Relevant retrieved 579 Pooled= false CLEF 2005 AH−Bilingual−X2FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 23.84 ds−am−fr−nonda−s 90% 10 9.18 20 4.71 80% 30 3.36 70% 40 2.71 50 1.85 Average Precision 60% 60 1.45 50% 70 0.60 80 0.37 40% 90 0.23 30% 100 0.17 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 3.31 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 10.80 ds−am−fr−nonda−s 90% 10 docs 9.00 15 docs 7.73 80% 20 docs 6.90 70% 30 docs 6.00 100 docs 3.60 60% R−Precision 200 docs 2.62 50% 500 docs 1.66 1000 docs 1.16 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 4.88 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 251 to 275) queries 1 ds−am−fr−nonda−s Topic 251 17.17 Topic 276 5.56 Difference (average precision) Topic 252 0.86 Topic 277 5.61 0.5 Topic 253 1.17 Topic 278 0.00 Topic 254 23.26 Topic 279 0.01 Topic 255 0.00 Topic 280 0.06 0 Topic 256 41.50 Topic 281 4.13 Topic 257 0.02 Topic 282 4.33 −0.5 Topic 258 0.00 Topic 283 4.24 Topic 259 0.89 Topic 284 0.00 Topic 260 4.68 Topic 285 1.54 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.00 Topic 286 0.76 Topic Number Topic 262 0.68 Topic 287 0.83 Topic 263 8.82 Topic 288 10.97 CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 276 to 300) Topic 264 0.04 Topic 289 0.09 1 Topic 265 1.26 Topic 290 0.11 ds−am−fr−nonda−s Difference (average precision) Topic 266 0.02 Topic 291 0.11 0.5 Topic 267 0.00 Topic 292 0.05 Topic 268 0.64 Topic 293 1.80 Topic 269 2.20 Topic 294 0.07 0 Topic 270 0.20 Topic 295 0.83 Topic 271 0.17 Topic 296 0.07 Topic 272 12.70 Topic 297 4.44 −0.5 Topic 273 0.26 Topic 298 0.03 Topic 274 0.23 Topic 299 0.07 −1 Topic 275 0.34 Topic 300 2.79 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.167 hildesheim UHIENFR1 AH-Bilingual-X2FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual English to French Retrieved 50,000 RunType= automatic Relevant 2,537 QueryType= TD Relevant retrieved 2,269 Pooled= false CLEF 2005 AH−Bilingual−X2FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 67.52 UHIENFR1 90% 10 55.66 20 48.33 80% 30 42.99 70% 40 39.37 50 34.91 Average Precision 60% 60 30.31 50% 70 25.61 80 19.08 40% 90 12.41 30% 100 5.23 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 33.37 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 48.80 UHIENFR1 90% 10 docs 49.20 15 docs 46.67 80% 20 docs 44.20 70% 30 docs 40.20 100 docs 24.82 60% R−Precision 200 docs 16.50 50% 500 docs 8.28 1000 docs 4.54 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 34.72 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 251 to 275) queries 1 UHIENFR1 Topic 251 26.86 Topic 276 18.38 Difference (average precision) Topic 252 12.91 Topic 277 53.12 0.5 Topic 253 34.50 Topic 278 1.88 Topic 254 52.71 Topic 279 10.39 Topic 255 5.00 Topic 280 21.68 0 Topic 256 83.31 Topic 281 51.16 Topic 257 15.68 Topic 282 0.91 −0.5 Topic 258 3.40 Topic 283 63.22 Topic 259 41.17 Topic 284 56.52 Topic 260 26.49 Topic 285 32.80 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.08 Topic 286 4.38 Topic Number Topic 262 2.02 Topic 287 57.18 Topic 263 7.94 Topic 288 6.06 CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 276 to 300) Topic 264 68.76 Topic 289 64.71 1 Topic 265 35.87 Topic 290 41.42 UHIENFR1 Difference (average precision) Topic 266 2.71 Topic 291 15.03 0.5 Topic 267 20.53 Topic 292 6.98 Topic 268 8.89 Topic 293 75.84 Topic 269 35.98 Topic 294 64.32 0 Topic 270 64.14 Topic 295 49.01 Topic 271 54.55 Topic 296 30.48 Topic 272 8.37 Topic 297 62.87 −0.5 Topic 273 59.08 Topic 298 40.37 Topic 274 79.58 Topic 299 15.83 −1 Topic 275 63.75 Topic 300 9.55 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.168 hildesheim UHIENFR2 AH-Bilingual-X2FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual English to French Retrieved 50,000 RunType= automatic Relevant 2,537 QueryType= TD Relevant retrieved 2,307 Pooled= false CLEF 2005 AH−Bilingual−X2FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 70.23 UHIENFR2 90% 10 57.26 20 50.29 80% 30 45.45 70% 40 41.05 50 36.87 Average Precision 60% 60 31.28 50% 70 26.62 80 20.04 40% 90 12.86 30% 100 5.22 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 34.65 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 49.60 UHIENFR2 90% 10 docs 50.20 15 docs 47.20 80% 20 docs 44.20 70% 30 docs 40.33 100 docs 25.06 60% R−Precision 200 docs 16.94 50% 500 docs 8.44 1000 docs 4.61 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 36.54 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 251 to 275) queries 1 UHIENFR2 Topic 251 27.74 Topic 276 18.38 Difference (average precision) Topic 252 12.97 Topic 277 53.12 0.5 Topic 253 46.38 Topic 278 1.88 Topic 254 58.82 Topic 279 10.39 Topic 255 5.00 Topic 280 21.68 0 Topic 256 83.31 Topic 281 51.16 Topic 257 18.75 Topic 282 0.91 −0.5 Topic 258 25.98 Topic 283 63.22 Topic 259 41.17 Topic 284 56.16 Topic 260 26.49 Topic 285 32.80 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.08 Topic 286 4.38 Topic Number Topic 262 2.02 Topic 287 57.18 Topic 263 7.94 Topic 288 6.06 CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 276 to 300) Topic 264 59.14 Topic 289 64.71 1 Topic 265 35.87 Topic 290 41.42 UHIENFR2 Difference (average precision) Topic 266 2.71 Topic 291 15.03 0.5 Topic 267 20.53 Topic 292 6.98 Topic 268 30.78 Topic 293 75.84 Topic 269 38.05 Topic 294 64.32 0 Topic 270 64.14 Topic 295 49.01 Topic 271 54.55 Topic 296 30.48 Topic 272 8.37 Topic 297 62.87 −0.5 Topic 273 59.08 Topic 298 40.37 Topic 274 79.58 Topic 299 15.83 −1 Topic 275 69.32 Topic 300 9.55 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.169 hildesheim UHIRUFR1 AH-Bilingual-X2FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual Russian to French Retrieved 50,000 RunType= automatic Relevant 2,537 QueryType= TD Relevant retrieved 1,974 Pooled= true CLEF 2005 AH−Bilingual−X2FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 57.41 UHIRUFR1 90% 10 46.91 20 40.50 80% 30 36.24 70% 40 32.07 50 28.71 Average Precision 60% 60 23.34 50% 70 18.64 80 13.59 40% 90 9.53 30% 100 4.00 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 26.93 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 38.00 UHIRUFR1 90% 10 docs 37.80 15 docs 36.80 80% 20 docs 34.60 70% 30 docs 31.87 100 docs 20.20 60% R−Precision 200 docs 13.64 50% 500 docs 7.01 1000 docs 3.95 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 29.23 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 251 to 275) queries 1 UHIRUFR1 Topic 251 27.10 Topic 276 21.90 Difference (average precision) Topic 252 24.76 Topic 277 53.28 0.5 Topic 253 30.50 Topic 278 15.15 Topic 254 59.26 Topic 279 7.79 Topic 255 1.69 Topic 280 34.63 0 Topic 256 43.49 Topic 281 21.59 Topic 257 15.74 Topic 282 2.64 −0.5 Topic 258 1.11 Topic 283 59.33 Topic 259 35.77 Topic 284 43.05 Topic 260 30.03 Topic 285 0.47 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.00 Topic 286 1.31 Topic Number Topic 262 0.12 Topic 287 42.73 Topic 263 8.48 Topic 288 11.07 CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 276 to 300) Topic 264 61.91 Topic 289 58.57 1 Topic 265 0.14 Topic 290 53.07 UHIRUFR1 Difference (average precision) Topic 266 0.69 Topic 291 12.12 0.5 Topic 267 20.02 Topic 292 17.22 Topic 268 56.83 Topic 293 72.28 Topic 269 10.44 Topic 294 64.32 0 Topic 270 0.43 Topic 295 9.31 Topic 271 81.84 Topic 296 0.01 Topic 272 1.33 Topic 297 0.19 −0.5 Topic 273 63.75 Topic 298 42.26 Topic 274 68.02 Topic 299 10.14 −1 Topic 275 37.64 Topic 300 11.16 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.170 jhu-apl aplbienfrc AH-Bilingual-X2FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual English to French Retrieved 50,000 RunType= automatic Relevant 2,537 QueryType= TD Relevant retrieved 2,108 Pooled= true CLEF 2005 AH−Bilingual−X2FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 69.69 aplbienfrc 90% 10 56.49 20 53.08 80% 30 47.20 70% 40 39.97 50 35.85 Average Precision 60% 60 31.32 50% 70 24.07 80 18.56 40% 90 11.85 30% 100 5.22 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 34.42 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 50.00 aplbienfrc 90% 10 docs 45.80 15 docs 43.20 80% 20 docs 40.70 70% 30 docs 36.87 100 docs 23.62 60% R−Precision 200 docs 15.30 50% 500 docs 7.62 1000 docs 4.22 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 33.75 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 251 to 275) queries 1 aplbienfrc Topic 251 38.68 Topic 276 13.89 Difference (average precision) Topic 252 8.63 Topic 277 67.29 0.5 Topic 253 52.97 Topic 278 66.66 Topic 254 59.10 Topic 279 7.75 Topic 255 50.00 Topic 280 3.12 0 Topic 256 91.65 Topic 281 58.77 Topic 257 4.18 Topic 282 7.48 −0.5 Topic 258 0.61 Topic 283 70.72 Topic 259 9.53 Topic 284 38.53 Topic 260 51.33 Topic 285 53.33 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.04 Topic 286 0.83 Topic Number Topic 262 0.06 Topic 287 27.31 Topic 263 5.73 Topic 288 20.34 CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 276 to 300) Topic 264 75.70 Topic 289 57.56 1 Topic 265 43.47 Topic 290 41.27 aplbienfrc Difference (average precision) Topic 266 0.62 Topic 291 11.79 0.5 Topic 267 18.36 Topic 292 32.16 Topic 268 44.87 Topic 293 75.46 Topic 269 19.55 Topic 294 49.33 0 Topic 270 63.25 Topic 295 47.75 Topic 271 56.37 Topic 296 31.41 Topic 272 10.36 Topic 297 1.87 −0.5 Topic 273 60.14 Topic 298 43.27 Topic 274 65.26 Topic 299 0.17 −1 Topic 275 56.77 Topic 300 5.82 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.171 miracle ENSST AH-Bilingual-X2FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual English to French Retrieved 50,000 RunType= automatic Relevant 2,537 QueryType= TD Relevant retrieved 2,072 Pooled= false CLEF 2005 AH−Bilingual−X2FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 68.10 ENSST 90% 10 52.52 20 44.76 80% 30 40.51 70% 40 35.36 50 31.37 Average Precision 60% 60 26.83 50% 70 22.73 80 17.62 40% 90 10.17 30% 100 4.34 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 30.76 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 46.00 ENSST 90% 10 docs 43.80 15 docs 41.47 80% 20 docs 38.50 70% 30 docs 35.27 100 docs 22.00 60% R−Precision 200 docs 14.79 50% 500 docs 7.55 1000 docs 4.14 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 31.86 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 251 to 275) queries 1 ENSST Topic 251 13.10 Topic 276 20.32 Difference (average precision) Topic 252 7.06 Topic 277 53.54 0.5 Topic 253 0.94 Topic 278 59.85 Topic 254 59.48 Topic 279 6.94 Topic 255 1.11 Topic 280 18.29 0 Topic 256 77.20 Topic 281 45.23 Topic 257 12.82 Topic 282 2.61 −0.5 Topic 258 0.08 Topic 283 8.91 Topic 259 41.84 Topic 284 66.07 Topic 260 8.93 Topic 285 59.63 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.07 Topic 286 2.40 Topic Number Topic 262 5.50 Topic 287 49.99 Topic 263 35.86 Topic 288 12.51 CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 276 to 300) Topic 264 61.84 Topic 289 63.69 1 Topic 265 24.74 Topic 290 19.20 ENSST Difference (average precision) Topic 266 0.61 Topic 291 9.86 0.5 Topic 267 25.89 Topic 292 5.83 Topic 268 67.23 Topic 293 71.43 Topic 269 18.73 Topic 294 65.50 0 Topic 270 63.16 Topic 295 43.99 Topic 271 64.42 Topic 296 20.28 Topic 272 15.54 Topic 297 55.67 −0.5 Topic 273 43.70 Topic 298 31.10 Topic 274 35.79 Topic 299 12.66 −1 Topic 275 36.67 Topic 300 10.10 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.172 miracle ENSxNP01HR1 AH-Bilingual-X2FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual English to French Retrieved 50,000 RunType= automatic Relevant 2,537 QueryType= TDN Relevant retrieved 2,023 Pooled= false CLEF 2005 AH−Bilingual−X2FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 68.64 ENSxNP01HR1 90% 10 50.70 20 39.08 80% 30 34.61 70% 40 29.54 50 26.97 Average Precision 60% 60 22.79 50% 70 17.74 80 12.96 40% 90 7.21 30% 100 1.94 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 26.45 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 43.20 ENSxNP01HR1 90% 10 docs 39.20 15 docs 36.53 80% 20 docs 34.60 70% 30 docs 31.87 100 docs 20.60 60% R−Precision 200 docs 13.87 50% 500 docs 7.20 1000 docs 4.05 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 28.90 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 251 to 275) queries 1 ENSxNP01HR1 Topic 251 7.10 Topic 276 14.98 Difference (average precision) Topic 252 14.99 Topic 277 35.99 0.5 Topic 253 13.59 Topic 278 22.90 Topic 254 52.91 Topic 279 6.49 Topic 255 2.08 Topic 280 20.50 0 Topic 256 45.33 Topic 281 37.62 Topic 257 14.99 Topic 282 1.03 −0.5 Topic 258 0.06 Topic 283 6.55 Topic 259 15.82 Topic 284 56.69 Topic 260 2.42 Topic 285 55.57 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 5.93 Topic 286 12.59 Topic Number Topic 262 8.15 Topic 287 40.60 Topic 263 25.14 Topic 288 10.58 CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 276 to 300) Topic 264 40.33 Topic 289 69.31 1 Topic 265 22.82 Topic 290 4.61 ENSxNP01HR1 Difference (average precision) Topic 266 1.46 Topic 291 8.80 0.5 Topic 267 24.51 Topic 292 4.50 Topic 268 51.20 Topic 293 59.78 Topic 269 19.93 Topic 294 57.66 0 Topic 270 55.37 Topic 295 52.65 Topic 271 48.69 Topic 296 7.24 Topic 272 14.44 Topic 297 60.67 −0.5 Topic 273 48.90 Topic 298 27.70 Topic 274 61.88 Topic 299 1.74 −1 Topic 275 36.79 Topic 300 10.88 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.173 miracle ENSxNP01SR1 AH-Bilingual-X2FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual English to French Retrieved 50,000 RunType= automatic Relevant 2,537 QueryType= TDN Relevant retrieved 2,119 Pooled= false CLEF 2005 AH−Bilingual−X2FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 74.36 ENSxNP01SR1 90% 10 54.50 20 45.77 80% 30 40.80 70% 40 35.70 50 31.87 Average Precision 60% 60 26.20 50% 70 21.74 80 17.11 40% 90 11.10 30% 100 3.67 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 30.73 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 50.00 ENSxNP01SR1 90% 10 docs 42.40 15 docs 40.40 80% 20 docs 38.80 70% 30 docs 34.93 100 docs 22.38 60% R−Precision 200 docs 15.16 50% 500 docs 7.69 1000 docs 4.24 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 32.88 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 251 to 275) queries 1 ENSxNP01SR1 Topic 251 10.82 Topic 276 19.43 Difference (average precision) Topic 252 18.17 Topic 277 35.67 0.5 Topic 253 3.29 Topic 278 33.11 Topic 254 62.80 Topic 279 7.20 Topic 255 2.33 Topic 280 15.50 0 Topic 256 58.78 Topic 281 47.97 Topic 257 16.07 Topic 282 4.08 −0.5 Topic 258 0.06 Topic 283 6.33 Topic 259 36.29 Topic 284 66.96 Topic 260 6.27 Topic 285 63.56 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 16.76 Topic 286 13.03 Topic Number Topic 262 8.48 Topic 287 52.43 Topic 263 36.85 Topic 288 18.56 CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 276 to 300) Topic 264 49.91 Topic 289 60.18 1 Topic 265 24.89 Topic 290 9.56 ENSxNP01SR1 Difference (average precision) Topic 266 0.83 Topic 291 9.14 0.5 Topic 267 25.96 Topic 292 13.08 Topic 268 58.73 Topic 293 69.33 Topic 269 27.21 Topic 294 62.81 0 Topic 270 65.00 Topic 295 44.99 Topic 271 64.40 Topic 296 17.12 Topic 272 18.58 Topic 297 53.75 −0.5 Topic 273 49.99 Topic 298 28.41 Topic 274 42.61 Topic 299 4.76 −1 Topic 275 57.66 Topic 300 16.87 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.174 miracle ESSST AH-Bilingual-X2FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual Spanish to French Retrieved 50,000 RunType= automatic Relevant 2,537 QueryType= TD Relevant retrieved 1,921 Pooled= false CLEF 2005 AH−Bilingual−X2FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 63.59 ESSST 90% 10 50.62 20 44.13 80% 30 38.89 70% 40 34.55 50 30.92 Average Precision 60% 60 26.06 50% 70 20.98 80 16.10 40% 90 9.50 30% 100 3.78 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 29.60 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 47.20 ESSST 90% 10 docs 41.40 15 docs 38.27 80% 20 docs 36.40 70% 30 docs 33.80 100 docs 20.48 60% R−Precision 200 docs 13.59 50% 500 docs 6.93 1000 docs 3.84 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 31.66 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 251 to 275) queries 1 ESSST Topic 251 13.93 Topic 276 19.26 Difference (average precision) Topic 252 4.57 Topic 277 51.22 0.5 Topic 253 0.00 Topic 278 53.05 Topic 254 49.43 Topic 279 6.16 Topic 255 1.09 Topic 280 31.08 0 Topic 256 84.58 Topic 281 42.38 Topic 257 6.22 Topic 282 5.30 −0.5 Topic 258 0.00 Topic 283 63.81 Topic 259 35.37 Topic 284 24.58 Topic 260 13.95 Topic 285 33.98 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.03 Topic 286 1.05 Topic Number Topic 262 0.34 Topic 287 2.36 Topic 263 27.90 Topic 288 3.13 CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 276 to 300) Topic 264 60.43 Topic 289 17.83 1 Topic 265 24.27 Topic 290 34.79 ESSST Difference (average precision) Topic 266 11.99 Topic 291 8.53 0.5 Topic 267 20.54 Topic 292 4.30 Topic 268 44.56 Topic 293 69.59 Topic 269 18.73 Topic 294 65.31 0 Topic 270 61.66 Topic 295 45.28 Topic 271 80.77 Topic 296 30.92 Topic 272 14.37 Topic 297 55.67 −0.5 Topic 273 50.27 Topic 298 31.11 Topic 274 73.88 Topic 299 2.28 −1 Topic 275 59.80 Topic 300 18.18 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.175 miracle ESSxNP01HR1 AH-Bilingual-X2FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual Spanish to French Retrieved 50,000 RunType= automatic Relevant 2,537 QueryType= TDN Relevant retrieved 1,811 Pooled= false CLEF 2005 AH−Bilingual−X2FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 63.35 ESSxNP01HR1 90% 10 50.15 20 43.38 80% 30 37.58 70% 40 32.86 50 27.98 Average Precision 60% 60 23.32 50% 70 19.09 80 13.17 40% 90 5.71 30% 100 1.49 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 27.49 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 45.20 ESSxNP01HR1 90% 10 docs 39.00 15 docs 36.53 80% 20 docs 35.10 70% 30 docs 32.73 100 docs 19.04 60% R−Precision 200 docs 12.61 50% 500 docs 6.50 1000 docs 3.62 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 28.92 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 251 to 275) queries 1 ESSxNP01HR1 Topic 251 7.59 Topic 276 15.15 Difference (average precision) Topic 252 7.10 Topic 277 43.04 0.5 Topic 253 0.01 Topic 278 30.55 Topic 254 50.66 Topic 279 6.31 Topic 255 1.85 Topic 280 26.87 0 Topic 256 68.25 Topic 281 36.21 Topic 257 6.68 Topic 282 4.93 −0.5 Topic 258 0.07 Topic 283 55.58 Topic 259 16.36 Topic 284 15.54 Topic 260 5.25 Topic 285 38.75 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 38.44 Topic 286 1.53 Topic Number Topic 262 0.38 Topic 287 1.59 Topic 263 24.53 Topic 288 1.98 CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 276 to 300) Topic 264 51.05 Topic 289 26.58 1 Topic 265 21.28 Topic 290 27.47 ESSxNP01HR1 Difference (average precision) Topic 266 14.46 Topic 291 6.00 0.5 Topic 267 19.55 Topic 292 3.17 Topic 268 46.68 Topic 293 59.28 Topic 269 11.43 Topic 294 63.63 0 Topic 270 56.32 Topic 295 52.79 Topic 271 74.66 Topic 296 40.79 Topic 272 12.02 Topic 297 60.80 −0.5 Topic 273 51.98 Topic 298 27.23 Topic 274 72.33 Topic 299 1.78 −1 Topic 275 49.97 Topic 300 18.10 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.176 miracle ESSxNP01SR1 AH-Bilingual-X2FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual Spanish to French Retrieved 50,000 RunType= automatic Relevant 2,537 QueryType= TDN Relevant retrieved 1,935 Pooled= true CLEF 2005 AH−Bilingual−X2FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 67.91 ESSxNP01SR1 90% 10 53.33 20 47.25 80% 30 42.13 70% 40 37.06 50 33.03 Average Precision 60% 60 27.17 50% 70 22.06 80 17.82 40% 90 9.92 30% 100 3.80 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 31.34 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 48.00 ESSxNP01SR1 90% 10 docs 41.80 15 docs 39.20 80% 20 docs 37.30 70% 30 docs 33.67 100 docs 21.56 60% R−Precision 200 docs 13.85 50% 500 docs 6.98 1000 docs 3.87 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 32.66 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 251 to 275) queries 1 ESSxNP01SR1 Topic 251 12.28 Topic 276 20.03 Difference (average precision) Topic 252 10.71 Topic 277 43.26 0.5 Topic 253 0.00 Topic 278 39.24 Topic 254 55.15 Topic 279 6.30 Topic 255 1.72 Topic 280 25.36 0 Topic 256 83.95 Topic 281 46.41 Topic 257 9.90 Topic 282 11.54 −0.5 Topic 258 0.00 Topic 283 54.74 Topic 259 25.60 Topic 284 35.64 Topic 260 6.32 Topic 285 44.52 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 56.02 Topic 286 5.21 Topic Number Topic 262 0.50 Topic 287 2.36 Topic 263 30.15 Topic 288 3.37 CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 276 to 300) Topic 264 59.03 Topic 289 30.83 1 Topic 265 22.23 Topic 290 27.31 ESSxNP01SR1 Difference (average precision) Topic 266 15.50 Topic 291 7.38 0.5 Topic 267 20.50 Topic 292 11.04 Topic 268 67.07 Topic 293 67.74 Topic 269 19.51 Topic 294 69.20 0 Topic 270 66.43 Topic 295 45.61 Topic 271 70.14 Topic 296 41.25 Topic 272 14.66 Topic 297 54.18 −0.5 Topic 273 53.94 Topic 298 28.95 Topic 274 64.25 Topic 299 2.18 −1 Topic 275 60.49 Topic 300 17.40 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.177 u.glasgow glaitfrtd AH-Bilingual-X2FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual Italian to French Retrieved 50,000 RunType= automatic Relevant 2,537 QueryType= TD Relevant retrieved 1,732 Pooled= false CLEF 2005 AH−Bilingual−X2FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 49.94 glaitfrtd 90% 10 38.65 20 31.72 80% 30 26.48 70% 40 22.99 50 20.72 Average Precision 60% 60 17.64 50% 70 13.22 80 10.94 40% 90 6.73 30% 100 2.52 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 20.66 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 33.20 glaitfrtd 90% 10 docs 33.00 15 docs 30.00 80% 20 docs 27.80 70% 30 docs 25.53 100 docs 16.60 60% R−Precision 200 docs 11.37 50% 500 docs 6.09 1000 docs 3.46 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 23.14 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 251 to 275) queries 1 glaitfrtd Topic 251 8.32 Topic 276 0.70 Difference (average precision) Topic 252 6.94 Topic 277 0.07 0.5 Topic 253 6.02 Topic 278 0.69 Topic 254 50.34 Topic 279 0.04 Topic 255 0.44 Topic 280 5.90 0 Topic 256 76.65 Topic 281 22.68 Topic 257 3.98 Topic 282 2.60 −0.5 Topic 258 6.67 Topic 283 70.71 Topic 259 26.25 Topic 284 55.69 Topic 260 26.06 Topic 285 59.26 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 9.28 Topic 286 0.69 Topic Number Topic 262 0.44 Topic 287 41.68 Topic 263 32.00 Topic 288 1.39 CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 276 to 300) Topic 264 42.67 Topic 289 16.29 1 Topic 265 22.64 Topic 290 0.51 glaitfrtd Difference (average precision) Topic 266 2.29 Topic 291 6.47 0.5 Topic 267 30.94 Topic 292 5.13 Topic 268 18.71 Topic 293 29.31 Topic 269 9.63 Topic 294 60.52 0 Topic 270 46.74 Topic 295 15.50 Topic 271 63.71 Topic 296 22.92 Topic 272 8.62 Topic 297 3.36 −0.5 Topic 273 46.27 Topic 298 10.87 Topic 274 48.89 Topic 299 1.03 −1 Topic 275 4.34 Topic 300 0.06 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.178 u.glasgow glaitfrtdn AH-Bilingual-X2FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual Italian to French Retrieved 50,000 RunType= automatic Relevant 2,537 QueryType= TDN Relevant retrieved 1,799 Pooled= true CLEF 2005 AH−Bilingual−X2FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 57.69 glaitfrtdn 90% 10 43.84 20 34.87 80% 30 31.05 70% 40 25.72 50 22.38 Average Precision 60% 60 18.57 50% 70 14.24 80 11.41 40% 90 6.25 30% 100 2.16 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 22.91 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 38.40 glaitfrtdn 90% 10 docs 35.40 15 docs 34.00 80% 20 docs 32.90 70% 30 docs 28.33 100 docs 17.80 60% R−Precision 200 docs 11.82 50% 500 docs 6.29 1000 docs 3.60 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 25.18 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 251 to 275) queries 1 glaitfrtdn Topic 251 2.41 Topic 276 0.57 Difference (average precision) Topic 252 22.75 Topic 277 0.03 0.5 Topic 253 12.58 Topic 278 1.58 Topic 254 48.76 Topic 279 0.40 Topic 255 2.94 Topic 280 23.71 0 Topic 256 75.64 Topic 281 32.67 Topic 257 14.59 Topic 282 1.95 −0.5 Topic 258 0.61 Topic 283 61.30 Topic 259 33.30 Topic 284 51.28 Topic 260 14.91 Topic 285 63.12 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 33.28 Topic 286 0.00 Topic Number Topic 262 0.47 Topic 287 48.59 Topic 263 27.37 Topic 288 3.78 CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 276 to 300) Topic 264 39.98 Topic 289 11.79 1 Topic 265 19.96 Topic 290 0.16 glaitfrtdn Difference (average precision) Topic 266 1.03 Topic 291 7.05 0.5 Topic 267 34.52 Topic 292 7.61 Topic 268 21.49 Topic 293 29.38 Topic 269 7.41 Topic 294 65.05 0 Topic 270 46.02 Topic 295 18.62 Topic 271 72.97 Topic 296 26.12 Topic 272 9.77 Topic 297 4.19 −0.5 Topic 273 56.05 Topic 298 19.87 Topic 274 51.06 Topic 299 0.48 −1 Topic 275 16.60 Topic 300 0.00 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.179 u.glasgow glaitfrtdnqe AH-Bilingual-X2FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual Italian to French Retrieved 50,000 RunType= automatic Relevant 2,537 QueryType= TDN Relevant retrieved 2,010 Pooled= false CLEF 2005 AH−Bilingual−X2FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 56.65 glaitfrtdnqe 90% 10 48.90 20 41.14 80% 30 37.38 70% 40 33.88 50 31.05 Average Precision 60% 60 25.66 50% 70 21.03 80 16.72 40% 90 10.15 30% 100 3.92 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 28.83 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 42.00 glaitfrtdnqe 90% 10 docs 39.80 15 docs 37.73 80% 20 docs 35.30 70% 30 docs 32.20 100 docs 21.38 60% R−Precision 200 docs 14.32 50% 500 docs 7.25 1000 docs 4.02 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 29.43 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 251 to 275) queries 1 glaitfrtdnqe Topic 251 1.61 Topic 276 0.52 Difference (average precision) Topic 252 27.61 Topic 277 0.01 0.5 Topic 253 28.52 Topic 278 3.36 Topic 254 53.10 Topic 279 0.43 Topic 255 2.94 Topic 280 37.61 0 Topic 256 84.01 Topic 281 31.11 Topic 257 9.00 Topic 282 2.28 −0.5 Topic 258 0.38 Topic 283 67.43 Topic 259 24.37 Topic 284 62.51 Topic 260 51.15 Topic 285 65.20 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 47.54 Topic 286 0.00 Topic Number Topic 262 0.46 Topic 287 50.62 Topic 263 37.07 Topic 288 4.23 CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 276 to 300) Topic 264 65.27 Topic 289 15.24 1 Topic 265 19.22 Topic 290 0.10 glaitfrtdnqe Difference (average precision) Topic 266 0.25 Topic 291 12.57 0.5 Topic 267 35.78 Topic 292 8.29 Topic 268 22.68 Topic 293 30.93 Topic 269 23.80 Topic 294 64.45 0 Topic 270 61.70 Topic 295 31.32 Topic 271 76.80 Topic 296 30.68 Topic 272 17.77 Topic 297 2.76 −0.5 Topic 273 65.32 Topic 298 40.17 Topic 274 70.66 Topic 299 0.36 −1 Topic 275 52.54 Topic 300 0.00 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.180 u.surugadai SrgdDT05 AH-Bilingual-X2FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual German to French Retrieved 50,000 RunType= automatic Relevant 2,537 QueryType= TD Relevant retrieved 1,394 Pooled= false CLEF 2005 AH−Bilingual−X2FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 39.45 SrgdDT05 90% 10 26.10 20 21.41 80% 30 18.50 70% 40 17.08 50 14.70 Average Precision 60% 60 12.43 50% 70 11.36 80 9.37 40% 90 3.90 30% 100 1.44 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 14.94 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 22.40 SrgdDT05 90% 10 docs 20.40 15 docs 19.33 80% 20 docs 19.00 70% 30 docs 17.33 100 docs 11.38 60% R−Precision 200 docs 8.05 50% 500 docs 4.74 1000 docs 2.79 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 16.05 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 251 to 275) queries 1 SrgdDT05 Topic 251 4.10 Topic 276 10.52 Difference (average precision) Topic 252 0.06 Topic 277 60.46 0.5 Topic 253 0.00 Topic 278 0.01 Topic 254 41.64 Topic 279 0.21 Topic 255 0.00 Topic 280 18.04 0 Topic 256 77.49 Topic 281 1.65 Topic 257 0.00 Topic 282 8.53 −0.5 Topic 258 0.00 Topic 283 1.31 Topic 259 2.85 Topic 284 19.13 Topic 260 32.13 Topic 285 57.29 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.43 Topic 286 0.00 Topic Number Topic 262 0.21 Topic 287 16.40 Topic 263 20.56 Topic 288 2.64 CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 276 to 300) Topic 264 18.20 Topic 289 0.00 1 Topic 265 9.38 Topic 290 0.03 SrgdDT05 Difference (average precision) Topic 266 13.68 Topic 291 7.93 0.5 Topic 267 4.64 Topic 292 5.56 Topic 268 0.44 Topic 293 70.04 Topic 269 0.06 Topic 294 32.61 0 Topic 270 0.72 Topic 295 15.02 Topic 271 88.21 Topic 296 43.35 Topic 272 17.36 Topic 297 0.00 −0.5 Topic 273 2.15 Topic 298 0.28 Topic 274 7.77 Topic 299 0.82 −1 Topic 275 23.87 Topic 300 9.04 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.181 u.surugadai SrgdMgE03 AH-Bilingual-X2FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual German to French Retrieved 50,000 RunType= automatic Relevant 2,537 QueryType= TD Relevant retrieved 2,015 Pooled= false CLEF 2005 AH−Bilingual−X2FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 59.08 SrgdMgE03 90% 10 44.92 20 38.62 80% 30 32.42 70% 40 29.53 50 26.77 Average Precision 60% 60 23.98 50% 70 19.72 80 14.70 40% 90 8.52 30% 100 3.81 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 26.05 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 38.00 SrgdMgE03 90% 10 docs 36.20 15 docs 34.27 80% 20 docs 32.40 70% 30 docs 29.33 100 docs 19.20 60% R−Precision 200 docs 13.62 50% 500 docs 7.18 1000 docs 4.03 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 26.69 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 251 to 275) queries 1 SrgdMgE03 Topic 251 30.04 Topic 276 7.43 Difference (average precision) Topic 252 3.85 Topic 277 57.11 0.5 Topic 253 59.02 Topic 278 1.75 Topic 254 56.25 Topic 279 7.97 Topic 255 0.48 Topic 280 25.65 0 Topic 256 81.11 Topic 281 12.87 Topic 257 9.41 Topic 282 2.88 −0.5 Topic 258 0.00 Topic 283 45.91 Topic 259 25.62 Topic 284 35.80 Topic 260 15.64 Topic 285 55.75 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.00 Topic 286 26.13 Topic Number Topic 262 17.94 Topic 287 18.49 Topic 263 0.23 Topic 288 3.63 CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 276 to 300) Topic 264 58.70 Topic 289 0.00 1 Topic 265 9.22 Topic 290 4.84 SrgdMgE03 Difference (average precision) Topic 266 3.09 Topic 291 15.00 0.5 Topic 267 45.02 Topic 292 2.74 Topic 268 2.15 Topic 293 70.04 Topic 269 32.51 Topic 294 64.44 0 Topic 270 60.21 Topic 295 1.18 Topic 271 84.08 Topic 296 29.90 Topic 272 8.36 Topic 297 64.38 −0.5 Topic 273 2.20 Topic 298 36.18 Topic 274 73.77 Topic 299 6.13 −1 Topic 275 18.82 Topic 300 8.73 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.182 u.surugadai SrgdMgG02 AH-Bilingual-X2FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual German to French Retrieved 50,000 RunType= automatic Relevant 2,537 QueryType= TD Relevant retrieved 2,018 Pooled= true CLEF 2005 AH−Bilingual−X2FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 59.31 SrgdMgG02 90% 10 44.34 20 36.21 80% 30 32.70 70% 40 28.56 50 26.03 Average Precision 60% 60 22.26 50% 70 16.95 80 13.13 40% 90 7.66 30% 100 3.35 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 24.92 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 40.00 SrgdMgG02 90% 10 docs 36.00 15 docs 32.53 80% 20 docs 30.90 70% 30 docs 28.53 100 docs 18.10 60% R−Precision 200 docs 12.79 50% 500 docs 7.06 1000 docs 4.04 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 25.79 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 251 to 275) queries 1 SrgdMgG02 Topic 251 19.76 Topic 276 6.22 Difference (average precision) Topic 252 2.45 Topic 277 61.17 0.5 Topic 253 14.75 Topic 278 0.24 Topic 254 59.14 Topic 279 9.06 Topic 255 0.47 Topic 280 27.47 0 Topic 256 77.59 Topic 281 15.09 Topic 257 3.52 Topic 282 5.08 −0.5 Topic 258 0.00 Topic 283 41.13 Topic 259 23.72 Topic 284 34.72 Topic 260 39.90 Topic 285 55.97 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.39 Topic 286 6.82 Topic Number Topic 262 18.62 Topic 287 29.66 Topic 263 18.03 Topic 288 4.16 CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 276 to 300) Topic 264 50.38 Topic 289 0.00 1 Topic 265 10.48 Topic 290 0.06 SrgdMgG02 Difference (average precision) Topic 266 3.32 Topic 291 12.60 0.5 Topic 267 41.08 Topic 292 2.63 Topic 268 2.59 Topic 293 70.14 Topic 269 19.23 Topic 294 62.64 0 Topic 270 45.80 Topic 295 6.75 Topic 271 86.05 Topic 296 34.27 Topic 272 10.95 Topic 297 60.64 −0.5 Topic 273 1.73 Topic 298 35.49 Topic 274 67.50 Topic 299 3.85 −1 Topic 275 35.89 Topic 300 6.71 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.183 u.surugadai SrgdQT04 AH-Bilingual-X2FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual German to French Retrieved 50,000 RunType= automatic Relevant 2,537 QueryType= TD Relevant retrieved 1,998 Pooled= false CLEF 2005 AH−Bilingual−X2FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 54.57 SrgdQT04 90% 10 43.69 20 38.05 80% 30 34.63 70% 40 30.79 50 28.44 Average Precision 60% 60 24.96 50% 70 21.04 80 16.29 40% 90 9.12 30% 100 2.72 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 26.58 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 38.00 SrgdQT04 90% 10 docs 33.80 15 docs 32.80 80% 20 docs 32.30 70% 30 docs 29.53 100 docs 19.62 60% R−Precision 200 docs 13.67 50% 500 docs 7.15 1000 docs 4.00 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 26.42 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 251 to 275) queries 1 SrgdQT04 Topic 251 26.03 Topic 276 0.91 Difference (average precision) Topic 252 4.95 Topic 277 57.51 0.5 Topic 253 63.83 Topic 278 0.57 Topic 254 53.30 Topic 279 10.30 Topic 255 0.82 Topic 280 20.89 0 Topic 256 77.13 Topic 281 14.30 Topic 257 14.08 Topic 282 2.85 −0.5 Topic 258 0.00 Topic 283 64.24 Topic 259 25.78 Topic 284 38.73 Topic 260 45.80 Topic 285 54.29 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.00 Topic 286 15.71 Topic Number Topic 262 23.02 Topic 287 4.05 Topic 263 2.44 Topic 288 0.89 CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 276 to 300) Topic 264 59.50 Topic 289 0.00 1 Topic 265 7.19 Topic 290 0.07 SrgdQT04 Difference (average precision) Topic 266 0.19 Topic 291 14.38 0.5 Topic 267 39.92 Topic 292 2.45 Topic 268 3.22 Topic 293 69.43 Topic 269 30.15 Topic 294 66.40 0 Topic 270 60.12 Topic 295 4.94 Topic 271 81.58 Topic 296 30.52 Topic 272 8.11 Topic 297 64.42 −0.5 Topic 273 0.47 Topic 298 37.71 Topic 274 75.96 Topic 299 3.74 −1 Topic 275 36.30 Topic 300 9.93 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.184 unine UniNEbifr1 AH-Bilingual-X2FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual English to French Retrieved 50,000 RunType= automatic Relevant 2,537 QueryType= TD Relevant retrieved 2,165 Pooled= true CLEF 2005 AH−Bilingual−X2FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 72.24 UniNEbifr1 90% 10 60.14 20 51.67 80% 30 43.08 70% 40 38.08 50 34.11 Average Precision 60% 60 29.16 50% 70 23.98 80 18.14 40% 90 12.03 30% 100 4.30 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 33.57 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 50.40 UniNEbifr1 90% 10 docs 49.20 15 docs 45.47 80% 20 docs 43.40 70% 30 docs 38.60 100 docs 23.88 60% R−Precision 200 docs 15.74 50% 500 docs 7.81 1000 docs 4.33 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 35.19 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 251 to 275) queries 1 UniNEbifr1 Topic 251 16.04 Topic 276 28.88 Difference (average precision) Topic 252 6.22 Topic 277 48.82 0.5 Topic 253 30.00 Topic 278 21.85 Topic 254 66.97 Topic 279 7.98 Topic 255 0.96 Topic 280 15.85 0 Topic 256 83.20 Topic 281 45.82 Topic 257 11.98 Topic 282 3.23 −0.5 Topic 258 3.58 Topic 283 47.43 Topic 259 50.49 Topic 284 66.25 Topic 260 23.10 Topic 285 41.29 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.18 Topic 286 8.03 Topic Number Topic 262 10.15 Topic 287 51.46 Topic 263 37.87 Topic 288 10.13 CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 276 to 300) Topic 264 69.11 Topic 289 71.60 1 Topic 265 38.56 Topic 290 17.59 UniNEbifr1 Difference (average precision) Topic 266 0.78 Topic 291 6.99 0.5 Topic 267 44.93 Topic 292 5.18 Topic 268 55.81 Topic 293 75.37 Topic 269 19.88 Topic 294 67.37 0 Topic 270 58.50 Topic 295 51.77 Topic 271 72.44 Topic 296 25.24 Topic 272 15.46 Topic 297 43.61 −0.5 Topic 273 47.14 Topic 298 27.80 Topic 274 63.71 Topic 299 11.40 −1 Topic 275 30.80 Topic 300 19.56 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.185 unine UniNEbifr2 AH-Bilingual-X2FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual English to French Retrieved 50,000 RunType= automatic Relevant 2,537 QueryType= TD Relevant retrieved 2,212 Pooled= false CLEF 2005 AH−Bilingual−X2FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 74.52 UniNEbifr2 90% 10 58.70 20 51.50 80% 30 45.02 70% 40 38.32 50 35.57 Average Precision 60% 60 30.68 50% 70 25.35 80 19.39 40% 90 12.89 30% 100 4.17 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 34.67 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 53.20 UniNEbifr2 90% 10 docs 49.00 15 docs 44.00 80% 20 docs 42.40 70% 30 docs 39.73 100 docs 24.56 60% R−Precision 200 docs 16.32 50% 500 docs 8.02 1000 docs 4.42 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 36.02 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 251 to 275) queries 1 UniNEbifr2 Topic 251 23.98 Topic 276 23.62 Difference (average precision) Topic 252 7.30 Topic 277 49.61 0.5 Topic 253 39.06 Topic 278 5.67 Topic 254 69.75 Topic 279 9.71 Topic 255 1.49 Topic 280 19.58 0 Topic 256 85.58 Topic 281 47.76 Topic 257 15.14 Topic 282 4.84 −0.5 Topic 258 2.66 Topic 283 46.76 Topic 259 51.97 Topic 284 64.85 Topic 260 22.69 Topic 285 57.34 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.07 Topic 286 7.47 Topic Number Topic 262 4.25 Topic 287 52.60 Topic 263 44.21 Topic 288 11.20 CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 276 to 300) Topic 264 73.25 Topic 289 69.29 1 Topic 265 39.67 Topic 290 24.80 UniNEbifr2 Difference (average precision) Topic 266 1.24 Topic 291 4.54 0.5 Topic 267 43.03 Topic 292 4.47 Topic 268 55.44 Topic 293 76.66 Topic 269 21.88 Topic 294 68.53 0 Topic 270 63.37 Topic 295 43.28 Topic 271 75.20 Topic 296 24.81 Topic 272 20.25 Topic 297 47.98 −0.5 Topic 273 59.21 Topic 298 30.09 Topic 274 61.14 Topic 299 10.80 −1 Topic 275 24.47 Topic 300 20.72 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.186 unine UniNEbifr3 AH-Bilingual-X2FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual English to French Retrieved 50,000 RunType= automatic Relevant 2,537 QueryType= TD Relevant retrieved 2,194 Pooled= false CLEF 2005 AH−Bilingual−X2FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 72.72 UniNEbifr3 90% 10 60.95 20 52.26 80% 30 44.30 70% 40 38.56 50 35.24 Average Precision 60% 60 30.80 50% 70 24.88 80 18.84 40% 90 12.41 30% 100 4.22 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 34.44 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 51.20 UniNEbifr3 90% 10 docs 48.60 15 docs 46.27 80% 20 docs 44.60 70% 30 docs 39.67 100 docs 24.48 60% R−Precision 200 docs 16.07 50% 500 docs 7.98 1000 docs 4.39 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 35.85 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 251 to 275) queries 1 UniNEbifr3 Topic 251 15.53 Topic 276 26.30 Difference (average precision) Topic 252 6.77 Topic 277 48.59 0.5 Topic 253 33.11 Topic 278 23.32 Topic 254 68.12 Topic 279 8.41 Topic 255 1.22 Topic 280 14.85 0 Topic 256 83.23 Topic 281 48.85 Topic 257 14.70 Topic 282 3.24 −0.5 Topic 258 4.47 Topic 283 48.42 Topic 259 50.30 Topic 284 64.87 Topic 260 25.91 Topic 285 43.87 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.15 Topic 286 10.70 Topic Number Topic 262 4.84 Topic 287 53.46 Topic 263 40.96 Topic 288 10.13 CLEF 2005 AH−Bilingual−X2FR − Comparison to median by topic (topics 276 to 300) Topic 264 69.37 Topic 289 73.97 1 Topic 265 41.79 Topic 290 20.45 UniNEbifr3 Difference (average precision) Topic 266 0.66 Topic 291 6.62 0.5 Topic 267 47.03 Topic 292 5.54 Topic 268 54.49 Topic 293 76.59 Topic 269 20.60 Topic 294 68.42 0 Topic 270 62.02 Topic 295 50.97 Topic 271 70.71 Topic 296 25.27 Topic 272 18.01 Topic 297 41.95 −0.5 Topic 273 55.38 Topic 298 29.74 Topic 274 65.43 Topic 299 9.50 −1 Topic 275 33.54 Topic 300 19.68 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.187 jhu-apl aplbienhua AH-Bilingual-X2HU Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual English to Hungarian Retrieved 50,000 RunType= automatic Relevant 939 QueryType= TD Relevant retrieved 718 Pooled= true CLEF 2005 AH−Bilingual−X2HU − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 41.51 aplbienhua 90% 10 38.64 20 33.54 80% 30 29.86 70% 40 25.45 50 23.27 Average Precision 60% 60 19.43 50% 70 17.12 80 13.84 40% 90 11.13 30% 100 6.42 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 22.35 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2HU − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 25.60 aplbienhua 90% 10 docs 22.60 15 docs 21.33 80% 20 docs 20.10 70% 30 docs 17.60 100 docs 9.02 60% R−Precision 200 docs 5.41 50% 500 docs 2.51 1000 docs 1.44 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 22.78 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2HU − Comparison to median by topic (topics 251 to 275) queries 1 aplbienhua Topic 251 38.21 Topic 276 9.75 Difference (average precision) Topic 252 12.72 Topic 277 9.33 0.5 Topic 253 40.16 Topic 278 0.00 Topic 254 67.45 Topic 279 30.30 Topic 255 38.30 Topic 280 19.82 0 Topic 256 83.96 Topic 281 85.13 Topic 257 11.56 Topic 282 6.52 −0.5 Topic 258 0.00 Topic 283 0.06 Topic 259 31.13 Topic 284 0.15 Topic 260 0.00 Topic 285 0.00 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.00 Topic 286 2.59 Topic Number Topic 262 0.00 Topic 287 42.97 Topic 263 0.04 Topic 288 0.19 CLEF 2005 AH−Bilingual−X2HU − Comparison to median by topic (topics 276 to 300) Topic 264 11.52 Topic 289 100.00 1 Topic 265 3.03 Topic 290 65.51 aplbienhua Difference (average precision) Topic 266 5.05 Topic 291 55.29 0.5 Topic 267 3.80 Topic 292 50.21 Topic 268 5.40 Topic 293 60.59 Topic 269 0.27 Topic 294 7.52 0 Topic 270 0.01 Topic 295 12.77 Topic 271 30.05 Topic 296 11.57 Topic 272 7.69 Topic 297 64.40 −0.5 Topic 273 4.29 Topic 298 11.40 Topic 274 71.50 Topic 299 0.00 −1 Topic 275 1.56 Topic 300 3.66 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.188 jhu-apl aplbienhue AH-Bilingual-X2HU Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual English to Hungarian Retrieved 50,000 RunType= automatic Relevant 939 QueryType= TD Relevant retrieved 729 Pooled= false CLEF 2005 AH−Bilingual−X2HU − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 43.91 aplbienhue 90% 10 38.97 20 36.87 80% 30 32.23 70% 40 30.02 50 26.98 Average Precision 60% 60 20.98 50% 70 18.77 80 15.58 40% 90 11.52 30% 100 6.49 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 24.58 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2HU − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 30.80 aplbienhue 90% 10 docs 26.20 15 docs 22.53 80% 20 docs 20.50 70% 30 docs 18.13 100 docs 9.44 60% R−Precision 200 docs 5.50 50% 500 docs 2.67 1000 docs 1.46 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 24.37 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2HU − Comparison to median by topic (topics 251 to 275) queries 1 aplbienhue Topic 251 29.07 Topic 276 14.57 Difference (average precision) Topic 252 38.29 Topic 277 17.19 0.5 Topic 253 45.22 Topic 278 0.00 Topic 254 65.21 Topic 279 78.56 Topic 255 10.79 Topic 280 33.75 0 Topic 256 83.34 Topic 281 93.57 Topic 257 6.87 Topic 282 21.91 −0.5 Topic 258 0.00 Topic 283 0.02 Topic 259 42.52 Topic 284 0.09 Topic 260 0.02 Topic 285 0.00 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.00 Topic 286 2.31 Topic Number Topic 262 3.72 Topic 287 57.52 Topic 263 0.59 Topic 288 0.04 CLEF 2005 AH−Bilingual−X2HU − Comparison to median by topic (topics 276 to 300) Topic 264 21.52 Topic 289 98.61 1 Topic 265 6.15 Topic 290 68.09 aplbienhue Difference (average precision) Topic 266 7.00 Topic 291 57.75 0.5 Topic 267 7.89 Topic 292 50.33 Topic 268 3.69 Topic 293 76.75 Topic 269 0.26 Topic 294 7.85 0 Topic 270 0.00 Topic 295 12.15 Topic 271 14.84 Topic 296 2.62 Topic 272 7.69 Topic 297 65.58 −0.5 Topic 273 0.48 Topic 298 12.99 Topic 274 57.32 Topic 299 0.00 −1 Topic 275 0.64 Topic 300 3.59 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.189 miracle ENMST AH-Bilingual-X2HU Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual English to Hungarian Retrieved 50,000 RunType= automatic Relevant 939 QueryType= TD Relevant retrieved 752 Pooled= false CLEF 2005 AH−Bilingual−X2HU − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 64.23 ENMST 90% 10 55.76 20 48.18 80% 30 40.29 70% 40 32.54 50 28.90 Average Precision 60% 60 23.66 50% 70 20.37 80 17.22 40% 90 12.91 30% 100 8.67 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 30.16 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2HU − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 36.80 ENMST 90% 10 docs 30.20 15 docs 27.33 80% 20 docs 25.20 70% 30 docs 20.47 100 docs 9.84 60% R−Precision 200 docs 5.87 50% 500 docs 2.74 1000 docs 1.50 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 28.61 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2HU − Comparison to median by topic (topics 251 to 275) queries 1 ENMST Topic 251 5.16 Topic 276 17.78 Difference (average precision) Topic 252 23.18 Topic 277 7.37 0.5 Topic 253 43.75 Topic 278 36.80 Topic 254 44.98 Topic 279 6.55 Topic 255 29.38 Topic 280 5.15 0 Topic 256 73.46 Topic 281 96.45 Topic 257 7.72 Topic 282 9.02 −0.5 Topic 258 0.29 Topic 283 53.57 Topic 259 25.49 Topic 284 23.11 Topic 260 0.00 Topic 285 46.73 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 40.74 Topic 286 4.36 Topic Number Topic 262 3.05 Topic 287 67.19 Topic 263 0.66 Topic 288 9.63 CLEF 2005 AH−Bilingual−X2HU − Comparison to median by topic (topics 276 to 300) Topic 264 40.36 Topic 289 94.72 1 Topic 265 12.41 Topic 290 32.28 ENMST Difference (average precision) Topic 266 16.76 Topic 291 57.25 0.5 Topic 267 41.96 Topic 292 51.82 Topic 268 25.91 Topic 293 84.17 Topic 269 4.40 Topic 294 95.00 0 Topic 270 26.33 Topic 295 14.64 Topic 271 31.35 Topic 296 6.55 Topic 272 33.33 Topic 297 22.27 −0.5 Topic 273 18.85 Topic 298 1.33 Topic 274 7.67 Topic 299 30.23 −1 Topic 275 75.00 Topic 300 1.89 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.190 miracle ENMxNP01ST1 AH-Bilingual-X2HU Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual English to Hungarian Retrieved 50,000 RunType= automatic Relevant 939 QueryType= TD Relevant retrieved 752 Pooled= true CLEF 2005 AH−Bilingual−X2HU − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 61.04 ENMxNP01ST1 90% 10 53.05 20 45.47 80% 30 40.97 70% 40 32.50 50 29.09 Average Precision 60% 60 24.13 50% 70 20.66 80 17.69 40% 90 13.39 30% 100 9.08 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 29.77 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2HU − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 37.20 ENMxNP01ST1 90% 10 docs 30.80 15 docs 27.73 80% 20 docs 25.30 70% 30 docs 20.53 100 docs 9.86 60% R−Precision 200 docs 5.88 50% 500 docs 2.74 1000 docs 1.50 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 28.12 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2HU − Comparison to median by topic (topics 251 to 275) queries 1 ENMxNP01ST1 Topic 251 5.16 Topic 276 18.00 Difference (average precision) Topic 252 23.18 Topic 277 7.80 0.5 Topic 253 44.49 Topic 278 38.81 Topic 254 47.52 Topic 279 6.54 Topic 255 29.38 Topic 280 5.15 0 Topic 256 73.46 Topic 281 96.11 Topic 257 7.72 Topic 282 9.02 −0.5 Topic 258 0.29 Topic 283 53.57 Topic 259 3.27 Topic 284 23.11 Topic 260 0.00 Topic 285 50.70 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 40.74 Topic 286 4.36 Topic Number Topic 262 3.01 Topic 287 66.25 Topic 263 0.66 Topic 288 9.77 CLEF 2005 AH−Bilingual−X2HU − Comparison to median by topic (topics 276 to 300) Topic 264 40.36 Topic 289 94.72 1 Topic 265 14.14 Topic 290 32.27 ENMxNP01ST1 Difference (average precision) Topic 266 17.41 Topic 291 55.18 0.5 Topic 267 45.94 Topic 292 51.85 Topic 268 25.91 Topic 293 84.17 Topic 269 4.31 Topic 294 95.00 0 Topic 270 27.51 Topic 295 15.07 Topic 271 32.06 Topic 296 6.68 Topic 272 33.33 Topic 297 22.26 −0.5 Topic 273 20.24 Topic 298 1.33 Topic 274 7.67 Topic 299 8.01 −1 Topic 275 83.33 Topic 300 1.88 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.191 unine UniNEbihu1 AH-Bilingual-X2HU Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual English to Hungarian Retrieved 50,000 RunType= automatic Relevant 939 QueryType= TD Relevant retrieved 807 Pooled= true CLEF 2005 AH−Bilingual−X2HU − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 53.91 UniNEbihu1 90% 10 46.67 20 42.09 80% 30 37.43 70% 40 31.94 50 29.52 Average Precision 60% 60 24.41 50% 70 21.44 80 16.19 40% 90 11.93 30% 100 7.22 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 27.86 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2HU − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 30.00 UniNEbihu1 90% 10 docs 29.40 15 docs 24.40 80% 20 docs 22.60 70% 30 docs 20.40 100 docs 10.64 60% R−Precision 200 docs 6.37 50% 500 docs 2.98 1000 docs 1.61 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 26.79 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2HU − Comparison to median by topic (topics 251 to 275) queries 1 UniNEbihu1 Topic 251 12.20 Topic 276 26.39 Difference (average precision) Topic 252 17.25 Topic 277 44.92 0.5 Topic 253 36.26 Topic 278 0.01 Topic 254 45.67 Topic 279 73.27 Topic 255 39.24 Topic 280 5.62 0 Topic 256 81.37 Topic 281 95.60 Topic 257 21.98 Topic 282 2.10 −0.5 Topic 258 0.04 Topic 283 28.89 Topic 259 1.19 Topic 284 0.68 Topic 260 7.89 Topic 285 0.12 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.57 Topic 286 2.39 Topic Number Topic 262 0.50 Topic 287 73.23 Topic 263 18.94 Topic 288 5.70 CLEF 2005 AH−Bilingual−X2HU − Comparison to median by topic (topics 276 to 300) Topic 264 12.54 Topic 289 100.00 1 Topic 265 39.02 Topic 290 61.46 UniNEbihu1 Difference (average precision) Topic 266 19.21 Topic 291 66.81 0.5 Topic 267 57.53 Topic 292 51.01 Topic 268 51.79 Topic 293 23.65 Topic 269 0.85 Topic 294 43.94 0 Topic 270 33.53 Topic 295 0.61 Topic 271 25.34 Topic 296 33.79 Topic 272 16.67 Topic 297 59.58 −0.5 Topic 273 7.34 Topic 298 0.37 Topic 274 18.36 Topic 299 0.00 −1 Topic 275 17.50 Topic 300 9.99 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.192 unine UniNEbihu2 AH-Bilingual-X2HU Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual English to Hungarian Retrieved 50,000 RunType= automatic Relevant 939 QueryType= TD Relevant retrieved 793 Pooled= false CLEF 2005 AH−Bilingual−X2HU − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 45.47 UniNEbihu2 90% 10 40.71 20 33.60 80% 30 32.47 70% 40 25.28 50 23.78 Average Precision 60% 60 20.09 50% 70 17.49 80 14.00 40% 90 10.82 30% 100 7.23 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 23.15 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2HU − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 28.80 UniNEbihu2 90% 10 docs 24.20 15 docs 22.00 80% 20 docs 20.80 70% 30 docs 17.07 100 docs 10.26 60% R−Precision 200 docs 6.23 50% 500 docs 2.95 1000 docs 1.59 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 22.01 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2HU − Comparison to median by topic (topics 251 to 275) queries 1 UniNEbihu2 Topic 251 9.77 Topic 276 25.48 Difference (average precision) Topic 252 16.75 Topic 277 16.68 0.5 Topic 253 46.60 Topic 278 0.07 Topic 254 56.19 Topic 279 8.07 Topic 255 34.26 Topic 280 7.46 0 Topic 256 81.04 Topic 281 93.40 Topic 257 25.88 Topic 282 1.91 −0.5 Topic 258 0.09 Topic 283 57.76 Topic 259 0.65 Topic 284 0.00 Topic 260 2.16 Topic 285 0.00 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 1.04 Topic 286 2.06 Topic Number Topic 262 6.30 Topic 287 74.38 Topic 263 16.09 Topic 288 9.02 CLEF 2005 AH−Bilingual−X2HU − Comparison to median by topic (topics 276 to 300) Topic 264 6.53 Topic 289 97.05 1 Topic 265 3.56 Topic 290 48.23 UniNEbihu2 Difference (average precision) Topic 266 24.21 Topic 291 67.58 0.5 Topic 267 34.17 Topic 292 51.01 Topic 268 19.59 Topic 293 13.92 Topic 269 1.74 Topic 294 11.63 0 Topic 270 36.66 Topic 295 0.05 Topic 271 20.65 Topic 296 29.94 Topic 272 14.29 Topic 297 49.82 −0.5 Topic 273 12.01 Topic 298 0.25 Topic 274 10.02 Topic 299 0.00 −1 Topic 275 5.22 Topic 300 6.32 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.193 unine UniNEbihu3 AH-Bilingual-X2HU Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual English to Hungarian Retrieved 50,000 RunType= automatic Relevant 939 QueryType= TD Relevant retrieved 811 Pooled= false CLEF 2005 AH−Bilingual−X2HU − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 53.81 UniNEbihu3 90% 10 48.01 20 42.83 80% 30 38.11 70% 40 34.08 50 31.16 Average Precision 60% 60 25.54 50% 70 22.66 80 17.86 40% 90 13.20 30% 100 8.53 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 28.82 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2HU − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 31.20 UniNEbihu3 90% 10 docs 29.60 15 docs 26.40 80% 20 docs 24.10 70% 30 docs 21.20 100 docs 10.90 60% R−Precision 200 docs 6.48 50% 500 docs 3.01 1000 docs 1.62 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 27.89 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2HU − Comparison to median by topic (topics 251 to 275) queries 1 UniNEbihu3 Topic 251 12.86 Topic 276 22.81 Difference (average precision) Topic 252 18.75 Topic 277 53.46 0.5 Topic 253 42.02 Topic 278 0.01 Topic 254 47.28 Topic 279 63.86 Topic 255 51.81 Topic 280 6.29 0 Topic 256 80.68 Topic 281 96.72 Topic 257 21.77 Topic 282 1.48 −0.5 Topic 258 0.03 Topic 283 33.44 Topic 259 1.31 Topic 284 1.47 Topic 260 10.85 Topic 285 0.11 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.35 Topic 286 2.88 Topic Number Topic 262 0.24 Topic 287 72.02 Topic 263 23.48 Topic 288 0.98 CLEF 2005 AH−Bilingual−X2HU − Comparison to median by topic (topics 276 to 300) Topic 264 12.58 Topic 289 100.00 1 Topic 265 39.55 Topic 290 69.49 UniNEbihu3 Difference (average precision) Topic 266 19.23 Topic 291 66.29 0.5 Topic 267 55.17 Topic 292 51.22 Topic 268 52.79 Topic 293 49.14 Topic 269 0.73 Topic 294 44.28 0 Topic 270 29.57 Topic 295 1.55 Topic 271 20.72 Topic 296 29.88 Topic 272 14.29 Topic 297 59.87 −0.5 Topic 273 8.10 Topic 298 0.28 Topic 274 23.98 Topic 299 0.03 −1 Topic 275 17.83 Topic 300 7.54 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.194 alicante IRn-enpt-fexp AH-Bilingual-X2PT Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual English to Portuguese Retrieved 50,000 RunType= automatic Relevant 2,904 QueryType= TD Relevant retrieved 2,264 Pooled= false CLEF 2005 AH−Bilingual−X2PT − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 67.10 IRn−enpt−fexp 90% 10 54.43 20 46.33 80% 30 40.30 70% 40 33.39 50 28.47 Average Precision 60% 60 22.38 50% 70 17.55 80 13.32 40% 90 7.59 30% 100 3.91 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 28.94 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2PT − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 49.20 IRn−enpt−fexp 90% 10 docs 47.60 15 docs 45.07 80% 20 docs 41.30 70% 30 docs 37.20 100 docs 22.54 60% R−Precision 200 docs 15.23 50% 500 docs 8.01 1000 docs 4.53 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 31.08 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 251 to 275) queries 1 IRn−enpt−fexp Topic 251 48.15 Topic 276 28.73 Difference (average precision) Topic 252 1.55 Topic 277 3.94 0.5 Topic 253 29.99 Topic 278 7.73 Topic 254 61.30 Topic 279 44.05 Topic 255 39.23 Topic 280 4.90 0 Topic 256 95.33 Topic 281 64.96 Topic 257 13.22 Topic 282 14.84 −0.5 Topic 258 1.04 Topic 283 29.67 Topic 259 53.47 Topic 284 15.37 Topic 260 47.51 Topic 285 30.86 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.02 Topic 286 2.62 Topic Number Topic 262 0.96 Topic 287 42.49 Topic 263 10.71 Topic 288 1.25 CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 276 to 300) Topic 264 45.63 Topic 289 38.85 1 Topic 265 14.68 Topic 290 13.47 IRn−enpt−fexp Difference (average precision) Topic 266 26.53 Topic 291 25.41 0.5 Topic 267 14.84 Topic 292 8.95 Topic 268 22.27 Topic 293 70.70 Topic 269 11.64 Topic 294 63.41 0 Topic 270 32.66 Topic 295 31.39 Topic 271 53.08 Topic 296 39.32 Topic 272 21.62 Topic 297 41.50 −0.5 Topic 273 44.66 Topic 298 59.17 Topic 274 4.17 Topic 299 36.33 −1 Topic 275 15.47 Topic 300 17.30 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.195 alicante IRn-enpt-fexpfl AH-Bilingual-X2PT Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual English to Portuguese Retrieved 50,000 RunType= automatic Relevant 2,904 QueryType= TD Relevant retrieved 2,196 Pooled= true CLEF 2005 AH−Bilingual−X2PT − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 64.06 IRn−enpt−fexpfl 90% 10 51.36 20 43.33 80% 30 36.86 70% 40 31.16 50 26.86 Average Precision 60% 60 22.21 50% 70 16.82 80 12.82 40% 90 7.74 30% 100 3.60 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 27.27 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2PT − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 46.80 IRn−enpt−fexpfl 90% 10 docs 45.20 15 docs 41.87 80% 20 docs 39.40 70% 30 docs 35.20 100 docs 21.82 60% R−Precision 200 docs 14.64 50% 500 docs 7.74 1000 docs 4.39 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 30.25 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 251 to 275) queries 1 IRn−enpt−fexpfl Topic 251 40.53 Topic 276 28.46 Difference (average precision) Topic 252 0.99 Topic 277 1.57 0.5 Topic 253 19.54 Topic 278 3.40 Topic 254 65.06 Topic 279 44.45 Topic 255 2.65 Topic 280 7.85 0 Topic 256 96.63 Topic 281 60.52 Topic 257 10.12 Topic 282 13.63 −0.5 Topic 258 0.43 Topic 283 29.63 Topic 259 49.32 Topic 284 13.73 Topic 260 56.75 Topic 285 31.43 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.01 Topic 286 1.58 Topic Number Topic 262 0.64 Topic 287 43.51 Topic 263 7.31 Topic 288 1.26 CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 276 to 300) Topic 264 46.59 Topic 289 40.83 1 Topic 265 8.51 Topic 290 9.42 IRn−enpt−fexpfl Difference (average precision) Topic 266 18.47 Topic 291 22.22 0.5 Topic 267 14.89 Topic 292 11.57 Topic 268 13.59 Topic 293 73.15 Topic 269 13.94 Topic 294 57.11 0 Topic 270 30.81 Topic 295 28.29 Topic 271 51.44 Topic 296 41.93 Topic 272 18.29 Topic 297 44.42 −0.5 Topic 273 52.59 Topic 298 55.63 Topic 274 3.38 Topic 299 30.46 −1 Topic 275 16.74 Topic 300 28.44 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.196 alicante IRn-enpt-vexp AH-Bilingual-X2PT Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual English to Portuguese Retrieved 50,000 RunType= automatic Relevant 2,904 QueryType= TD Relevant retrieved 2,303 Pooled= false CLEF 2005 AH−Bilingual−X2PT − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 67.68 IRn−enpt−vexp 90% 10 54.14 20 46.62 80% 30 39.60 70% 40 33.26 50 28.92 Average Precision 60% 60 23.65 50% 70 18.50 80 14.48 40% 90 8.52 30% 100 3.48 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 29.18 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2PT − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 46.80 IRn−enpt−vexp 90% 10 docs 46.80 15 docs 44.27 80% 20 docs 42.10 70% 30 docs 37.80 100 docs 22.80 60% R−Precision 200 docs 15.46 50% 500 docs 7.93 1000 docs 4.61 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 31.38 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 251 to 275) queries 1 IRn−enpt−vexp Topic 251 53.04 Topic 276 27.14 Difference (average precision) Topic 252 1.68 Topic 277 3.48 0.5 Topic 253 35.99 Topic 278 13.03 Topic 254 60.65 Topic 279 44.30 Topic 255 25.74 Topic 280 3.74 0 Topic 256 94.44 Topic 281 62.38 Topic 257 14.49 Topic 282 14.93 −0.5 Topic 258 1.56 Topic 283 32.12 Topic 259 49.67 Topic 284 16.57 Topic 260 43.77 Topic 285 33.55 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.02 Topic 286 2.02 Topic Number Topic 262 0.83 Topic 287 35.41 Topic 263 9.86 Topic 288 1.54 CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 276 to 300) Topic 264 48.65 Topic 289 40.74 1 Topic 265 17.74 Topic 290 14.24 IRn−enpt−vexp Difference (average precision) Topic 266 28.23 Topic 291 25.59 0.5 Topic 267 18.04 Topic 292 7.10 Topic 268 20.74 Topic 293 71.27 Topic 269 11.63 Topic 294 64.72 0 Topic 270 35.54 Topic 295 33.73 Topic 271 54.32 Topic 296 41.65 Topic 272 21.03 Topic 297 45.51 −0.5 Topic 273 39.19 Topic 298 62.38 Topic 274 5.49 Topic 299 36.21 −1 Topic 275 19.84 Topic 300 13.57 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.197 alicante IRn-enpt-vnexp AH-Bilingual-X2PT Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual English to Portuguese Retrieved 50,000 RunType= automatic Relevant 2,904 QueryType= TD Relevant retrieved 2,083 Pooled= false CLEF 2005 AH−Bilingual−X2PT − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 72.14 IRn−enpt−vnexp 90% 10 54.19 20 40.73 80% 30 33.01 70% 40 27.63 50 22.89 Average Precision 60% 60 17.69 50% 70 14.13 80 9.79 40% 90 6.15 30% 100 3.46 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 25.22 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2PT − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 48.40 IRn−enpt−vnexp 90% 10 docs 45.40 15 docs 40.40 80% 20 docs 38.00 70% 30 docs 33.20 100 docs 19.78 60% R−Precision 200 docs 13.34 50% 500 docs 7.12 1000 docs 4.17 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 27.58 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 251 to 275) queries 1 IRn−enpt−vnexp Topic 251 48.71 Topic 276 19.89 Difference (average precision) Topic 252 1.76 Topic 277 2.02 0.5 Topic 253 23.53 Topic 278 12.34 Topic 254 30.97 Topic 279 30.66 Topic 255 45.63 Topic 280 4.82 0 Topic 256 93.69 Topic 281 60.40 Topic 257 14.18 Topic 282 16.40 −0.5 Topic 258 2.38 Topic 283 28.81 Topic 259 41.22 Topic 284 7.24 Topic 260 17.67 Topic 285 28.04 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.06 Topic 286 1.43 Topic Number Topic 262 4.56 Topic 287 27.54 Topic 263 8.43 Topic 288 2.12 CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 276 to 300) Topic 264 35.82 Topic 289 38.84 1 Topic 265 11.67 Topic 290 11.75 IRn−enpt−vnexp Difference (average precision) Topic 266 26.74 Topic 291 23.34 0.5 Topic 267 17.31 Topic 292 7.94 Topic 268 11.66 Topic 293 68.44 Topic 269 10.10 Topic 294 68.18 0 Topic 270 26.54 Topic 295 25.52 Topic 271 48.53 Topic 296 38.82 Topic 272 32.70 Topic 297 38.73 −0.5 Topic 273 29.08 Topic 298 43.44 Topic 274 28.21 Topic 299 26.89 −1 Topic 275 9.47 Topic 300 6.58 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.198 buffalo UBbi-en-pt-comb1 AH-Bilingual-X2PT Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual English to Portuguese Retrieved 50,000 RunType= automatic Relevant 2,904 QueryType= TD Relevant retrieved 1,526 Pooled= true CLEF 2005 AH−Bilingual−X2PT − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 43.19 UBbi−en−pt−comb1 90% 10 33.71 20 27.23 80% 30 21.37 70% 40 18.29 50 14.90 Average Precision 60% 60 11.17 50% 70 8.37 80 5.61 40% 90 3.10 30% 100 0.09 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 15.72 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2PT − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 30.40 UBbi−en−pt−comb1 90% 10 docs 29.20 15 docs 27.07 80% 20 docs 26.00 70% 30 docs 23.60 100 docs 14.78 60% R−Precision 200 docs 9.94 50% 500 docs 5.15 1000 docs 3.05 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 20.24 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 251 to 275) queries 1 UBbi−en−pt−comb1 Topic 251 21.65 Topic 276 14.47 Difference (average precision) Topic 252 3.03 Topic 277 0.03 0.5 Topic 253 1.59 Topic 278 0.20 Topic 254 39.53 Topic 279 3.89 Topic 255 1.71 Topic 280 12.48 0 Topic 256 82.57 Topic 281 46.95 Topic 257 14.16 Topic 282 18.91 −0.5 Topic 258 0.23 Topic 283 45.20 Topic 259 25.97 Topic 284 2.86 Topic 260 46.27 Topic 285 0.64 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.00 Topic 286 0.03 Topic Number Topic 262 0.04 Topic 287 15.26 Topic 263 1.32 Topic 288 1.46 CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 276 to 300) Topic 264 11.82 Topic 289 2.78 1 Topic 265 17.84 Topic 290 0.52 UBbi−en−pt−comb1 Difference (average precision) Topic 266 44.96 Topic 291 5.96 0.5 Topic 267 1.97 Topic 292 4.09 Topic 268 12.92 Topic 293 36.81 Topic 269 1.12 Topic 294 53.81 0 Topic 270 23.70 Topic 295 11.04 Topic 271 10.57 Topic 296 27.48 Topic 272 26.91 Topic 297 4.99 −0.5 Topic 273 23.49 Topic 298 22.57 Topic 274 9.39 Topic 299 0.40 −1 Topic 275 26.84 Topic 300 3.54 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.199 buffalo UBbi-en-pt-comb2 AH-Bilingual-X2PT Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual English to Portuguese Retrieved 50,000 RunType= automatic Relevant 2,904 QueryType= TD Relevant retrieved 1,546 Pooled= false CLEF 2005 AH−Bilingual−X2PT − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 53.09 UBbi−en−pt−comb2 90% 10 38.34 20 29.56 80% 30 23.40 70% 40 19.66 50 15.80 Average Precision 60% 60 11.78 50% 70 9.66 80 6.89 40% 90 4.03 30% 100 2.31 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 17.87 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2PT − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 35.60 UBbi−en−pt−comb2 90% 10 docs 33.00 15 docs 29.60 80% 20 docs 27.80 70% 30 docs 24.33 100 docs 15.12 60% R−Precision 200 docs 10.10 50% 500 docs 5.17 1000 docs 3.09 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 21.88 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 251 to 275) queries 1 UBbi−en−pt−comb2 Topic 251 24.94 Topic 276 12.42 Difference (average precision) Topic 252 3.55 Topic 277 0.02 0.5 Topic 253 1.76 Topic 278 0.18 Topic 254 42.27 Topic 279 3.75 Topic 255 19.06 Topic 280 10.54 0 Topic 256 94.68 Topic 281 52.22 Topic 257 14.65 Topic 282 17.83 −0.5 Topic 258 0.22 Topic 283 52.84 Topic 259 39.15 Topic 284 2.47 Topic 260 46.10 Topic 285 0.79 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.00 Topic 286 0.05 Topic Number Topic 262 0.05 Topic 287 16.11 Topic 263 1.07 Topic 288 1.39 CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 276 to 300) Topic 264 11.00 Topic 289 11.11 1 Topic 265 22.00 Topic 290 0.45 UBbi−en−pt−comb2 Difference (average precision) Topic 266 48.36 Topic 291 6.79 0.5 Topic 267 1.49 Topic 292 5.93 Topic 268 8.94 Topic 293 40.72 Topic 269 1.32 Topic 294 57.46 0 Topic 270 21.79 Topic 295 12.51 Topic 271 16.26 Topic 296 36.67 Topic 272 24.86 Topic 297 5.12 −0.5 Topic 273 31.94 Topic 298 21.71 Topic 274 9.85 Topic 299 0.31 −1 Topic 275 33.83 Topic 300 5.03 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.200 buffalo UBbi-en-pt-t1 AH-Bilingual-X2PT Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual English to Portuguese Retrieved 50,000 RunType= automatic Relevant 2,904 QueryType= TD Relevant retrieved 1,545 Pooled= false CLEF 2005 AH−Bilingual−X2PT − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 54.96 UBbi−en−pt−t1 90% 10 40.33 20 29.37 80% 30 22.73 70% 40 19.18 50 15.44 Average Precision 60% 60 11.75 50% 70 9.29 80 6.27 40% 90 3.67 30% 100 1.90 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 17.86 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2PT − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 35.20 UBbi−en−pt−t1 90% 10 docs 32.20 15 docs 29.60 80% 20 docs 27.70 70% 30 docs 24.73 100 docs 15.14 60% R−Precision 200 docs 10.12 50% 500 docs 5.23 1000 docs 3.09 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 21.13 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 251 to 275) queries 1 UBbi−en−pt−t1 Topic 251 24.33 Topic 276 13.84 Difference (average precision) Topic 252 3.03 Topic 277 0.03 0.5 Topic 253 1.56 Topic 278 0.20 Topic 254 42.36 Topic 279 3.89 Topic 255 19.36 Topic 280 12.48 0 Topic 256 92.52 Topic 281 52.58 Topic 257 14.18 Topic 282 22.02 −0.5 Topic 258 0.23 Topic 283 50.95 Topic 259 35.32 Topic 284 2.43 Topic 260 48.41 Topic 285 0.64 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.00 Topic 286 0.03 Topic Number Topic 262 0.04 Topic 287 17.91 Topic 263 1.32 Topic 288 1.44 CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 276 to 300) Topic 264 11.82 Topic 289 16.67 1 Topic 265 17.94 Topic 290 0.51 UBbi−en−pt−t1 Difference (average precision) Topic 266 47.40 Topic 291 5.95 0.5 Topic 267 1.96 Topic 292 4.09 Topic 268 12.92 Topic 293 41.10 Topic 269 1.12 Topic 294 59.68 0 Topic 270 22.40 Topic 295 12.65 Topic 271 16.41 Topic 296 32.36 Topic 272 27.45 Topic 297 4.99 −0.5 Topic 273 28.80 Topic 298 20.99 Topic 274 6.46 Topic 299 0.40 −1 Topic 275 32.16 Topic 300 5.66 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.201 buffalo UBbi-en-pt-t2 AH-Bilingual-X2PT Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual English to Portuguese Retrieved 50,000 RunType= automatic Relevant 2,904 QueryType= TD Relevant retrieved 1,545 Pooled= false CLEF 2005 AH−Bilingual−X2PT − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 54.80 UBbi−en−pt−t2 90% 10 40.22 20 29.54 80% 30 22.73 70% 40 19.38 50 15.62 Average Precision 60% 60 11.68 50% 70 9.31 80 6.29 40% 90 3.76 30% 100 1.94 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 17.91 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2PT − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 35.60 UBbi−en−pt−t2 90% 10 docs 32.60 15 docs 29.47 80% 20 docs 27.80 70% 30 docs 24.87 100 docs 15.16 60% R−Precision 200 docs 10.13 50% 500 docs 5.22 1000 docs 3.09 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 21.49 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 251 to 275) queries 1 UBbi−en−pt−t2 Topic 251 24.34 Topic 276 13.76 Difference (average precision) Topic 252 3.03 Topic 277 0.03 0.5 Topic 253 1.59 Topic 278 0.20 Topic 254 42.37 Topic 279 3.89 Topic 255 19.45 Topic 280 12.48 0 Topic 256 92.52 Topic 281 52.60 Topic 257 14.16 Topic 282 22.02 −0.5 Topic 258 0.23 Topic 283 50.95 Topic 259 35.32 Topic 284 2.43 Topic 260 48.38 Topic 285 0.64 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.00 Topic 286 0.03 Topic Number Topic 262 0.04 Topic 287 17.90 Topic 263 1.32 Topic 288 1.45 CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 276 to 300) Topic 264 11.82 Topic 289 16.67 1 Topic 265 17.84 Topic 290 0.51 UBbi−en−pt−t2 Difference (average precision) Topic 266 47.36 Topic 291 5.96 0.5 Topic 267 1.97 Topic 292 4.09 Topic 268 12.92 Topic 293 41.10 Topic 269 1.12 Topic 294 59.66 0 Topic 270 22.41 Topic 295 12.66 Topic 271 16.41 Topic 296 32.32 Topic 272 26.91 Topic 297 4.99 −0.5 Topic 273 28.88 Topic 298 20.99 Topic 274 9.63 Topic 299 0.40 −1 Topic 275 32.17 Topic 300 5.66 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.202 jhu-apl aplbienptb AH-Bilingual-X2PT Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual English to Portuguese Retrieved 50,000 RunType= automatic Relevant 2,904 QueryType= TD Relevant retrieved 2,053 Pooled= true CLEF 2005 AH−Bilingual−X2PT − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 70.23 aplbienptb 90% 10 57.23 20 50.10 80% 30 43.10 70% 40 36.90 50 30.78 Average Precision 60% 60 24.67 50% 70 18.93 80 14.19 40% 90 8.64 30% 100 4.57 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 31.20 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2PT − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 53.20 aplbienptb 90% 10 docs 50.00 15 docs 45.60 80% 20 docs 42.30 70% 30 docs 38.33 100 docs 23.18 60% R−Precision 200 docs 14.87 50% 500 docs 7.18 1000 docs 4.11 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 33.96 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 251 to 275) queries 1 aplbienptb Topic 251 57.92 Topic 276 19.31 Difference (average precision) Topic 252 47.99 Topic 277 21.69 0.5 Topic 253 6.05 Topic 278 57.64 Topic 254 31.56 Topic 279 38.85 Topic 255 3.46 Topic 280 0.53 0 Topic 256 100.00 Topic 281 57.02 Topic 257 25.03 Topic 282 18.18 −0.5 Topic 258 1.92 Topic 283 67.58 Topic 259 5.08 Topic 284 26.50 Topic 260 47.43 Topic 285 42.37 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.00 Topic 286 0.92 Topic Number Topic 262 10.21 Topic 287 41.70 Topic 263 1.44 Topic 288 0.86 CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 276 to 300) Topic 264 61.04 Topic 289 47.24 1 Topic 265 31.48 Topic 290 56.91 aplbienptb Difference (average precision) Topic 266 11.00 Topic 291 37.96 0.5 Topic 267 13.13 Topic 292 12.27 Topic 268 55.48 Topic 293 62.58 Topic 269 10.32 Topic 294 34.89 0 Topic 270 26.89 Topic 295 26.75 Topic 271 48.59 Topic 296 43.77 Topic 272 13.38 Topic 297 35.49 −0.5 Topic 273 55.57 Topic 298 66.14 Topic 274 8.43 Topic 299 22.43 −1 Topic 275 46.44 Topic 300 0.73 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.203 jhu-apl aplbiesptb AH-Bilingual-X2PT Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual Spanish to Portuguese Retrieved 50,000 RunType= automatic Relevant 2,904 QueryType= TD Relevant retrieved 2,268 Pooled= false CLEF 2005 AH−Bilingual−X2PT − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 75.96 aplbiesptb 90% 10 59.86 20 49.77 80% 30 43.06 70% 40 36.85 50 30.50 Average Precision 60% 60 25.01 50% 70 20.10 80 15.45 40% 90 9.47 30% 100 4.55 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 31.85 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2PT − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 52.80 aplbiesptb 90% 10 docs 49.60 15 docs 46.27 80% 20 docs 42.90 70% 30 docs 37.93 100 docs 24.18 60% R−Precision 200 docs 16.02 50% 500 docs 8.10 1000 docs 4.54 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 34.11 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 251 to 275) queries 1 aplbiesptb Topic 251 44.36 Topic 276 7.34 Difference (average precision) Topic 252 29.91 Topic 277 29.47 0.5 Topic 253 3.86 Topic 278 29.56 Topic 254 50.79 Topic 279 43.51 Topic 255 1.45 Topic 280 12.92 0 Topic 256 100.00 Topic 281 68.55 Topic 257 25.88 Topic 282 22.11 −0.5 Topic 258 16.67 Topic 283 70.64 Topic 259 16.49 Topic 284 38.16 Topic 260 32.21 Topic 285 26.76 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 2.20 Topic 286 4.14 Topic Number Topic 262 12.14 Topic 287 34.12 Topic 263 10.49 Topic 288 0.95 CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 276 to 300) Topic 264 49.76 Topic 289 43.05 1 Topic 265 30.77 Topic 290 60.89 aplbiesptb Difference (average precision) Topic 266 13.42 Topic 291 24.49 0.5 Topic 267 23.35 Topic 292 20.03 Topic 268 49.39 Topic 293 60.02 Topic 269 10.32 Topic 294 50.50 0 Topic 270 20.44 Topic 295 45.37 Topic 271 46.87 Topic 296 41.56 Topic 272 11.36 Topic 297 55.44 −0.5 Topic 273 46.00 Topic 298 38.55 Topic 274 29.67 Topic 299 44.06 −1 Topic 275 31.20 Topic 300 11.50 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.204 miracle ENSSR AH-Bilingual-X2PT Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual English to Portuguese Retrieved 50,000 RunType= automatic Relevant 2,904 QueryType= TDN Relevant retrieved 1,660 Pooled= false CLEF 2005 AH−Bilingual−X2PT − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 58.12 ENSSR 90% 10 45.62 20 34.94 80% 30 26.54 70% 40 20.85 50 17.06 Average Precision 60% 60 14.05 50% 70 11.61 80 8.24 40% 90 5.30 30% 100 2.47 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 20.62 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2PT − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 39.60 ENSSR 90% 10 docs 35.40 15 docs 31.73 80% 20 docs 30.10 70% 30 docs 27.07 100 docs 16.74 60% R−Precision 200 docs 10.94 50% 500 docs 5.82 1000 docs 3.32 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 23.31 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 251 to 275) queries 1 ENSSR Topic 251 24.52 Topic 276 22.02 Difference (average precision) Topic 252 2.33 Topic 277 0.03 0.5 Topic 253 3.16 Topic 278 1.52 Topic 254 42.34 Topic 279 0.05 Topic 255 34.85 Topic 280 17.28 0 Topic 256 93.06 Topic 281 71.56 Topic 257 19.49 Topic 282 15.29 −0.5 Topic 258 0.16 Topic 283 49.05 Topic 259 36.42 Topic 284 4.89 Topic 260 29.50 Topic 285 1.67 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.01 Topic 286 0.01 Topic Number Topic 262 0.41 Topic 287 27.50 Topic 263 0.79 Topic 288 5.88 CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 276 to 300) Topic 264 13.19 Topic 289 22.22 1 Topic 265 23.67 Topic 290 0.94 ENSSR Difference (average precision) Topic 266 50.11 Topic 291 5.76 0.5 Topic 267 2.96 Topic 292 5.58 Topic 268 17.25 Topic 293 40.69 Topic 269 5.28 Topic 294 68.72 0 Topic 270 29.32 Topic 295 24.09 Topic 271 16.77 Topic 296 48.05 Topic 272 33.48 Topic 297 2.63 −0.5 Topic 273 28.77 Topic 298 15.94 Topic 274 9.65 Topic 299 14.66 −1 Topic 275 45.41 Topic 300 2.00 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.205 miracle ENSST AH-Bilingual-X2PT Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual English to Portuguese Retrieved 50,000 RunType= automatic Relevant 2,904 QueryType= TD Relevant retrieved 1,505 Pooled= false CLEF 2005 AH−Bilingual−X2PT − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 55.21 ENSST 90% 10 43.85 20 33.42 80% 30 26.75 70% 40 20.57 50 17.45 Average Precision 60% 60 14.34 50% 70 12.27 80 9.32 40% 90 6.28 30% 100 3.29 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 20.36 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2PT − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 37.20 ENSST 90% 10 docs 33.60 15 docs 30.40 80% 20 docs 28.90 70% 30 docs 26.07 100 docs 15.94 60% R−Precision 200 docs 10.42 50% 500 docs 5.30 1000 docs 3.01 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 23.16 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 251 to 275) queries 1 ENSST Topic 251 28.86 Topic 276 19.92 Difference (average precision) Topic 252 3.77 Topic 277 0.01 0.5 Topic 253 1.02 Topic 278 1.34 Topic 254 38.89 Topic 279 1.07 Topic 255 36.13 Topic 280 25.02 0 Topic 256 97.55 Topic 281 67.15 Topic 257 14.07 Topic 282 13.72 −0.5 Topic 258 0.22 Topic 283 58.05 Topic 259 38.43 Topic 284 2.60 Topic 260 54.26 Topic 285 0.81 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.00 Topic 286 0.03 Topic Number Topic 262 0.13 Topic 287 20.22 Topic 263 0.36 Topic 288 2.76 CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 276 to 300) Topic 264 11.67 Topic 289 18.52 1 Topic 265 25.76 Topic 290 0.62 ENSST Difference (average precision) Topic 266 47.84 Topic 291 6.22 0.5 Topic 267 2.46 Topic 292 5.12 Topic 268 16.08 Topic 293 38.96 Topic 269 0.77 Topic 294 69.06 0 Topic 270 27.96 Topic 295 13.84 Topic 271 17.93 Topic 296 45.71 Topic 272 36.56 Topic 297 3.26 −0.5 Topic 273 33.31 Topic 298 13.62 Topic 274 14.52 Topic 299 0.40 −1 Topic 275 39.43 Topic 300 1.95 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.206 miracle ENSxNP01SR1 AH-Bilingual-X2PT Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual English to Portuguese Retrieved 50,000 RunType= automatic Relevant 2,904 QueryType= TDN Relevant retrieved 1,660 Pooled= true CLEF 2005 AH−Bilingual−X2PT − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 59.00 ENSxNP01SR1 90% 10 44.39 20 34.59 80% 30 26.45 70% 40 20.71 50 17.00 Average Precision 60% 60 13.79 50% 70 11.57 80 8.24 40% 90 5.18 30% 100 2.24 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 20.39 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2PT − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 39.60 ENSxNP01SR1 90% 10 docs 35.00 15 docs 31.47 80% 20 docs 29.90 70% 30 docs 27.07 100 docs 16.68 60% R−Precision 200 docs 10.89 50% 500 docs 5.81 1000 docs 3.32 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 23.11 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 251 to 275) queries 1 ENSxNP01SR1 Topic 251 24.52 Topic 276 22.02 Difference (average precision) Topic 252 2.34 Topic 277 0.03 0.5 Topic 253 3.16 Topic 278 1.52 Topic 254 41.46 Topic 279 0.05 Topic 255 34.85 Topic 280 17.35 0 Topic 256 93.06 Topic 281 71.57 Topic 257 19.75 Topic 282 15.32 −0.5 Topic 258 0.16 Topic 283 47.13 Topic 259 28.06 Topic 284 4.97 Topic 260 29.15 Topic 285 1.68 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.01 Topic 286 0.01 Topic Number Topic 262 0.42 Topic 287 27.59 Topic 263 0.79 Topic 288 5.89 CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 276 to 300) Topic 264 13.19 Topic 289 22.22 1 Topic 265 23.67 Topic 290 1.20 ENSxNP01SR1 Difference (average precision) Topic 266 50.13 Topic 291 5.80 0.5 Topic 267 2.98 Topic 292 5.89 Topic 268 17.28 Topic 293 40.69 Topic 269 5.33 Topic 294 68.84 0 Topic 270 33.03 Topic 295 23.88 Topic 271 13.54 Topic 296 46.48 Topic 272 34.16 Topic 297 2.63 −0.5 Topic 273 27.91 Topic 298 15.94 Topic 274 9.67 Topic 299 14.66 −1 Topic 275 45.41 Topic 300 2.00 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.207 miracle ESASR AH-Bilingual-X2PT Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual Spanish to Portuguese Retrieved 50,000 RunType= automatic Relevant 2,904 QueryType= TDN Relevant retrieved 2,367 Pooled= false CLEF 2005 AH−Bilingual−X2PT − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 78.59 ESASR 90% 10 63.77 20 54.32 80% 30 45.07 70% 40 36.65 50 31.44 Average Precision 60% 60 25.62 50% 70 20.54 80 14.36 40% 90 7.94 30% 100 3.90 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 32.87 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2PT − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 54.40 ESASR 90% 10 docs 50.40 15 docs 47.47 80% 20 docs 45.50 70% 30 docs 40.93 100 docs 25.44 60% R−Precision 200 docs 16.67 50% 500 docs 8.54 1000 docs 4.73 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 34.74 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 251 to 275) queries 1 ESASR Topic 251 46.84 Topic 276 8.92 Difference (average precision) Topic 252 4.62 Topic 277 19.57 0.5 Topic 253 32.16 Topic 278 1.34 Topic 254 43.41 Topic 279 25.21 Topic 255 35.70 Topic 280 16.45 0 Topic 256 92.28 Topic 281 71.36 Topic 257 20.13 Topic 282 19.57 −0.5 Topic 258 3.85 Topic 283 58.68 Topic 259 41.70 Topic 284 14.02 Topic 260 10.19 Topic 285 35.99 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 27.72 Topic 286 26.93 Topic Number Topic 262 0.56 Topic 287 34.56 Topic 263 20.78 Topic 288 16.25 CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 276 to 300) Topic 264 32.36 Topic 289 36.56 1 Topic 265 26.98 Topic 290 38.03 ESASR Difference (average precision) Topic 266 49.65 Topic 291 24.86 0.5 Topic 267 26.55 Topic 292 31.23 Topic 268 49.02 Topic 293 62.60 Topic 269 13.43 Topic 294 57.65 0 Topic 270 27.81 Topic 295 54.59 Topic 271 60.24 Topic 296 56.26 Topic 272 30.20 Topic 297 42.78 −0.5 Topic 273 34.31 Topic 298 17.33 Topic 274 21.11 Topic 299 31.86 −1 Topic 275 48.33 Topic 300 41.14 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.208 miracle ESAST AH-Bilingual-X2PT Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual Spanish to Portuguese Retrieved 50,000 RunType= automatic Relevant 2,904 QueryType= TD Relevant retrieved 2,329 Pooled= false CLEF 2005 AH−Bilingual−X2PT − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 73.65 ESAST 90% 10 60.89 20 50.23 80% 30 40.65 70% 40 35.88 50 29.71 Average Precision 60% 60 23.67 50% 70 18.83 80 13.86 40% 90 7.63 30% 100 3.33 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 31.06 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2PT − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 52.00 ESAST 90% 10 docs 48.00 15 docs 44.67 80% 20 docs 42.90 70% 30 docs 39.40 100 docs 24.86 60% R−Precision 200 docs 16.61 50% 500 docs 8.36 1000 docs 4.66 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 33.53 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 251 to 275) queries 1 ESAST Topic 251 58.50 Topic 276 6.81 Difference (average precision) Topic 252 7.23 Topic 277 18.07 0.5 Topic 253 27.09 Topic 278 0.58 Topic 254 38.12 Topic 279 15.83 Topic 255 25.97 Topic 280 22.34 0 Topic 256 94.64 Topic 281 63.57 Topic 257 11.15 Topic 282 18.97 −0.5 Topic 258 8.33 Topic 283 64.82 Topic 259 34.14 Topic 284 9.95 Topic 260 28.46 Topic 285 37.77 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 8.91 Topic 286 18.94 Topic Number Topic 262 0.36 Topic 287 40.59 Topic 263 20.06 Topic 288 9.22 CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 276 to 300) Topic 264 19.58 Topic 289 24.60 1 Topic 265 26.49 Topic 290 44.45 ESAST Difference (average precision) Topic 266 42.27 Topic 291 28.02 0.5 Topic 267 28.01 Topic 292 25.59 Topic 268 55.94 Topic 293 57.19 Topic 269 8.60 Topic 294 55.88 0 Topic 270 26.80 Topic 295 49.31 Topic 271 73.59 Topic 296 51.15 Topic 272 30.94 Topic 297 33.04 −0.5 Topic 273 37.35 Topic 298 19.52 Topic 274 21.53 Topic 299 35.20 −1 Topic 275 30.03 Topic 300 37.67 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.209 miracle ESAxNP01SR1 AH-Bilingual-X2PT Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual Spanish to Portuguese Retrieved 50,000 RunType= automatic Relevant 2,904 QueryType= TDN Relevant retrieved 2,367 Pooled= true CLEF 2005 AH−Bilingual−X2PT − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 77.78 ESAxNP01SR1 90% 10 62.95 20 52.94 80% 30 44.32 70% 40 36.45 50 30.96 Average Precision 60% 60 24.93 50% 70 19.85 80 13.85 40% 90 7.82 30% 100 3.81 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 32.18 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2PT − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 54.00 ESAxNP01SR1 90% 10 docs 51.00 15 docs 47.20 80% 20 docs 45.40 70% 30 docs 40.60 100 docs 25.32 60% R−Precision 200 docs 16.57 50% 500 docs 8.49 1000 docs 4.73 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 34.26 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 251 to 275) queries 1 ESAxNP01SR1 Topic 251 46.84 Topic 276 9.06 Difference (average precision) Topic 252 4.64 Topic 277 21.53 0.5 Topic 253 31.31 Topic 278 1.34 Topic 254 42.54 Topic 279 27.99 Topic 255 27.37 Topic 280 16.88 0 Topic 256 92.28 Topic 281 71.57 Topic 257 20.24 Topic 282 19.61 −0.5 Topic 258 0.05 Topic 283 57.97 Topic 259 35.79 Topic 284 12.66 Topic 260 10.19 Topic 285 35.99 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 27.72 Topic 286 26.96 Topic Number Topic 262 0.56 Topic 287 34.94 Topic 263 21.16 Topic 288 16.26 CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 276 to 300) Topic 264 33.10 Topic 289 36.56 1 Topic 265 28.91 Topic 290 35.38 ESAxNP01SR1 Difference (average precision) Topic 266 52.12 Topic 291 24.86 0.5 Topic 267 27.51 Topic 292 31.50 Topic 268 28.77 Topic 293 62.53 Topic 269 13.57 Topic 294 59.84 0 Topic 270 30.66 Topic 295 54.03 Topic 271 57.03 Topic 296 55.36 Topic 272 27.26 Topic 297 44.41 −0.5 Topic 273 33.98 Topic 298 15.86 Topic 274 21.28 Topic 299 31.31 −1 Topic 275 46.58 Topic 300 43.35 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.210 tlr tlrTDfr2pt3 AH-Bilingual-X2PT Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual French to Portuguese Retrieved 50,000 RunType= automatic Relevant 2,904 QueryType= TD Relevant retrieved 1,920 Pooled= false CLEF 2005 AH−Bilingual−X2PT − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 74.21 tlrTDfr2pt3 90% 10 46.51 20 35.17 80% 30 29.57 70% 40 24.28 50 19.29 Average Precision 60% 60 14.61 50% 70 10.72 80 7.81 40% 90 4.62 30% 100 2.77 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 22.09 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2PT − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 44.00 tlrTDfr2pt3 90% 10 docs 39.00 15 docs 36.40 80% 20 docs 32.50 70% 30 docs 28.33 100 docs 16.94 60% R−Precision 200 docs 11.80 50% 500 docs 6.58 1000 docs 3.84 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 25.25 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 251 to 275) queries 1 tlrTDfr2pt3 Topic 251 31.84 Topic 276 8.36 Difference (average precision) Topic 252 4.95 Topic 277 1.01 0.5 Topic 253 8.41 Topic 278 24.08 Topic 254 12.91 Topic 279 44.39 Topic 255 44.27 Topic 280 1.87 0 Topic 256 97.53 Topic 281 65.89 Topic 257 14.35 Topic 282 12.30 −0.5 Topic 258 0.16 Topic 283 10.63 Topic 259 15.94 Topic 284 17.30 Topic 260 37.73 Topic 285 10.78 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.41 Topic 286 22.01 Topic Number Topic 262 0.09 Topic 287 8.79 Topic 263 4.29 Topic 288 3.48 CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 276 to 300) Topic 264 23.79 Topic 289 25.20 1 Topic 265 7.47 Topic 290 22.30 tlrTDfr2pt3 Difference (average precision) Topic 266 3.57 Topic 291 31.37 0.5 Topic 267 21.36 Topic 292 16.94 Topic 268 51.22 Topic 293 41.81 Topic 269 5.59 Topic 294 56.09 0 Topic 270 16.35 Topic 295 14.29 Topic 271 37.32 Topic 296 43.22 Topic 272 30.86 Topic 297 44.21 −0.5 Topic 273 24.68 Topic 298 19.55 Topic 274 20.43 Topic 299 29.02 −1 Topic 275 13.92 Topic 300 0.03 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.211 tlr tlrTDfr2ptRFS1 AH-Bilingual-X2PT Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual French to Portuguese Retrieved 50,000 RunType= automatic Relevant 2,904 QueryType= TD Relevant retrieved 2,009 Pooled= true CLEF 2005 AH−Bilingual−X2PT − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 60.81 tlrTDfr2ptRFS1 90% 10 45.82 20 38.58 80% 30 30.58 70% 40 26.93 50 21.79 Average Precision 60% 60 17.24 50% 70 13.67 80 10.76 40% 90 6.37 30% 100 3.70 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 23.58 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2PT − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 42.80 tlrTDfr2ptRFS1 90% 10 docs 40.20 15 docs 37.87 80% 20 docs 35.60 70% 30 docs 31.20 100 docs 19.68 60% R−Precision 200 docs 13.07 50% 500 docs 6.91 1000 docs 4.02 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 26.89 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 251 to 275) queries 1 tlrTDfr2ptRFS1 Topic 251 29.57 Topic 276 15.72 Difference (average precision) Topic 252 4.95 Topic 277 3.56 0.5 Topic 253 23.48 Topic 278 10.18 Topic 254 12.91 Topic 279 45.78 Topic 255 9.18 Topic 280 1.05 0 Topic 256 97.53 Topic 281 57.81 Topic 257 24.20 Topic 282 20.59 −0.5 Topic 258 0.45 Topic 283 5.20 Topic 259 16.47 Topic 284 20.50 Topic 260 37.73 Topic 285 11.59 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.41 Topic 286 16.49 Topic Number Topic 262 0.62 Topic 287 7.05 Topic 263 1.20 Topic 288 0.60 CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 276 to 300) Topic 264 23.50 Topic 289 47.68 1 Topic 265 28.30 Topic 290 22.30 tlrTDfr2ptRFS1 Difference (average precision) Topic 266 1.26 Topic 291 45.33 0.5 Topic 267 13.57 Topic 292 14.88 Topic 268 48.70 Topic 293 61.94 Topic 269 4.61 Topic 294 44.77 0 Topic 270 15.54 Topic 295 19.79 Topic 271 30.34 Topic 296 42.93 Topic 272 30.86 Topic 297 44.05 −0.5 Topic 273 37.85 Topic 298 50.77 Topic 274 4.52 Topic 299 51.34 −1 Topic 275 19.58 Topic 300 0.00 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.212 u.glasgow glaespttd AH-Bilingual-X2PT Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual Spanish to Portuguese Retrieved 50,000 RunType= automatic Relevant 2,904 QueryType= TD Relevant retrieved 869 Pooled= true CLEF 2005 AH−Bilingual−X2PT − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 33.98 glaespttd 90% 10 22.46 20 14.49 80% 30 11.19 70% 40 8.84 50 7.07 Average Precision 60% 60 4.79 50% 70 4.37 80 3.36 40% 90 2.71 30% 100 2.07 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 9.28 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2PT − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 20.40 glaespttd 90% 10 docs 18.40 15 docs 16.67 80% 20 docs 15.30 70% 30 docs 12.73 100 docs 7.78 60% R−Precision 200 docs 5.14 50% 500 docs 2.77 1000 docs 1.74 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 11.69 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 251 to 275) queries 1 glaespttd Topic 251 29.48 Topic 276 0.18 Difference (average precision) Topic 252 0.00 Topic 277 0.00 0.5 Topic 253 0.18 Topic 278 0.00 Topic 254 38.83 Topic 279 0.00 Topic 255 33.83 Topic 280 1.29 0 Topic 256 89.97 Topic 281 28.74 Topic 257 0.14 Topic 282 3.18 −0.5 Topic 258 0.00 Topic 283 5.33 Topic 259 0.22 Topic 284 0.00 Topic 260 14.16 Topic 285 0.15 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 6.31 Topic 286 3.62 Topic Number Topic 262 0.00 Topic 287 0.00 Topic 263 0.31 Topic 288 3.24 CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 276 to 300) Topic 264 1.05 Topic 289 8.02 1 Topic 265 24.43 Topic 290 0.00 glaespttd Difference (average precision) Topic 266 0.02 Topic 291 1.93 0.5 Topic 267 0.13 Topic 292 4.58 Topic 268 1.76 Topic 293 30.19 Topic 269 1.69 Topic 294 6.61 0 Topic 270 18.86 Topic 295 0.23 Topic 271 0.04 Topic 296 44.61 Topic 272 19.59 Topic 297 5.56 −0.5 Topic 273 12.26 Topic 298 3.35 Topic 274 18.69 Topic 299 0.01 −1 Topic 275 0.79 Topic 300 0.59 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.213 u.glasgow glaespttdn AH-Bilingual-X2PT Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual Spanish to Portuguese Retrieved 50,000 RunType= automatic Relevant 2,904 QueryType= TDN Relevant retrieved 924 Pooled= true CLEF 2005 AH−Bilingual−X2PT − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 39.96 glaespttdn 90% 10 28.46 20 16.87 80% 30 11.48 70% 40 9.32 50 7.38 Average Precision 60% 60 5.14 50% 70 4.73 80 3.16 40% 90 2.56 30% 100 1.13 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 10.55 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2PT − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 24.00 glaespttdn 90% 10 docs 21.60 15 docs 18.40 80% 20 docs 16.50 70% 30 docs 14.33 100 docs 8.36 60% R−Precision 200 docs 5.49 50% 500 docs 2.98 1000 docs 1.85 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 12.47 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 251 to 275) queries 1 glaespttdn Topic 251 16.47 Topic 276 0.23 Difference (average precision) Topic 252 0.00 Topic 277 0.00 0.5 Topic 253 0.06 Topic 278 0.02 Topic 254 41.04 Topic 279 0.00 Topic 255 21.20 Topic 280 10.36 0 Topic 256 89.54 Topic 281 46.55 Topic 257 1.41 Topic 282 6.38 −0.5 Topic 258 0.00 Topic 283 3.41 Topic 259 27.22 Topic 284 0.00 Topic 260 6.47 Topic 285 0.01 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 11.18 Topic 286 0.40 Topic Number Topic 262 0.00 Topic 287 0.00 Topic 263 0.09 Topic 288 5.94 CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 276 to 300) Topic 264 1.44 Topic 289 16.67 1 Topic 265 19.92 Topic 290 0.00 glaespttdn Difference (average precision) Topic 266 0.01 Topic 291 1.99 0.5 Topic 267 0.12 Topic 292 4.18 Topic 268 1.32 Topic 293 27.43 Topic 269 1.06 Topic 294 12.97 0 Topic 270 14.99 Topic 295 8.61 Topic 271 0.03 Topic 296 47.65 Topic 272 8.02 Topic 297 3.54 −0.5 Topic 273 13.70 Topic 298 4.17 Topic 274 18.35 Topic 299 0.05 −1 Topic 275 33.03 Topic 300 0.13 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.214 u.glasgow glaespttdnqe AH-Bilingual-X2PT Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual Spanish to Portuguese Retrieved 50,000 RunType= automatic Relevant 2,904 QueryType= TDN Relevant retrieved 1,286 Pooled= false CLEF 2005 AH−Bilingual−X2PT − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 40.18 glaespttdnqe 90% 10 35.44 20 23.81 80% 30 20.07 70% 40 16.63 50 13.56 Average Precision 60% 60 9.99 50% 70 8.89 80 6.62 40% 90 4.50 30% 100 3.13 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 15.65 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2PT − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 26.80 glaespttdnqe 90% 10 docs 25.20 15 docs 23.07 80% 20 docs 21.90 70% 30 docs 19.73 100 docs 11.38 60% R−Precision 200 docs 7.97 50% 500 docs 4.26 1000 docs 2.57 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 16.39 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 251 to 275) queries 1 glaespttdnqe Topic 251 27.73 Topic 276 0.17 Difference (average precision) Topic 252 0.00 Topic 277 0.00 0.5 Topic 253 0.01 Topic 278 0.03 Topic 254 51.02 Topic 279 0.00 Topic 255 18.36 Topic 280 25.93 0 Topic 256 91.83 Topic 281 48.80 Topic 257 15.72 Topic 282 18.35 −0.5 Topic 258 0.00 Topic 283 53.75 Topic 259 40.97 Topic 284 0.00 Topic 260 7.24 Topic 285 0.00 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 9.34 Topic 286 2.46 Topic Number Topic 262 0.01 Topic 287 0.00 Topic 263 0.02 Topic 288 4.49 CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 276 to 300) Topic 264 2.62 Topic 289 50.15 1 Topic 265 27.61 Topic 290 0.00 glaespttdnqe Difference (average precision) Topic 266 0.00 Topic 291 17.26 0.5 Topic 267 0.01 Topic 292 0.90 Topic 268 0.64 Topic 293 36.63 Topic 269 0.17 Topic 294 41.57 0 Topic 270 17.66 Topic 295 23.98 Topic 271 0.01 Topic 296 51.21 Topic 272 1.26 Topic 297 5.13 −0.5 Topic 273 20.46 Topic 298 8.51 Topic 274 17.84 Topic 299 0.03 −1 Topic 275 42.56 Topic 300 0.12 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.215 unine UniNEbipt1 AH-Bilingual-X2PT Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual English to Portuguese Retrieved 50,000 RunType= automatic Relevant 2,904 QueryType= TD Relevant retrieved 2,385 Pooled= true CLEF 2005 AH−Bilingual−X2PT − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 74.85 UniNEbipt1 90% 10 59.44 20 52.68 80% 30 44.96 70% 40 37.67 50 32.19 Average Precision 60% 60 27.95 50% 70 23.79 80 19.04 40% 90 12.15 30% 100 5.73 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 34.04 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2PT − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 55.60 UniNEbipt1 90% 10 docs 49.80 15 docs 45.20 80% 20 docs 43.60 70% 30 docs 39.40 100 docs 24.00 60% R−Precision 200 docs 16.10 50% 500 docs 8.42 1000 docs 4.77 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 34.26 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 251 to 275) queries 1 UniNEbipt1 Topic 251 46.45 Topic 276 41.49 Difference (average precision) Topic 252 9.28 Topic 277 10.64 0.5 Topic 253 12.75 Topic 278 51.89 Topic 254 66.46 Topic 279 63.32 Topic 255 36.48 Topic 280 20.06 0 Topic 256 95.97 Topic 281 74.15 Topic 257 23.46 Topic 282 20.09 −0.5 Topic 258 0.45 Topic 283 63.85 Topic 259 42.75 Topic 284 20.55 Topic 260 56.30 Topic 285 40.65 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 11.03 Topic 286 7.32 Topic Number Topic 262 2.69 Topic 287 4.39 Topic 263 16.33 Topic 288 1.11 CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 276 to 300) Topic 264 63.54 Topic 289 40.01 1 Topic 265 0.12 Topic 290 9.95 UniNEbipt1 Difference (average precision) Topic 266 30.72 Topic 291 30.82 0.5 Topic 267 19.50 Topic 292 36.67 Topic 268 55.87 Topic 293 73.48 Topic 269 11.65 Topic 294 65.83 0 Topic 270 21.00 Topic 295 50.64 Topic 271 61.11 Topic 296 49.55 Topic 272 26.14 Topic 297 48.60 −0.5 Topic 273 48.35 Topic 298 39.73 Topic 274 7.86 Topic 299 31.15 −1 Topic 275 33.40 Topic 300 6.34 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.216 unine UniNEbipt2 AH-Bilingual-X2PT Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual English to Portuguese Retrieved 50,000 RunType= automatic Relevant 2,904 QueryType= TD Relevant retrieved 2,231 Pooled= false CLEF 2005 AH−Bilingual−X2PT − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 77.59 UniNEbipt2 90% 10 59.06 20 49.30 80% 30 40.55 70% 40 34.49 50 28.96 Average Precision 60% 60 22.85 50% 70 19.08 80 14.48 40% 90 9.56 30% 100 4.86 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 30.94 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2PT − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 52.80 UniNEbipt2 90% 10 docs 48.00 15 docs 43.87 80% 20 docs 41.60 70% 30 docs 36.87 100 docs 22.76 60% R−Precision 200 docs 14.95 50% 500 docs 7.87 1000 docs 4.46 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 32.32 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 251 to 275) queries 1 UniNEbipt2 Topic 251 45.83 Topic 276 30.84 Difference (average precision) Topic 252 8.30 Topic 277 8.75 0.5 Topic 253 17.42 Topic 278 36.20 Topic 254 63.33 Topic 279 57.62 Topic 255 35.45 Topic 280 7.54 0 Topic 256 96.93 Topic 281 71.07 Topic 257 22.98 Topic 282 17.63 −0.5 Topic 258 0.63 Topic 283 37.21 Topic 259 45.15 Topic 284 18.09 Topic 260 46.22 Topic 285 40.63 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 6.20 Topic 286 4.53 Topic Number Topic 262 5.50 Topic 287 4.74 Topic 263 14.49 Topic 288 1.74 CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 276 to 300) Topic 264 50.26 Topic 289 48.48 1 Topic 265 5.59 Topic 290 4.57 UniNEbipt2 Difference (average precision) Topic 266 29.95 Topic 291 29.34 0.5 Topic 267 22.91 Topic 292 35.33 Topic 268 41.52 Topic 293 68.45 Topic 269 12.71 Topic 294 68.42 0 Topic 270 19.59 Topic 295 37.67 Topic 271 60.07 Topic 296 46.48 Topic 272 28.73 Topic 297 42.56 −0.5 Topic 273 41.99 Topic 298 40.74 Topic 274 9.91 Topic 299 25.34 −1 Topic 275 28.11 Topic 300 3.37 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.217 unine UniNEbipt3 AH-Bilingual-X2PT Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual English to Portuguese Retrieved 50,000 RunType= automatic Relevant 2,904 QueryType= TD Relevant retrieved 2,199 Pooled= false CLEF 2005 AH−Bilingual−X2PT − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 76.01 UniNEbipt3 90% 10 60.01 20 49.93 80% 30 41.40 70% 40 34.34 50 29.34 Average Precision 60% 60 23.37 50% 70 19.24 80 14.88 40% 90 9.28 30% 100 4.90 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 31.17 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2PT − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 54.00 UniNEbipt3 90% 10 docs 48.40 15 docs 45.33 80% 20 docs 41.70 70% 30 docs 37.27 100 docs 22.52 60% R−Precision 200 docs 14.70 50% 500 docs 7.78 1000 docs 4.40 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 32.57 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 251 to 275) queries 1 UniNEbipt3 Topic 251 43.32 Topic 276 33.27 Difference (average precision) Topic 252 11.38 Topic 277 7.54 0.5 Topic 253 12.73 Topic 278 47.78 Topic 254 55.22 Topic 279 57.85 Topic 255 35.05 Topic 280 22.53 0 Topic 256 96.24 Topic 281 71.32 Topic 257 21.99 Topic 282 18.15 −0.5 Topic 258 0.63 Topic 283 47.19 Topic 259 45.21 Topic 284 19.28 Topic 260 45.58 Topic 285 39.49 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 8.48 Topic 286 5.42 Topic Number Topic 262 3.23 Topic 287 4.30 Topic 263 14.93 Topic 288 1.32 CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 276 to 300) Topic 264 55.71 Topic 289 46.20 1 Topic 265 0.20 Topic 290 6.70 UniNEbipt3 Difference (average precision) Topic 266 25.52 Topic 291 30.95 0.5 Topic 267 21.01 Topic 292 34.50 Topic 268 49.38 Topic 293 69.54 Topic 269 12.76 Topic 294 67.95 0 Topic 270 20.12 Topic 295 43.14 Topic 271 58.26 Topic 296 46.50 Topic 272 25.50 Topic 297 42.48 −0.5 Topic 273 39.85 Topic 298 36.14 Topic 274 8.92 Topic 299 21.84 −1 Topic 275 23.45 Topic 300 2.65 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.218 xldb XLDBTumba03 AH-Bilingual-X2PT Overall statistics for 29 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual English to Portuguese Retrieved 4,875 RunType= automatic Relevant 1,991 QueryType= TDN Relevant retrieved 605 Pooled= true CLEF 2005 AH−Bilingual−X2PT − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 29.69 XLDBTumba03 90% 10 18.14 20 11.87 80% 30 6.64 70% 40 4.71 50 2.99 Average Precision 60% 60 1.45 50% 70 0.84 80 0.53 40% 90 0.37 30% 100 0.00 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 5.75 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2PT − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 17.20 XLDBTumba03 90% 10 docs 15.60 15 docs 14.13 80% 20 docs 12.70 70% 30 docs 11.40 100 docs 7.14 60% R−Precision 200 docs 4.47 50% 500 docs 2.15 1000 docs 1.21 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 8.05 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 251 to 275) queries 1 XLDBTumba03 Topic 251 20.53 Topic 276 0.00 Difference (average precision) Topic 252 5.23 Topic 277 7.92 0.5 Topic 253 3.97 Topic 278 0.00 Topic 254 6.82 Topic 279 0.00 Topic 255 0.00 Topic 280 3.92 0 Topic 256 0.00 Topic 281 33.01 Topic 257 0.58 Topic 282 0.00 −0.5 Topic 258 0.00 Topic 283 0.00 Topic 259 0.00 Topic 284 0.21 Topic 260 0.00 Topic 285 0.00 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.00 Topic 286 17.83 Topic Number Topic 262 0.00 Topic 287 0.00 Topic 263 0.00 Topic 288 0.00 CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 276 to 300) Topic 264 0.00 Topic 289 26.98 1 Topic 265 0.00 Topic 290 0.00 XLDBTumba03 Difference (average precision) Topic 266 0.00 Topic 291 1.05 0.5 Topic 267 0.00 Topic 292 0.00 Topic 268 25.95 Topic 293 36.62 Topic 269 5.97 Topic 294 0.00 0 Topic 270 0.00 Topic 295 47.70 Topic 271 0.00 Topic 296 2.04 Topic 272 0.06 Topic 297 0.00 −0.5 Topic 273 15.08 Topic 298 19.15 Topic 274 0.00 Topic 299 6.72 −1 Topic 275 0.00 Topic 300 0.00 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.219 xldb XLDBTumba04 AH-Bilingual-X2PT Overall statistics for 33 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual English to Portuguese Retrieved 6,774 RunType= automatic Relevant 2,156 QueryType= TDN Relevant retrieved 299 Pooled= false CLEF 2005 AH−Bilingual−X2PT − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 31.82 XLDBTumba04 90% 10 16.17 20 10.25 80% 30 6.08 70% 40 3.36 50 2.98 Average Precision 60% 60 2.50 50% 70 2.49 80 0.43 40% 90 0.38 30% 100 0.00 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 5.53 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2PT − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 21.60 XLDBTumba04 90% 10 docs 17.20 15 docs 14.53 80% 20 docs 12.80 70% 30 docs 10.20 100 docs 4.22 60% R−Precision 200 docs 2.51 50% 500 docs 1.14 1000 docs 0.60 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 7.40 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 251 to 275) queries 1 XLDBTumba04 Topic 251 18.92 Topic 276 0.02 Difference (average precision) Topic 252 0.94 Topic 277 0.00 0.5 Topic 253 1.59 Topic 278 0.00 Topic 254 18.91 Topic 279 0.00 Topic 255 0.00 Topic 280 2.90 0 Topic 256 75.00 Topic 281 32.69 Topic 257 0.00 Topic 282 0.49 −0.5 Topic 258 0.00 Topic 283 0.00 Topic 259 5.00 Topic 284 0.00 Topic 260 0.00 Topic 285 0.00 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.00 Topic 286 0.08 Topic Number Topic 262 4.55 Topic 287 1.07 Topic 263 0.00 Topic 288 0.12 CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 276 to 300) Topic 264 0.00 Topic 289 28.89 1 Topic 265 0.00 Topic 290 0.00 XLDBTumba04 Difference (average precision) Topic 266 3.45 Topic 291 0.48 0.5 Topic 267 0.83 Topic 292 0.00 Topic 268 0.00 Topic 293 12.55 Topic 269 0.00 Topic 294 26.59 0 Topic 270 20.17 Topic 295 5.68 Topic 271 1.54 Topic 296 0.00 Topic 272 0.00 Topic 297 0.00 −0.5 Topic 273 9.87 Topic 298 0.26 Topic 274 0.00 Topic 299 0.00 −1 Topic 275 4.17 Topic 300 0.00 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.220 xldb XLDBTumba07 AH-Bilingual-X2PT Overall statistics for 29 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual English to Portuguese Retrieved 4,875 RunType= automatic Relevant 1,991 QueryType= TDN Relevant retrieved 617 Pooled= false CLEF 2005 AH−Bilingual−X2PT − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 22.13 XLDBTumba07 90% 10 13.90 20 9.22 80% 30 5.79 70% 40 4.17 50 3.20 Average Precision 60% 60 1.88 50% 70 1.52 80 0.72 40% 90 0.41 30% 100 0.00 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 4.71 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2PT − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 13.60 XLDBTumba07 90% 10 docs 11.60 15 docs 11.33 80% 20 docs 11.10 70% 30 docs 9.73 100 docs 6.68 60% R−Precision 200 docs 4.58 50% 500 docs 2.24 1000 docs 1.23 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 7.24 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 251 to 275) queries 1 XLDBTumba07 Topic 251 18.40 Topic 276 0.00 Difference (average precision) Topic 252 3.47 Topic 277 5.94 0.5 Topic 253 2.52 Topic 278 0.00 Topic 254 5.76 Topic 279 0.00 Topic 255 0.00 Topic 280 1.60 0 Topic 256 0.00 Topic 281 30.29 Topic 257 0.58 Topic 282 0.00 −0.5 Topic 258 0.00 Topic 283 0.00 Topic 259 0.00 Topic 284 0.21 Topic 260 0.00 Topic 285 0.00 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.00 Topic 286 20.61 Topic Number Topic 262 0.00 Topic 287 0.00 Topic 263 0.00 Topic 288 0.00 CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 276 to 300) Topic 264 0.00 Topic 289 28.89 1 Topic 265 0.00 Topic 290 0.00 XLDBTumba07 Difference (average precision) Topic 266 0.00 Topic 291 0.64 0.5 Topic 267 0.00 Topic 292 0.00 Topic 268 11.54 Topic 293 26.33 Topic 269 4.89 Topic 294 0.00 0 Topic 270 0.00 Topic 295 38.90 Topic 271 0.00 Topic 296 2.04 Topic 272 0.30 Topic 297 0.00 −0.5 Topic 273 10.83 Topic 298 16.84 Topic 274 0.00 Topic 299 5.01 −1 Topic 275 0.00 Topic 300 0.00 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.221 xldb XLDBTumba08 AH-Bilingual-X2PT Overall statistics for 33 queries : General info: Total number of documents over all queries Track= Ad Hoc Bilingual English to Portuguese Retrieved 6,774 RunType= automatic Relevant 2,156 QueryType= TDN Relevant retrieved 301 Pooled= false CLEF 2005 AH−Bilingual−X2PT − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 30.70 XLDBTumba08 90% 10 13.68 20 9.85 80% 30 5.85 70% 40 3.22 50 3.10 Average Precision 60% 60 2.72 50% 70 2.70 80 0.67 40% 90 0.45 30% 100 0.00 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 5.32 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Bilingual−X2PT − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 19.60 XLDBTumba08 90% 10 docs 14.80 15 docs 12.27 80% 20 docs 11.50 70% 30 docs 9.47 100 docs 4.52 60% R−Precision 200 docs 2.73 50% 500 docs 1.16 1000 docs 0.60 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 7.43 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 251 to 275) queries 1 XLDBTumba08 Topic 251 15.86 Topic 276 0.07 Difference (average precision) Topic 252 0.90 Topic 277 0.00 0.5 Topic 253 1.05 Topic 278 0.00 Topic 254 19.41 Topic 279 0.00 Topic 255 0.00 Topic 280 2.95 0 Topic 256 75.00 Topic 281 35.64 Topic 257 0.00 Topic 282 0.71 −0.5 Topic 258 0.00 Topic 283 0.00 Topic 259 7.46 Topic 284 0.00 Topic 260 0.00 Topic 285 0.00 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.00 Topic 286 0.10 Topic Number Topic 262 1.09 Topic 287 1.07 Topic 263 0.00 Topic 288 0.15 CLEF 2005 AH−Bilingual−X2PT − Comparison to median by topic (topics 276 to 300) Topic 264 0.00 Topic 289 30.56 1 Topic 265 0.00 Topic 290 0.00 XLDBTumba08 Difference (average precision) Topic 266 3.45 Topic 291 0.56 0.5 Topic 267 0.83 Topic 292 0.00 Topic 268 0.00 Topic 293 9.44 Topic 269 0.00 Topic 294 20.61 0 Topic 270 16.81 Topic 295 4.45 Topic 271 4.42 Topic 296 0.00 Topic 272 0.00 Topic 297 0.00 −0.5 Topic 273 8.62 Topic 298 0.27 Topic 274 0.00 Topic 299 0.00 −1 Topic 275 4.39 Topic 300 0.00 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.222 alicante IRn-bu-fexp AH-Monolingual-BG Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Bulgarian Retrieved 50,000 RunType= automatic Relevant 778 QueryType= TD Relevant retrieved 596 Pooled= true CLEF 2005 AH−Monolingual−BG − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 45.55 IRn−bu−fexp 90% 10 36.86 20 27.63 80% 30 21.48 70% 40 19.63 50 17.85 Average Precision 60% 60 11.51 50% 70 10.04 80 8.12 40% 90 6.37 30% 100 4.89 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 17.58 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−BG − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 21.20 IRn−bu−fexp 90% 10 docs 18.80 15 docs 16.40 80% 20 docs 13.80 70% 30 docs 12.13 100 docs 6.68 60% R−Precision 200 docs 4.14 50% 500 docs 2.12 1000 docs 1.19 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 17.54 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 251 to 275) queries 1 IRn−bu−fexp Topic 251 22.96 Topic 276 13.16 Difference (average precision) Topic 252 3.85 Topic 277 0.05 0.5 Topic 253 29.31 Topic 278 18.33 Topic 254 5.67 Topic 279 17.12 Topic 255 2.97 Topic 280 6.60 0 Topic 256 64.29 Topic 281 45.65 Topic 257 9.44 Topic 282 7.38 −0.5 Topic 258 9.09 Topic 283 45.08 Topic 259 60.74 Topic 284 13.15 Topic 260 10.75 Topic 285 34.72 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 17.20 Topic 286 6.36 Topic Number Topic 262 7.10 Topic 287 27.60 Topic 263 3.02 Topic 288 2.42 CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 276 to 300) Topic 264 0.57 Topic 289 61.11 1 Topic 265 16.88 Topic 290 32.79 IRn−bu−fexp Difference (average precision) Topic 266 17.02 Topic 291 40.31 0.5 Topic 267 10.65 Topic 292 0.00 Topic 268 45.24 Topic 293 52.68 Topic 269 0.13 Topic 294 23.18 0 Topic 270 3.94 Topic 295 3.83 Topic 271 0.00 Topic 296 2.94 Topic 272 14.29 Topic 297 2.86 −0.5 Topic 273 18.18 Topic 298 0.06 Topic 274 2.49 Topic 299 0.11 −1 Topic 275 13.34 Topic 300 32.35 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.223 alicante IRn-bu-vexp AH-Monolingual-BG Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Bulgarian Retrieved 50,000 RunType= automatic Relevant 778 QueryType= TD Relevant retrieved 597 Pooled= true CLEF 2005 AH−Monolingual−BG − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 44.97 IRn−bu−vexp 90% 10 35.95 20 28.22 80% 30 21.44 70% 40 19.72 50 17.87 Average Precision 60% 60 11.48 50% 70 10.18 80 8.16 40% 90 6.39 30% 100 4.87 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 17.46 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−BG − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 20.00 IRn−bu−vexp 90% 10 docs 18.80 15 docs 16.27 80% 20 docs 13.80 70% 30 docs 12.33 100 docs 6.74 60% R−Precision 200 docs 4.16 50% 500 docs 2.12 1000 docs 1.19 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 17.17 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 251 to 275) queries 1 IRn−bu−vexp Topic 251 25.64 Topic 276 13.16 Difference (average precision) Topic 252 3.83 Topic 277 0.05 0.5 Topic 253 29.13 Topic 278 16.65 Topic 254 5.57 Topic 279 17.12 Topic 255 2.97 Topic 280 5.59 0 Topic 256 64.29 Topic 281 45.65 Topic 257 9.44 Topic 282 7.38 −0.5 Topic 258 8.33 Topic 283 45.08 Topic 259 60.74 Topic 284 13.15 Topic 260 10.74 Topic 285 34.72 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 15.39 Topic 286 6.37 Topic Number Topic 262 6.83 Topic 287 27.60 Topic 263 3.02 Topic 288 2.35 CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 276 to 300) Topic 264 0.57 Topic 289 61.11 1 Topic 265 17.97 Topic 290 30.71 IRn−bu−vexp Difference (average precision) Topic 266 16.90 Topic 291 40.32 0.5 Topic 267 10.48 Topic 292 0.00 Topic 268 45.20 Topic 293 52.68 Topic 269 0.10 Topic 294 23.06 0 Topic 270 3.92 Topic 295 3.80 Topic 271 0.00 Topic 296 2.94 Topic 272 14.29 Topic 297 2.86 −0.5 Topic 273 18.17 Topic 298 0.06 Topic 274 2.49 Topic 299 0.11 −1 Topic 275 12.29 Topic 300 32.35 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.224 alicante IRn-bu-vnexp AH-Monolingual-BG Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Bulgarian Retrieved 50,000 RunType= automatic Relevant 778 QueryType= TD Relevant retrieved 603 Pooled= false CLEF 2005 AH−Monolingual−BG − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 43.79 IRn−bu−vnexp 90% 10 37.31 20 28.46 80% 30 23.64 70% 40 21.33 50 19.22 Average Precision 60% 60 11.70 50% 70 9.99 80 8.73 40% 90 6.71 30% 100 5.39 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 17.87 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−BG − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 21.60 IRn−bu−vnexp 90% 10 docs 18.00 15 docs 16.13 80% 20 docs 15.00 70% 30 docs 13.07 100 docs 6.98 60% R−Precision 200 docs 4.25 50% 500 docs 2.11 1000 docs 1.21 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 19.65 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 251 to 275) queries 1 IRn−bu−vnexp Topic 251 17.72 Topic 276 6.98 Difference (average precision) Topic 252 5.57 Topic 277 0.44 0.5 Topic 253 28.43 Topic 278 33.51 Topic 254 7.07 Topic 279 23.04 Topic 255 2.34 Topic 280 1.17 0 Topic 256 45.00 Topic 281 40.99 Topic 257 5.75 Topic 282 19.89 −0.5 Topic 258 10.00 Topic 283 39.51 Topic 259 53.35 Topic 284 13.05 Topic 260 12.01 Topic 285 51.39 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 13.27 Topic 286 5.00 Topic Number Topic 262 8.82 Topic 287 21.59 Topic 263 3.54 Topic 288 0.61 CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 276 to 300) Topic 264 1.74 Topic 289 64.29 1 Topic 265 25.30 Topic 290 40.41 IRn−bu−vnexp Difference (average precision) Topic 266 12.37 Topic 291 40.69 0.5 Topic 267 14.93 Topic 292 0.00 Topic 268 46.19 Topic 293 58.13 Topic 269 1.09 Topic 294 21.86 0 Topic 270 2.23 Topic 295 8.11 Topic 271 0.00 Topic 296 16.67 Topic 272 2.38 Topic 297 7.09 −0.5 Topic 273 14.42 Topic 298 0.73 Topic 274 2.80 Topic 299 0.53 −1 Topic 275 26.67 Topic 300 15.06 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.225 hildesheim UHIBG1 AH-Monolingual-BG Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Bulgarian Retrieved 50,000 RunType= automatic Relevant 778 QueryType= TD Relevant retrieved 587 Pooled= true CLEF 2005 AH−Monolingual−BG − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 49.97 UHIBG1 90% 10 41.48 20 31.25 80% 30 24.09 70% 40 19.97 50 17.68 Average Precision 60% 60 13.53 50% 70 10.69 80 8.02 40% 90 6.13 30% 100 4.58 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 18.87 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−BG − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 23.60 UHIBG1 90% 10 docs 22.60 15 docs 19.07 80% 20 docs 16.60 70% 30 docs 13.53 100 docs 7.46 60% R−Precision 200 docs 4.64 50% 500 docs 2.17 1000 docs 1.17 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 19.96 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 251 to 275) queries 1 UHIBG1 Topic 251 19.57 Topic 276 10.03 Difference (average precision) Topic 252 2.36 Topic 277 24.44 0.5 Topic 253 13.02 Topic 278 24.57 Topic 254 28.66 Topic 279 64.06 Topic 255 20.83 Topic 280 0.02 0 Topic 256 41.67 Topic 281 30.54 Topic 257 7.33 Topic 282 23.24 −0.5 Topic 258 2.38 Topic 283 55.45 Topic 259 2.99 Topic 284 1.24 Topic 260 19.47 Topic 285 31.67 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 38.03 Topic 286 6.03 Topic Number Topic 262 30.88 Topic 287 16.41 Topic 263 2.31 Topic 288 4.80 CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 276 to 300) Topic 264 26.45 Topic 289 39.29 1 Topic 265 18.23 Topic 290 41.04 UHIBG1 Difference (average precision) Topic 266 2.15 Topic 291 42.83 0.5 Topic 267 15.11 Topic 292 0.00 Topic 268 45.10 Topic 293 0.05 Topic 269 10.95 Topic 294 45.26 0 Topic 270 1.78 Topic 295 0.83 Topic 271 36.11 Topic 296 0.25 Topic 272 1.32 Topic 297 1.38 −0.5 Topic 273 21.87 Topic 298 2.72 Topic 274 3.00 Topic 299 9.58 −1 Topic 275 24.33 Topic 300 31.89 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.226 hildesheim UHIBG2 AH-Monolingual-BG Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Bulgarian Retrieved 50,000 RunType= automatic Relevant 778 QueryType= TD Relevant retrieved 597 Pooled= true CLEF 2005 AH−Monolingual−BG − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 48.12 UHIBG2 90% 10 40.31 20 33.38 80% 30 26.23 70% 40 20.89 50 17.42 Average Precision 60% 60 13.95 50% 70 11.26 80 9.22 40% 90 6.89 30% 100 4.78 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 19.46 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−BG − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 23.60 UHIBG2 90% 10 docs 22.20 15 docs 19.20 80% 20 docs 17.30 70% 30 docs 15.27 100 docs 7.62 60% R−Precision 200 docs 4.75 50% 500 docs 2.19 1000 docs 1.19 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 19.77 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 251 to 275) queries 1 UHIBG2 Topic 251 23.50 Topic 276 12.45 Difference (average precision) Topic 252 3.73 Topic 277 27.00 0.5 Topic 253 9.95 Topic 278 14.80 Topic 254 31.28 Topic 279 62.21 Topic 255 38.89 Topic 280 0.02 0 Topic 256 36.67 Topic 281 34.11 Topic 257 9.30 Topic 282 23.00 −0.5 Topic 258 14.29 Topic 283 12.07 Topic 259 38.35 Topic 284 1.49 Topic 260 17.67 Topic 285 25.96 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 44.12 Topic 286 5.31 Topic Number Topic 262 47.50 Topic 287 13.47 Topic 263 2.71 Topic 288 0.15 CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 276 to 300) Topic 264 20.77 Topic 289 39.29 1 Topic 265 17.15 Topic 290 41.11 UHIBG2 Difference (average precision) Topic 266 1.38 Topic 291 40.89 0.5 Topic 267 18.49 Topic 292 0.00 Topic 268 41.43 Topic 293 1.87 Topic 269 18.54 Topic 294 60.01 0 Topic 270 1.85 Topic 295 1.09 Topic 271 36.11 Topic 296 0.17 Topic 272 9.09 Topic 297 3.42 −0.5 Topic 273 23.33 Topic 298 2.88 Topic 274 2.92 Topic 299 8.33 −1 Topic 275 25.65 Topic 300 7.16 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.227 hummingbird humBG05t AH-Monolingual-BG Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Bulgarian Retrieved 42,603 RunType= automatic Relevant 778 QueryType= T Relevant retrieved 582 Pooled= true CLEF 2005 AH−Monolingual−BG − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 50.90 humBG05t 90% 10 45.38 20 37.35 80% 30 33.52 70% 40 29.37 50 25.50 Average Precision 60% 60 19.21 50% 70 17.97 80 16.36 40% 90 12.38 30% 100 10.73 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 25.36 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−BG − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 30.40 humBG05t 90% 10 docs 22.00 15 docs 18.93 80% 20 docs 17.30 70% 30 docs 15.20 100 docs 7.72 60% R−Precision 200 docs 4.65 50% 500 docs 2.16 1000 docs 1.16 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 25.40 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 251 to 275) queries 1 humBG05t Topic 251 19.60 Topic 276 8.66 Difference (average precision) Topic 252 6.63 Topic 277 49.65 0.5 Topic 253 24.01 Topic 278 42.67 Topic 254 5.52 Topic 279 82.38 Topic 255 33.93 Topic 280 8.26 0 Topic 256 39.29 Topic 281 33.28 Topic 257 4.75 Topic 282 16.46 −0.5 Topic 258 50.00 Topic 283 32.42 Topic 259 96.17 Topic 284 13.93 Topic 260 16.56 Topic 285 58.89 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 3.99 Topic 286 3.01 Topic Number Topic 262 58.96 Topic 287 24.05 Topic 263 2.37 Topic 288 1.98 CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 276 to 300) Topic 264 11.56 Topic 289 55.88 1 Topic 265 27.16 Topic 290 41.45 humBG05t Difference (average precision) Topic 266 7.91 Topic 291 42.56 0.5 Topic 267 0.43 Topic 292 0.00 Topic 268 58.45 Topic 293 25.38 Topic 269 8.41 Topic 294 28.36 0 Topic 270 0.86 Topic 295 38.75 Topic 271 100.00 Topic 296 6.25 Topic 272 25.00 Topic 297 5.69 −0.5 Topic 273 5.77 Topic 298 3.96 Topic 274 14.08 Topic 299 0.26 −1 Topic 275 18.58 Topic 300 3.85 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.228 hummingbird humBG05td AH-Monolingual-BG Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Bulgarian Retrieved 50,000 RunType= automatic Relevant 778 QueryType= TD Relevant retrieved 685 Pooled= true CLEF 2005 AH−Monolingual−BG − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 57.74 humBG05td 90% 10 52.88 20 45.30 80% 30 36.26 70% 40 30.39 50 27.05 Average Precision 60% 60 18.79 50% 70 16.25 80 14.11 40% 90 9.36 30% 100 8.07 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 26.95 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−BG − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 30.00 humBG05td 90% 10 docs 26.00 15 docs 24.13 80% 20 docs 21.90 70% 30 docs 17.80 100 docs 9.00 60% R−Precision 200 docs 5.37 50% 500 docs 2.47 1000 docs 1.37 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 25.78 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 251 to 275) queries 1 humBG05td Topic 251 27.18 Topic 276 10.76 Difference (average precision) Topic 252 7.61 Topic 277 11.54 0.5 Topic 253 22.98 Topic 278 7.13 Topic 254 18.35 Topic 279 80.24 Topic 255 38.10 Topic 280 5.92 0 Topic 256 66.67 Topic 281 39.90 Topic 257 20.17 Topic 282 34.94 −0.5 Topic 258 25.00 Topic 283 40.24 Topic 259 70.51 Topic 284 13.59 Topic 260 31.34 Topic 285 68.06 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 17.71 Topic 286 16.09 Topic Number Topic 262 55.25 Topic 287 24.35 Topic 263 2.37 Topic 288 2.84 CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 276 to 300) Topic 264 16.67 Topic 289 55.56 1 Topic 265 26.38 Topic 290 41.02 humBG05td Difference (average precision) Topic 266 13.65 Topic 291 37.77 0.5 Topic 267 8.01 Topic 292 0.00 Topic 268 43.34 Topic 293 53.69 Topic 269 3.46 Topic 294 58.33 0 Topic 270 1.74 Topic 295 42.19 Topic 271 32.50 Topic 296 4.76 Topic 272 50.00 Topic 297 3.36 −0.5 Topic 273 18.80 Topic 298 11.92 Topic 274 32.33 Topic 299 3.91 −1 Topic 275 14.40 Topic 300 14.77 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.229 hummingbird humBG05tde AH-Monolingual-BG Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Bulgarian Retrieved 50,000 RunType= automatic Relevant 778 QueryType= TD Relevant retrieved 690 Pooled= true CLEF 2005 AH−Monolingual−BG − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 57.51 humBG05tde 90% 10 49.98 20 45.39 80% 30 40.19 70% 40 34.99 50 30.25 Average Precision 60% 60 22.69 50% 70 20.62 80 16.69 40% 90 12.03 30% 100 9.73 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 29.18 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−BG − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 29.20 humBG05tde 90% 10 docs 26.60 15 docs 23.87 80% 20 docs 21.50 70% 30 docs 18.40 100 docs 9.48 60% R−Precision 200 docs 5.63 50% 500 docs 2.60 1000 docs 1.38 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 27.45 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 251 to 275) queries 1 humBG05tde Topic 251 34.46 Topic 276 10.25 Difference (average precision) Topic 252 9.09 Topic 277 1.42 0.5 Topic 253 22.73 Topic 278 1.98 Topic 254 32.36 Topic 279 86.26 Topic 255 39.39 Topic 280 6.30 0 Topic 256 66.67 Topic 281 41.19 Topic 257 26.40 Topic 282 36.78 −0.5 Topic 258 16.67 Topic 283 42.10 Topic 259 68.52 Topic 284 12.40 Topic 260 44.37 Topic 285 66.67 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 20.35 Topic 286 16.18 Topic Number Topic 262 60.87 Topic 287 22.40 Topic 263 1.53 Topic 288 2.61 CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 276 to 300) Topic 264 17.46 Topic 289 61.11 1 Topic 265 40.20 Topic 290 43.20 humBG05tde Difference (average precision) Topic 266 5.53 Topic 291 38.44 0.5 Topic 267 10.15 Topic 292 0.00 Topic 268 39.97 Topic 293 61.01 Topic 269 2.37 Topic 294 64.46 0 Topic 270 2.72 Topic 295 40.40 Topic 271 32.50 Topic 296 6.67 Topic 272 100.00 Topic 297 1.87 −0.5 Topic 273 27.48 Topic 298 5.16 Topic 274 34.81 Topic 299 1.76 −1 Topic 275 16.51 Topic 300 15.15 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.230 jhu-apl aplmobgc AH-Monolingual-BG Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Bulgarian Retrieved 50,000 RunType= automatic Relevant 778 QueryType= TD Relevant retrieved 706 Pooled= true CLEF 2005 AH−Monolingual−BG − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 62.03 aplmobgc 90% 10 54.20 20 45.14 80% 30 38.54 70% 40 33.58 50 30.96 Average Precision 60% 60 25.67 50% 70 22.18 80 18.44 40% 90 14.81 30% 100 11.68 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 30.58 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−BG − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 33.60 aplmobgc 90% 10 docs 30.80 15 docs 28.13 80% 20 docs 24.70 70% 30 docs 20.20 100 docs 9.78 60% R−Precision 200 docs 5.76 50% 500 docs 2.65 1000 docs 1.41 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 30.05 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 251 to 275) queries 1 aplmobgc Topic 251 34.82 Topic 276 11.17 Difference (average precision) Topic 252 10.07 Topic 277 36.14 0.5 Topic 253 24.02 Topic 278 42.77 Topic 254 42.42 Topic 279 62.87 Topic 255 42.86 Topic 280 1.36 0 Topic 256 45.00 Topic 281 44.10 Topic 257 21.39 Topic 282 14.63 −0.5 Topic 258 100.00 Topic 283 72.13 Topic 259 54.10 Topic 284 9.56 Topic 260 37.89 Topic 285 31.67 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 41.47 Topic 286 13.01 Topic Number Topic 262 66.62 Topic 287 17.02 Topic 263 4.15 Topic 288 0.53 CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 276 to 300) Topic 264 27.35 Topic 289 64.29 1 Topic 265 33.01 Topic 290 67.68 aplmobgc Difference (average precision) Topic 266 7.73 Topic 291 52.75 0.5 Topic 267 38.24 Topic 292 0.00 Topic 268 39.03 Topic 293 35.98 Topic 269 11.10 Topic 294 79.76 0 Topic 270 3.17 Topic 295 13.80 Topic 271 33.33 Topic 296 2.00 Topic 272 20.00 Topic 297 14.97 −0.5 Topic 273 31.80 Topic 298 2.12 Topic 274 20.23 Topic 299 4.95 −1 Topic 275 20.40 Topic 300 23.38 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.231 jhu-apl aplmobgd AH-Monolingual-BG Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Bulgarian Retrieved 50,000 RunType= automatic Relevant 778 QueryType= TD Relevant retrieved 678 Pooled= true CLEF 2005 AH−Monolingual−BG − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 61.64 aplmobgd 90% 10 56.97 20 47.43 80% 30 42.35 70% 40 37.63 50 34.34 Average Precision 60% 60 25.90 50% 70 22.13 80 18.46 40% 90 14.32 30% 100 10.91 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 32.03 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−BG − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 36.40 aplmobgd 90% 10 docs 30.80 15 docs 27.87 80% 20 docs 24.70 70% 30 docs 20.07 100 docs 9.54 60% R−Precision 200 docs 5.72 50% 500 docs 2.54 1000 docs 1.36 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 30.38 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 251 to 275) queries 1 aplmobgd Topic 251 36.19 Topic 276 11.79 Difference (average precision) Topic 252 11.64 Topic 277 41.07 0.5 Topic 253 26.97 Topic 278 49.72 Topic 254 40.93 Topic 279 69.09 Topic 255 33.33 Topic 280 2.23 0 Topic 256 66.67 Topic 281 49.06 Topic 257 21.99 Topic 282 13.26 −0.5 Topic 258 100.00 Topic 283 71.14 Topic 259 56.66 Topic 284 9.20 Topic 260 35.19 Topic 285 47.09 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 45.19 Topic 286 13.52 Topic Number Topic 262 68.82 Topic 287 16.61 Topic 263 4.69 Topic 288 0.26 CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 276 to 300) Topic 264 29.04 Topic 289 64.29 1 Topic 265 25.81 Topic 290 70.26 aplmobgd Difference (average precision) Topic 266 8.89 Topic 291 53.11 0.5 Topic 267 39.42 Topic 292 0.00 Topic 268 38.10 Topic 293 37.44 Topic 269 8.65 Topic 294 78.85 0 Topic 270 3.22 Topic 295 0.98 Topic 271 58.33 Topic 296 1.72 Topic 272 16.67 Topic 297 11.34 −0.5 Topic 273 31.47 Topic 298 2.33 Topic 274 15.08 Topic 299 6.82 −1 Topic 275 29.62 Topic 300 27.98 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.232 jhu-apl aplmobge AH-Monolingual-BG Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Bulgarian Retrieved 50,000 RunType= automatic Relevant 778 QueryType= TD Relevant retrieved 699 Pooled= false CLEF 2005 AH−Monolingual−BG − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 56.43 aplmobge 90% 10 49.95 20 41.45 80% 30 34.68 70% 40 30.09 50 28.26 Average Precision 60% 60 23.20 50% 70 20.62 80 16.99 40% 90 13.06 30% 100 10.17 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 27.68 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−BG − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 35.20 aplmobge 90% 10 docs 30.40 15 docs 27.07 80% 20 docs 24.20 70% 30 docs 20.40 100 docs 9.82 60% R−Precision 200 docs 5.86 50% 500 docs 2.62 1000 docs 1.40 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 26.86 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 251 to 275) queries 1 aplmobge Topic 251 34.28 Topic 276 10.48 Difference (average precision) Topic 252 8.40 Topic 277 32.86 0.5 Topic 253 21.54 Topic 278 27.15 Topic 254 41.24 Topic 279 64.96 Topic 255 20.00 Topic 280 0.53 0 Topic 256 45.00 Topic 281 42.01 Topic 257 18.27 Topic 282 10.83 −0.5 Topic 258 33.33 Topic 283 72.35 Topic 259 54.82 Topic 284 9.92 Topic 260 42.49 Topic 285 32.42 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 41.35 Topic 286 12.63 Topic Number Topic 262 63.55 Topic 287 16.77 Topic 263 3.32 Topic 288 0.86 CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 276 to 300) Topic 264 26.25 Topic 289 39.29 1 Topic 265 38.67 Topic 290 65.75 aplmobge Difference (average precision) Topic 266 7.38 Topic 291 52.20 0.5 Topic 267 36.17 Topic 292 0.00 Topic 268 39.01 Topic 293 35.34 Topic 269 14.73 Topic 294 79.63 0 Topic 270 3.07 Topic 295 28.94 Topic 271 35.00 Topic 296 2.38 Topic 272 20.00 Topic 297 15.84 −0.5 Topic 273 31.09 Topic 298 1.94 Topic 274 21.69 Topic 299 3.57 −1 Topic 275 10.15 Topic 300 14.45 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.233 miracle BGHT AH-Monolingual-BG Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Bulgarian Retrieved 50,000 RunType= automatic Relevant 778 QueryType= TD Relevant retrieved 652 Pooled= false CLEF 2005 AH−Monolingual−BG − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 44.53 BGHT 90% 10 37.54 20 32.65 80% 30 26.51 70% 40 22.21 50 16.72 Average Precision 60% 60 10.92 50% 70 9.46 80 7.18 40% 90 4.52 30% 100 2.91 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 18.04 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−BG − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 20.40 BGHT 90% 10 docs 19.60 15 docs 17.33 80% 20 docs 16.90 70% 30 docs 15.40 100 docs 8.06 60% R−Precision 200 docs 5.00 50% 500 docs 2.37 1000 docs 1.30 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 18.39 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 251 to 275) queries 1 BGHT Topic 251 27.76 Topic 276 4.64 Difference (average precision) Topic 252 1.96 Topic 277 36.77 0.5 Topic 253 14.34 Topic 278 1.77 Topic 254 9.17 Topic 279 12.27 Topic 255 17.31 Topic 280 3.61 0 Topic 256 17.60 Topic 281 27.43 Topic 257 4.95 Topic 282 31.63 −0.5 Topic 258 3.12 Topic 283 43.72 Topic 259 57.49 Topic 284 13.81 Topic 260 27.30 Topic 285 35.71 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 22.72 Topic 286 4.12 Topic Number Topic 262 40.39 Topic 287 19.86 Topic 263 0.70 Topic 288 1.12 CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 276 to 300) Topic 264 15.52 Topic 289 55.56 1 Topic 265 20.59 Topic 290 32.40 BGHT Difference (average precision) Topic 266 6.01 Topic 291 36.54 0.5 Topic 267 14.16 Topic 292 0.00 Topic 268 47.57 Topic 293 43.03 Topic 269 2.62 Topic 294 33.29 0 Topic 270 1.39 Topic 295 49.94 Topic 271 3.88 Topic 296 3.85 Topic 272 5.26 Topic 297 7.80 −0.5 Topic 273 15.25 Topic 298 3.32 Topic 274 12.66 Topic 299 0.94 −1 Topic 275 5.36 Topic 300 3.71 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.234 miracle ST AH-Monolingual-BG Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Bulgarian Retrieved 50,000 RunType= automatic Relevant 778 QueryType= TD Relevant retrieved 696 Pooled= true CLEF 2005 AH−Monolingual−BG − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 59.24 ST 90% 10 52.88 20 44.35 80% 30 36.89 70% 40 32.24 50 27.09 Average Precision 60% 60 18.67 50% 70 16.04 80 12.95 40% 90 8.78 30% 100 6.59 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 26.76 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−BG − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 32.80 ST 90% 10 docs 27.00 15 docs 23.60 80% 20 docs 22.20 70% 30 docs 19.20 100 docs 9.70 60% R−Precision 200 docs 5.70 50% 500 docs 2.57 1000 docs 1.39 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 26.27 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 251 to 275) queries 1 ST Topic 251 37.57 Topic 276 9.41 Difference (average precision) Topic 252 6.35 Topic 277 35.30 0.5 Topic 253 27.15 Topic 278 10.03 Topic 254 18.29 Topic 279 79.01 Topic 255 22.22 Topic 280 10.69 0 Topic 256 61.11 Topic 281 40.19 Topic 257 21.79 Topic 282 35.60 −0.5 Topic 258 25.00 Topic 283 50.76 Topic 259 66.17 Topic 284 13.33 Topic 260 36.63 Topic 285 40.55 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 13.71 Topic 286 9.01 Topic Number Topic 262 55.92 Topic 287 24.33 Topic 263 2.69 Topic 288 3.36 CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 276 to 300) Topic 264 22.84 Topic 289 55.26 1 Topic 265 35.31 Topic 290 43.54 ST Difference (average precision) Topic 266 9.01 Topic 291 43.31 0.5 Topic 267 19.22 Topic 292 0.00 Topic 268 46.11 Topic 293 45.12 Topic 269 6.14 Topic 294 57.56 0 Topic 270 1.90 Topic 295 56.29 Topic 271 14.83 Topic 296 6.25 Topic 272 33.33 Topic 297 6.03 −0.5 Topic 273 28.78 Topic 298 6.85 Topic 274 9.13 Topic 299 4.92 −1 Topic 275 16.32 Topic 300 13.90 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.235 miracle r1SR AH-Monolingual-BG Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Bulgarian Retrieved 50,000 RunType= automatic Relevant 778 QueryType= TDN Relevant retrieved 606 Pooled= true CLEF 2005 AH−Monolingual−BG − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 54.45 r1SR 90% 10 46.78 20 37.69 80% 30 29.79 70% 40 25.28 50 22.00 Average Precision 60% 60 13.59 50% 70 11.11 80 7.25 40% 90 5.84 30% 100 3.93 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 21.91 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−BG − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 26.00 r1SR 90% 10 docs 22.60 15 docs 19.33 80% 20 docs 17.10 70% 30 docs 15.27 100 docs 7.84 60% R−Precision 200 docs 4.65 50% 500 docs 2.21 1000 docs 1.21 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 21.53 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 251 to 275) queries 1 r1SR Topic 251 24.45 Topic 276 9.37 Difference (average precision) Topic 252 1.47 Topic 277 0.02 0.5 Topic 253 16.46 Topic 278 0.10 Topic 254 40.68 Topic 279 60.17 Topic 255 34.02 Topic 280 38.87 0 Topic 256 75.00 Topic 281 16.59 Topic 257 24.92 Topic 282 15.45 −0.5 Topic 258 0.00 Topic 283 55.18 Topic 259 44.78 Topic 284 19.42 Topic 260 29.68 Topic 285 36.85 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 18.56 Topic 286 0.00 Topic Number Topic 262 31.97 Topic 287 22.21 Topic 263 1.69 Topic 288 14.18 CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 276 to 300) Topic 264 7.93 Topic 289 57.14 1 Topic 265 22.52 Topic 290 63.01 r1SR Difference (average precision) Topic 266 0.00 Topic 291 38.73 0.5 Topic 267 5.68 Topic 292 0.00 Topic 268 19.32 Topic 293 70.22 Topic 269 25.91 Topic 294 51.81 0 Topic 270 1.01 Topic 295 35.80 Topic 271 0.00 Topic 296 0.29 Topic 272 14.29 Topic 297 0.00 −0.5 Topic 273 23.89 Topic 298 0.36 Topic 274 0.38 Topic 299 0.09 −1 Topic 275 20.48 Topic 300 4.42 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.236 u.glasgow glabgtdn AH-Monolingual-BG Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Bulgarian Retrieved 50,000 RunType= automatic Relevant 778 QueryType= TDN Relevant retrieved 565 Pooled= true CLEF 2005 AH−Monolingual−BG − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 50.97 glabgtdn 90% 10 45.22 20 37.37 80% 30 30.17 70% 40 22.55 50 20.49 Average Precision 60% 60 14.87 50% 70 11.13 80 8.87 40% 90 6.84 30% 100 6.31 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 21.59 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−BG − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 26.80 glabgtdn 90% 10 docs 23.80 15 docs 20.80 80% 20 docs 18.20 70% 30 docs 14.60 100 docs 7.36 60% R−Precision 200 docs 4.18 50% 500 docs 2.02 1000 docs 1.13 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 19.71 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 251 to 275) queries 1 glabgtdn Topic 251 17.47 Topic 276 7.26 Difference (average precision) Topic 252 0.21 Topic 277 41.81 0.5 Topic 253 18.14 Topic 278 1.19 Topic 254 19.12 Topic 279 62.45 Topic 255 46.67 Topic 280 3.50 0 Topic 256 66.67 Topic 281 40.38 Topic 257 21.56 Topic 282 22.47 −0.5 Topic 258 50.00 Topic 283 40.64 Topic 259 53.02 Topic 284 0.26 Topic 260 9.90 Topic 285 58.73 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 14.23 Topic 286 5.00 Topic Number Topic 262 2.73 Topic 287 21.28 Topic 263 1.49 Topic 288 3.39 CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 276 to 300) Topic 264 12.96 Topic 289 11.86 1 Topic 265 26.83 Topic 290 38.56 glabgtdn Difference (average precision) Topic 266 5.97 Topic 291 38.72 0.5 Topic 267 7.32 Topic 292 0.00 Topic 268 71.83 Topic 293 44.77 Topic 269 0.80 Topic 294 34.37 0 Topic 270 0.81 Topic 295 40.06 Topic 271 8.12 Topic 296 50.00 Topic 272 8.33 Topic 297 6.02 −0.5 Topic 273 26.99 Topic 298 0.44 Topic 274 4.01 Topic 299 1.13 −1 Topic 275 5.15 Topic 300 4.71 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.237 u.glasgow glabgtdnqe AH-Monolingual-BG Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Bulgarian Retrieved 50,000 RunType= automatic Relevant 778 QueryType= TDN Relevant retrieved 643 Pooled= true CLEF 2005 AH−Monolingual−BG − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 48.27 glabgtdnqe 90% 10 43.01 20 38.83 80% 30 33.24 70% 40 28.87 50 25.71 Average Precision 60% 60 19.73 50% 70 14.81 80 11.50 40% 90 8.73 30% 100 6.80 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 24.12 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−BG − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 30.40 glabgtdnqe 90% 10 docs 25.80 15 docs 22.00 80% 20 docs 20.40 70% 30 docs 17.07 100 docs 8.94 60% R−Precision 200 docs 5.29 50% 500 docs 2.42 1000 docs 1.29 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 22.13 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 251 to 275) queries 1 glabgtdnqe Topic 251 47.47 Topic 276 8.46 Difference (average precision) Topic 252 1.26 Topic 277 59.26 0.5 Topic 253 19.14 Topic 278 0.98 Topic 254 31.18 Topic 279 43.71 Topic 255 55.56 Topic 280 5.90 0 Topic 256 70.00 Topic 281 30.36 Topic 257 31.12 Topic 282 30.22 −0.5 Topic 258 33.33 Topic 283 64.06 Topic 259 62.33 Topic 284 2.49 Topic 260 13.14 Topic 285 26.67 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 28.94 Topic 286 6.46 Topic Number Topic 262 3.91 Topic 287 19.15 Topic 263 2.60 Topic 288 2.39 CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 276 to 300) Topic 264 12.80 Topic 289 15.26 1 Topic 265 27.88 Topic 290 55.21 glabgtdnqe Difference (average precision) Topic 266 12.62 Topic 291 43.77 0.5 Topic 267 9.31 Topic 292 0.00 Topic 268 68.16 Topic 293 30.65 Topic 269 0.47 Topic 294 58.40 0 Topic 270 1.34 Topic 295 61.95 Topic 271 8.52 Topic 296 33.33 Topic 272 11.11 Topic 297 4.96 −0.5 Topic 273 32.38 Topic 298 0.80 Topic 274 5.38 Topic 299 0.44 −1 Topic 275 5.74 Topic 300 5.54 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.238 u.glasgow glabgtdqe AH-Monolingual-BG Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Bulgarian Retrieved 50,000 RunType= automatic Relevant 778 QueryType= TD Relevant retrieved 627 Pooled= false CLEF 2005 AH−Monolingual−BG − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 51.91 glabgtdqe 90% 10 48.03 20 37.53 80% 30 32.19 70% 40 29.97 50 26.91 Average Precision 60% 60 19.78 50% 70 16.48 80 13.92 40% 90 9.75 30% 100 7.95 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 25.14 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−BG − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 31.20 glabgtdqe 90% 10 docs 26.60 15 docs 22.93 80% 20 docs 20.30 70% 30 docs 17.40 100 docs 8.80 60% R−Precision 200 docs 5.17 50% 500 docs 2.31 1000 docs 1.25 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 24.33 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 251 to 275) queries 1 glabgtdqe Topic 251 46.38 Topic 276 10.36 Difference (average precision) Topic 252 0.10 Topic 277 27.62 0.5 Topic 253 13.34 Topic 278 1.26 Topic 254 23.24 Topic 279 56.40 Topic 255 24.44 Topic 280 4.74 0 Topic 256 70.00 Topic 281 45.11 Topic 257 3.01 Topic 282 23.81 −0.5 Topic 258 100.00 Topic 283 61.35 Topic 259 61.13 Topic 284 0.46 Topic 260 41.30 Topic 285 33.13 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 23.95 Topic 286 5.36 Topic Number Topic 262 4.43 Topic 287 19.30 Topic 263 3.47 Topic 288 1.45 CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 276 to 300) Topic 264 20.99 Topic 289 26.67 1 Topic 265 31.75 Topic 290 58.16 glabgtdqe Difference (average precision) Topic 266 15.97 Topic 291 47.15 0.5 Topic 267 10.44 Topic 292 0.00 Topic 268 61.57 Topic 293 43.45 Topic 269 0.03 Topic 294 57.43 0 Topic 270 1.55 Topic 295 58.04 Topic 271 10.05 Topic 296 8.33 Topic 272 14.29 Topic 297 24.51 −0.5 Topic 273 30.76 Topic 298 0.17 Topic 274 5.28 Topic 299 0.17 −1 Topic 275 5.30 Topic 300 20.03 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.239 unine UniNEbg1 AH-Monolingual-BG Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Bulgarian Retrieved 50,000 RunType= automatic Relevant 778 QueryType= TD Relevant retrieved 718 Pooled= true CLEF 2005 AH−Monolingual−BG − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 51.86 UniNEbg1 90% 10 46.98 20 41.41 80% 30 35.52 70% 40 33.37 50 30.04 Average Precision 60% 60 23.11 50% 70 21.03 80 17.43 40% 90 13.41 30% 100 9.08 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 27.82 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−BG − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 32.00 UniNEbg1 90% 10 docs 27.60 15 docs 24.40 80% 20 docs 21.90 70% 30 docs 19.00 100 docs 10.16 60% R−Precision 200 docs 6.17 50% 500 docs 2.77 1000 docs 1.44 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 25.49 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 251 to 275) queries 1 UniNEbg1 Topic 251 43.14 Topic 276 10.32 Difference (average precision) Topic 252 3.16 Topic 277 44.97 0.5 Topic 253 20.83 Topic 278 24.97 Topic 254 33.12 Topic 279 93.33 Topic 255 13.26 Topic 280 10.46 0 Topic 256 61.11 Topic 281 36.53 Topic 257 13.59 Topic 282 17.83 −0.5 Topic 258 50.00 Topic 283 54.31 Topic 259 83.57 Topic 284 10.74 Topic 260 36.02 Topic 285 40.28 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 14.38 Topic 286 8.67 Topic Number Topic 262 67.13 Topic 287 21.81 Topic 263 1.73 Topic 288 2.58 CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 276 to 300) Topic 264 17.15 Topic 289 57.14 1 Topic 265 35.10 Topic 290 55.25 UniNEbg1 Difference (average precision) Topic 266 5.97 Topic 291 43.01 0.5 Topic 267 10.79 Topic 292 0.00 Topic 268 37.69 Topic 293 27.81 Topic 269 5.75 Topic 294 63.67 0 Topic 270 3.13 Topic 295 62.69 Topic 271 15.26 Topic 296 3.03 Topic 272 33.33 Topic 297 0.82 −0.5 Topic 273 38.98 Topic 298 4.27 Topic 274 13.29 Topic 299 0.83 −1 Topic 275 21.80 Topic 300 16.58 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.240 unine UniNEbg2 AH-Monolingual-BG Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Bulgarian Retrieved 50,000 RunType= automatic Relevant 778 QueryType= TD Relevant retrieved 718 Pooled= true CLEF 2005 AH−Monolingual−BG − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 46.98 UniNEbg2 90% 10 44.10 20 39.20 80% 30 34.92 70% 40 31.69 50 28.51 Average Precision 60% 60 21.42 50% 70 20.12 80 16.13 40% 90 11.66 30% 100 8.38 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 26.22 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−BG − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 29.20 UniNEbg2 90% 10 docs 26.40 15 docs 23.87 80% 20 docs 22.40 70% 30 docs 19.60 100 docs 9.78 60% R−Precision 200 docs 5.83 50% 500 docs 2.68 1000 docs 1.44 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 25.63 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 251 to 275) queries 1 UniNEbg2 Topic 251 37.28 Topic 276 10.08 Difference (average precision) Topic 252 1.83 Topic 277 23.98 0.5 Topic 253 23.19 Topic 278 5.18 Topic 254 33.20 Topic 279 92.42 Topic 255 9.57 Topic 280 6.85 0 Topic 256 66.67 Topic 281 34.40 Topic 257 19.25 Topic 282 13.36 −0.5 Topic 258 50.00 Topic 283 55.01 Topic 259 70.42 Topic 284 8.43 Topic 260 40.58 Topic 285 29.44 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 19.29 Topic 286 9.38 Topic Number Topic 262 67.19 Topic 287 22.01 Topic 263 2.88 Topic 288 3.00 CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 276 to 300) Topic 264 13.74 Topic 289 56.25 1 Topic 265 28.25 Topic 290 73.10 UniNEbg2 Difference (average precision) Topic 266 4.12 Topic 291 43.81 0.5 Topic 267 9.53 Topic 292 0.00 Topic 268 35.86 Topic 293 35.60 Topic 269 3.76 Topic 294 70.72 0 Topic 270 2.98 Topic 295 49.78 Topic 271 11.81 Topic 296 1.35 Topic 272 33.33 Topic 297 0.47 −0.5 Topic 273 37.48 Topic 298 5.11 Topic 274 4.22 Topic 299 1.76 −1 Topic 275 12.29 Topic 300 20.77 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.241 unine UniNEbg3 AH-Monolingual-BG Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Bulgarian Retrieved 50,000 RunType= automatic Relevant 778 QueryType= TD Relevant retrieved 720 Pooled= false CLEF 2005 AH−Monolingual−BG − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 54.85 UniNEbg3 90% 10 47.38 20 42.16 80% 30 37.17 70% 40 33.64 50 31.22 Average Precision 60% 60 24.31 50% 70 21.07 80 16.27 40% 90 13.06 30% 100 8.84 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 28.39 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−BG − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 33.20 UniNEbg3 90% 10 docs 28.40 15 docs 25.07 80% 20 docs 23.30 70% 30 docs 19.87 100 docs 10.26 60% R−Precision 200 docs 6.22 50% 500 docs 2.74 1000 docs 1.44 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 25.93 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 251 to 275) queries 1 UniNEbg3 Topic 251 47.86 Topic 276 10.31 Difference (average precision) Topic 252 2.76 Topic 277 60.29 0.5 Topic 253 25.09 Topic 278 36.80 Topic 254 38.19 Topic 279 91.07 Topic 255 6.92 Topic 280 8.26 0 Topic 256 61.11 Topic 281 30.55 Topic 257 20.23 Topic 282 13.43 −0.5 Topic 258 50.00 Topic 283 65.58 Topic 259 83.39 Topic 284 13.30 Topic 260 30.78 Topic 285 30.69 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 13.70 Topic 286 8.03 Topic Number Topic 262 67.25 Topic 287 21.74 Topic 263 1.58 Topic 288 1.85 CLEF 2005 AH−Monolingual−BG − Comparison to median by topic (topics 276 to 300) Topic 264 16.75 Topic 289 53.45 1 Topic 265 32.32 Topic 290 55.51 UniNEbg3 Difference (average precision) Topic 266 6.74 Topic 291 42.54 0.5 Topic 267 11.76 Topic 292 0.00 Topic 268 37.20 Topic 293 19.82 Topic 269 6.80 Topic 294 63.31 0 Topic 270 4.30 Topic 295 68.11 Topic 271 12.69 Topic 296 1.03 Topic 272 25.00 Topic 297 0.94 −0.5 Topic 273 41.26 Topic 298 4.24 Topic 274 15.48 Topic 299 0.24 −1 Topic 275 28.38 Topic 300 30.88 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.242 alicante IRn-fr-fexp AH-Monolingual-FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual French Retrieved 50,000 RunType= automatic Relevant 2,537 QueryType= TD Relevant retrieved 2,119 Pooled= false CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 66.81 IRn−fr−fexp 90% 10 54.19 20 49.21 80% 30 44.35 70% 40 41.44 50 38.13 Average Precision 60% 60 33.35 50% 70 26.61 80 21.33 40% 90 13.88 30% 100 3.45 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 34.85 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 51.60 IRn−fr−fexp 90% 10 docs 46.60 15 docs 44.80 80% 20 docs 42.30 70% 30 docs 37.93 100 docs 24.38 60% R−Precision 200 docs 15.93 50% 500 docs 7.77 1000 docs 4.24 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 35.14 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275) queries 1 IRn−fr−fexp Topic 251 10.52 Topic 276 25.29 Difference (average precision) Topic 252 12.10 Topic 277 0.28 0.5 Topic 253 48.37 Topic 278 52.45 Topic 254 58.39 Topic 279 11.89 Topic 255 0.85 Topic 280 33.59 0 Topic 256 75.92 Topic 281 46.87 Topic 257 13.01 Topic 282 1.07 −0.5 Topic 258 17.42 Topic 283 77.42 Topic 259 2.84 Topic 284 64.52 Topic 260 54.69 Topic 285 62.07 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.00 Topic 286 8.28 Topic Number Topic 262 15.17 Topic 287 5.40 Topic 263 3.21 Topic 288 6.36 CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300) Topic 264 73.67 Topic 289 73.46 1 Topic 265 33.75 Topic 290 55.37 IRn−fr−fexp Difference (average precision) Topic 266 0.32 Topic 291 37.06 0.5 Topic 267 25.85 Topic 292 2.37 Topic 268 68.97 Topic 293 72.91 Topic 269 26.04 Topic 294 58.86 0 Topic 270 67.77 Topic 295 38.92 Topic 271 90.13 Topic 296 27.04 Topic 272 15.23 Topic 297 44.11 −0.5 Topic 273 12.74 Topic 298 56.23 Topic 274 76.84 Topic 299 0.22 −1 Topic 275 58.44 Topic 300 18.22 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.243 alicante IRn-fr-vexp AH-Monolingual-FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual French Retrieved 50,000 RunType= automatic Relevant 2,537 QueryType= TD Relevant retrieved 2,145 Pooled= true CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 70.85 IRn−fr−vexp 90% 10 56.44 20 49.43 80% 30 45.96 70% 40 41.29 50 38.74 Average Precision 60% 60 33.54 50% 70 27.75 80 22.10 40% 90 14.04 30% 100 3.29 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 35.90 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 53.20 IRn−fr−vexp 90% 10 docs 45.80 15 docs 45.33 80% 20 docs 42.70 70% 30 docs 38.73 100 docs 25.26 60% R−Precision 200 docs 16.10 50% 500 docs 7.90 1000 docs 4.29 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 36.15 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275) queries 1 IRn−fr−vexp Topic 251 11.18 Topic 276 19.41 Difference (average precision) Topic 252 11.86 Topic 277 0.17 0.5 Topic 253 53.85 Topic 278 47.90 Topic 254 63.31 Topic 279 9.60 Topic 255 2.63 Topic 280 35.71 0 Topic 256 79.74 Topic 281 50.38 Topic 257 14.37 Topic 282 0.95 −0.5 Topic 258 12.14 Topic 283 77.11 Topic 259 1.91 Topic 284 70.49 Topic 260 58.46 Topic 285 58.09 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.00 Topic 286 28.10 Topic Number Topic 262 14.43 Topic 287 9.10 Topic 263 3.41 Topic 288 8.28 CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300) Topic 264 80.28 Topic 289 75.87 1 Topic 265 42.40 Topic 290 53.72 IRn−fr−vexp Difference (average precision) Topic 266 0.33 Topic 291 37.93 0.5 Topic 267 26.20 Topic 292 4.89 Topic 268 62.44 Topic 293 75.99 Topic 269 22.69 Topic 294 61.45 0 Topic 270 66.92 Topic 295 43.57 Topic 271 87.57 Topic 296 24.41 Topic 272 19.42 Topic 297 45.22 −0.5 Topic 273 14.32 Topic 298 50.53 Topic 274 80.96 Topic 299 0.21 −1 Topic 275 60.18 Topic 300 15.08 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.244 alicante IRn-fr-vnexp AH-Monolingual-FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual French Retrieved 50,000 RunType= automatic Relevant 2,537 QueryType= TD Relevant retrieved 2,022 Pooled= false CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 63.64 IRn−fr−vnexp 90% 10 51.89 20 45.07 80% 30 41.56 70% 40 37.25 50 32.57 Average Precision 60% 60 27.41 50% 70 21.13 80 15.83 40% 90 11.97 30% 100 3.15 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 30.71 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 48.00 IRn−fr−vnexp 90% 10 docs 42.20 15 docs 41.20 80% 20 docs 38.50 70% 30 docs 34.80 100 docs 21.84 60% R−Precision 200 docs 14.38 50% 500 docs 7.23 1000 docs 4.04 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 32.88 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275) queries 1 IRn−fr−vnexp Topic 251 7.28 Topic 276 18.39 Difference (average precision) Topic 252 7.71 Topic 277 0.01 0.5 Topic 253 38.15 Topic 278 43.73 Topic 254 53.47 Topic 279 8.81 Topic 255 1.11 Topic 280 31.94 0 Topic 256 77.68 Topic 281 32.34 Topic 257 13.31 Topic 282 2.27 −0.5 Topic 258 9.11 Topic 283 77.34 Topic 259 1.02 Topic 284 61.87 Topic 260 36.05 Topic 285 60.17 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.04 Topic 286 18.42 Topic Number Topic 262 21.64 Topic 287 4.46 Topic 263 4.03 Topic 288 4.95 CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300) Topic 264 75.30 Topic 289 67.25 1 Topic 265 31.02 Topic 290 32.74 IRn−fr−vnexp Difference (average precision) Topic 266 1.71 Topic 291 28.89 0.5 Topic 267 26.89 Topic 292 3.43 Topic 268 70.35 Topic 293 71.36 Topic 269 16.30 Topic 294 63.45 0 Topic 270 33.74 Topic 295 36.38 Topic 271 90.59 Topic 296 24.82 Topic 272 12.77 Topic 297 44.95 −0.5 Topic 273 6.11 Topic 298 38.20 Topic 274 65.95 Topic 299 0.43 −1 Topic 275 42.60 Topic 300 14.95 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.245 clips CLIPS05FR0 AH-Monolingual-FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual French Retrieved 50,000 RunType= automatic Relevant 2,537 QueryType= TD Relevant retrieved 1,649 Pooled= false CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 63.29 CLIPS05FR0 90% 10 43.77 20 33.77 80% 30 30.20 70% 40 25.46 50 19.76 Average Precision 60% 60 14.11 50% 70 11.90 80 8.60 40% 90 4.77 30% 100 2.10 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 21.56 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 38.00 CLIPS05FR0 90% 10 docs 35.20 15 docs 34.13 80% 20 docs 32.10 70% 30 docs 28.07 100 docs 16.10 60% R−Precision 200 docs 10.92 50% 500 docs 5.74 1000 docs 3.30 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 23.28 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275) queries 1 CLIPS05FR0 Topic 251 5.44 Topic 276 12.18 Difference (average precision) Topic 252 1.26 Topic 277 0.46 0.5 Topic 253 29.23 Topic 278 27.03 Topic 254 32.15 Topic 279 6.71 Topic 255 0.69 Topic 280 0.97 0 Topic 256 52.93 Topic 281 36.11 Topic 257 21.37 Topic 282 0.73 −0.5 Topic 258 26.79 Topic 283 73.20 Topic 259 1.00 Topic 284 46.56 Topic 260 41.36 Topic 285 23.18 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.00 Topic 286 6.67 Topic Number Topic 262 35.03 Topic 287 0.90 Topic 263 9.87 Topic 288 9.57 CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300) Topic 264 66.47 Topic 289 16.99 1 Topic 265 27.07 Topic 290 20.60 CLIPS05FR0 Difference (average precision) Topic 266 3.62 Topic 291 7.59 0.5 Topic 267 3.14 Topic 292 7.45 Topic 268 48.37 Topic 293 30.56 Topic 269 8.92 Topic 294 60.76 0 Topic 270 32.97 Topic 295 7.62 Topic 271 79.60 Topic 296 7.50 Topic 272 26.17 Topic 297 37.86 −0.5 Topic 273 2.20 Topic 298 29.72 Topic 274 14.01 Topic 299 0.12 −1 Topic 275 27.81 Topic 300 9.61 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.246 clips CLIPS05FR1 AH-Monolingual-FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual French Retrieved 50,000 RunType= automatic Relevant 2,537 QueryType= TDN Relevant retrieved 1,235 Pooled= true CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 57.90 CLIPS05FR1 90% 10 40.74 20 26.09 80% 30 18.35 70% 40 14.23 50 10.45 Average Precision 60% 60 5.04 50% 70 2.45 80 1.36 40% 90 0.52 30% 100 0.24 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 14.11 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 36.40 CLIPS05FR1 90% 10 docs 32.40 15 docs 29.33 80% 20 docs 27.80 70% 30 docs 24.47 100 docs 13.68 60% R−Precision 200 docs 8.54 50% 500 docs 4.43 1000 docs 2.47 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 19.38 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275) queries 1 CLIPS05FR1 Topic 251 10.53 Topic 276 8.64 Difference (average precision) Topic 252 9.46 Topic 277 5.63 0.5 Topic 253 27.45 Topic 278 13.79 Topic 254 29.43 Topic 279 6.26 Topic 255 0.00 Topic 280 0.98 0 Topic 256 35.98 Topic 281 41.02 Topic 257 6.98 Topic 282 0.76 −0.5 Topic 258 0.37 Topic 283 52.43 Topic 259 0.50 Topic 284 26.37 Topic 260 8.56 Topic 285 20.32 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.42 Topic 286 18.80 Topic Number Topic 262 31.31 Topic 287 9.91 Topic 263 6.87 Topic 288 21.43 CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300) Topic 264 21.29 Topic 289 2.34 1 Topic 265 24.75 Topic 290 5.93 CLIPS05FR1 Difference (average precision) Topic 266 0.06 Topic 291 2.98 0.5 Topic 267 3.34 Topic 292 7.82 Topic 268 17.20 Topic 293 23.91 Topic 269 9.55 Topic 294 51.80 0 Topic 270 15.26 Topic 295 9.68 Topic 271 43.78 Topic 296 2.95 Topic 272 8.72 Topic 297 7.24 −0.5 Topic 273 4.56 Topic 298 19.83 Topic 274 2.25 Topic 299 0.72 −1 Topic 275 19.96 Topic 300 5.39 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.247 clips CLIPS05FR2 AH-Monolingual-FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual French Retrieved 50,000 RunType= automatic Relevant 2,537 QueryType= TDN Relevant retrieved 1,425 Pooled= false CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 54.45 CLIPS05FR2 90% 10 34.04 20 22.57 80% 30 16.47 70% 40 12.11 50 9.44 Average Precision 60% 60 6.53 50% 70 4.72 80 2.70 40% 90 1.23 30% 100 1.07 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 13.07 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 30.40 CLIPS05FR2 90% 10 docs 26.80 15 docs 25.20 80% 20 docs 23.40 70% 30 docs 20.33 100 docs 11.96 60% R−Precision 200 docs 8.32 50% 500 docs 4.66 1000 docs 2.85 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 17.06 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275) queries 1 CLIPS05FR2 Topic 251 7.20 Topic 276 1.78 Difference (average precision) Topic 252 24.24 Topic 277 3.78 0.5 Topic 253 20.73 Topic 278 5.16 Topic 254 17.59 Topic 279 0.65 Topic 255 0.23 Topic 280 2.73 0 Topic 256 57.94 Topic 281 23.05 Topic 257 19.89 Topic 282 0.65 −0.5 Topic 258 0.00 Topic 283 18.93 Topic 259 1.14 Topic 284 40.76 Topic 260 25.06 Topic 285 9.24 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 18.33 Topic 286 5.27 Topic Number Topic 262 0.11 Topic 287 12.65 Topic 263 0.48 Topic 288 3.99 CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300) Topic 264 28.45 Topic 289 22.80 1 Topic 265 19.73 Topic 290 0.59 CLIPS05FR2 Difference (average precision) Topic 266 0.12 Topic 291 0.55 0.5 Topic 267 15.95 Topic 292 8.69 Topic 268 35.61 Topic 293 2.02 Topic 269 22.50 Topic 294 23.27 0 Topic 270 3.31 Topic 295 10.17 Topic 271 8.49 Topic 296 19.91 Topic 272 14.25 Topic 297 13.50 −0.5 Topic 273 6.99 Topic 298 8.36 Topic 274 22.82 Topic 299 1.97 −1 Topic 275 41.50 Topic 300 0.16 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.248 cocri RIMfuzzET020 AH-Monolingual-FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual French Retrieved 47,850 RunType= manual Relevant 2,537 QueryType= T Relevant retrieved 1,533 Pooled= false CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 57.33 RIMfuzzET020 90% 10 44.20 20 32.69 80% 30 25.57 70% 40 21.36 50 18.87 Average Precision 60% 60 14.59 50% 70 11.31 80 7.79 40% 90 4.42 30% 100 1.21 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 19.60 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 35.20 RIMfuzzET020 90% 10 docs 31.40 15 docs 30.13 80% 20 docs 29.50 70% 30 docs 28.07 100 docs 16.60 60% R−Precision 200 docs 10.89 50% 500 docs 5.58 1000 docs 3.07 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 23.64 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275) queries 1 RIMfuzzET020 Topic 251 10.66 Topic 276 5.56 Difference (average precision) Topic 252 9.00 Topic 277 12.23 0.5 Topic 253 37.39 Topic 278 18.84 Topic 254 14.46 Topic 279 4.97 Topic 255 1.39 Topic 280 0.44 0 Topic 256 2.62 Topic 281 14.48 Topic 257 19.65 Topic 282 0.03 −0.5 Topic 258 8.85 Topic 283 64.94 Topic 259 0.01 Topic 284 0.92 Topic 260 30.23 Topic 285 7.03 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.00 Topic 286 3.85 Topic Number Topic 262 28.85 Topic 287 16.09 Topic 263 7.14 Topic 288 6.55 CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300) Topic 264 43.82 Topic 289 67.61 1 Topic 265 28.94 Topic 290 25.81 RIMfuzzET020 Difference (average precision) Topic 266 22.89 Topic 291 21.09 0.5 Topic 267 44.55 Topic 292 2.81 Topic 268 22.05 Topic 293 62.48 Topic 269 7.47 Topic 294 14.72 0 Topic 270 52.52 Topic 295 46.18 Topic 271 54.37 Topic 296 25.66 Topic 272 4.79 Topic 297 15.67 −0.5 Topic 273 1.25 Topic 298 1.47 Topic 274 33.01 Topic 299 0.04 −1 Topic 275 44.37 Topic 300 10.07 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.249 cocri RIMfuzzET050 AH-Monolingual-FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual French Retrieved 47,850 RunType= manual Relevant 2,537 QueryType= T Relevant retrieved 1,533 Pooled= false CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 59.27 RIMfuzzET050 90% 10 43.96 20 32.48 80% 30 25.71 70% 40 21.19 50 18.65 Average Precision 60% 60 14.40 50% 70 11.19 80 7.91 40% 90 4.42 30% 100 1.21 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 19.62 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 36.40 RIMfuzzET050 90% 10 docs 32.80 15 docs 30.40 80% 20 docs 29.20 70% 30 docs 27.73 100 docs 16.62 60% R−Precision 200 docs 10.89 50% 500 docs 5.58 1000 docs 3.07 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 23.40 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275) queries 1 RIMfuzzET050 Topic 251 12.01 Topic 276 5.56 Difference (average precision) Topic 252 9.00 Topic 277 12.23 0.5 Topic 253 37.39 Topic 278 18.84 Topic 254 14.46 Topic 279 3.59 Topic 255 1.37 Topic 280 0.63 0 Topic 256 2.62 Topic 281 13.22 Topic 257 19.65 Topic 282 0.03 −0.5 Topic 258 8.85 Topic 283 64.28 Topic 259 0.01 Topic 284 0.92 Topic 260 30.56 Topic 285 7.03 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.00 Topic 286 3.48 Topic Number Topic 262 28.85 Topic 287 16.09 Topic 263 7.14 Topic 288 6.55 CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300) Topic 264 45.44 Topic 289 68.61 1 Topic 265 27.93 Topic 290 25.81 RIMfuzzET050 Difference (average precision) Topic 266 22.89 Topic 291 21.09 0.5 Topic 267 44.55 Topic 292 2.48 Topic 268 22.05 Topic 293 62.53 Topic 269 7.45 Topic 294 14.72 0 Topic 270 53.64 Topic 295 46.39 Topic 271 54.58 Topic 296 25.66 Topic 272 4.32 Topic 297 15.67 −0.5 Topic 273 2.07 Topic 298 1.53 Topic 274 33.01 Topic 299 0.04 −1 Topic 275 44.37 Topic 300 10.03 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.250 cocri RIMfuzzLemme050 AH-Monolingual-FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual French Retrieved 48,829 RunType= manual Relevant 2,537 QueryType= T Relevant retrieved 1,907 Pooled= true CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 68.19 RIMfuzzLemme050 90% 10 48.47 20 40.92 80% 30 32.93 70% 40 27.89 50 21.48 Average Precision 60% 60 18.20 50% 70 14.47 80 10.18 40% 90 6.01 30% 100 1.31 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 24.35 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 40.00 RIMfuzzLemme050 90% 10 docs 37.60 15 docs 35.07 80% 20 docs 34.50 70% 30 docs 30.13 100 docs 18.84 60% R−Precision 200 docs 12.74 50% 500 docs 6.78 1000 docs 3.81 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 27.14 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275) queries 1 RIMfuzzLemme050 Topic 251 11.88 Topic 276 6.75 Difference (average precision) Topic 252 9.61 Topic 277 11.83 0.5 Topic 253 22.51 Topic 278 24.12 Topic 254 44.62 Topic 279 7.73 Topic 255 1.20 Topic 280 8.89 0 Topic 256 40.67 Topic 281 13.22 Topic 257 14.31 Topic 282 0.29 −0.5 Topic 258 1.60 Topic 283 66.17 Topic 259 0.06 Topic 284 41.34 Topic 260 27.39 Topic 285 36.28 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.00 Topic 286 7.02 Topic Number Topic 262 39.59 Topic 287 24.44 Topic 263 7.96 Topic 288 2.96 CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300) Topic 264 56.92 Topic 289 73.37 1 Topic 265 22.60 Topic 290 12.38 RIMfuzzLemme050 Difference (average precision) Topic 266 24.55 Topic 291 23.86 0.5 Topic 267 24.64 Topic 292 3.82 Topic 268 29.57 Topic 293 64.07 Topic 269 14.47 Topic 294 20.44 0 Topic 270 53.86 Topic 295 46.39 Topic 271 86.45 Topic 296 11.89 Topic 272 2.03 Topic 297 42.25 −0.5 Topic 273 1.86 Topic 298 22.63 Topic 274 47.33 Topic 299 0.03 −1 Topic 275 27.49 Topic 300 32.15 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.251 cocri RIMfuzzLemme080 AH-Monolingual-FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual French Retrieved 48,829 RunType= manual Relevant 2,537 QueryType= T Relevant retrieved 1,908 Pooled= false CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 70.44 RIMfuzzLemme080 90% 10 48.51 20 41.18 80% 30 32.79 70% 40 27.51 50 21.65 Average Precision 60% 60 18.38 50% 70 14.47 80 10.18 40% 90 6.23 30% 100 1.30 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 24.68 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 42.80 RIMfuzzLemme080 90% 10 docs 38.60 15 docs 35.73 80% 20 docs 34.80 70% 30 docs 30.93 100 docs 19.02 60% R−Precision 200 docs 12.67 50% 500 docs 6.79 1000 docs 3.82 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 27.20 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275) queries 1 RIMfuzzLemme080 Topic 251 11.74 Topic 276 10.18 Difference (average precision) Topic 252 9.40 Topic 277 11.83 0.5 Topic 253 22.51 Topic 278 23.20 Topic 254 44.40 Topic 279 8.33 Topic 255 1.20 Topic 280 8.76 0 Topic 256 40.67 Topic 281 13.37 Topic 257 14.31 Topic 282 0.28 −0.5 Topic 258 1.60 Topic 283 68.80 Topic 259 0.06 Topic 284 40.53 Topic 260 29.64 Topic 285 37.02 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.00 Topic 286 7.11 Topic Number Topic 262 37.45 Topic 287 25.46 Topic 263 7.96 Topic 288 4.34 CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300) Topic 264 57.04 Topic 289 74.08 1 Topic 265 22.60 Topic 290 12.29 RIMfuzzLemme080 Difference (average precision) Topic 266 24.55 Topic 291 25.53 0.5 Topic 267 24.64 Topic 292 5.51 Topic 268 29.57 Topic 293 63.97 Topic 269 13.77 Topic 294 18.49 0 Topic 270 53.86 Topic 295 47.58 Topic 271 88.68 Topic 296 11.89 Topic 272 1.98 Topic 297 44.31 −0.5 Topic 273 1.86 Topic 298 23.45 Topic 274 47.33 Topic 299 0.03 −1 Topic 275 27.78 Topic 300 32.91 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.252 cocri RIMfuzzTD050 AH-Monolingual-FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual French Retrieved 50,000 RunType= manual Relevant 2,537 QueryType= TD Relevant retrieved 1,897 Pooled= false CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 62.16 RIMfuzzTD050 90% 10 46.49 20 37.60 80% 30 31.81 70% 40 26.15 50 22.82 Average Precision 60% 60 19.18 50% 70 14.89 80 9.84 40% 90 5.54 30% 100 1.69 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 23.70 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 44.80 RIMfuzzTD050 90% 10 docs 39.00 15 docs 35.60 80% 20 docs 34.30 70% 30 docs 30.00 100 docs 18.74 60% R−Precision 200 docs 12.82 50% 500 docs 6.48 1000 docs 3.79 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 26.19 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275) queries 1 RIMfuzzTD050 Topic 251 18.96 Topic 276 14.58 Difference (average precision) Topic 252 4.83 Topic 277 12.44 0.5 Topic 253 27.57 Topic 278 14.55 Topic 254 16.92 Topic 279 5.08 Topic 255 1.23 Topic 280 0.14 0 Topic 256 75.78 Topic 281 28.94 Topic 257 22.91 Topic 282 5.12 −0.5 Topic 258 13.89 Topic 283 40.88 Topic 259 12.38 Topic 284 47.43 Topic 260 46.30 Topic 285 28.49 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.10 Topic 286 7.59 Topic Number Topic 262 1.54 Topic 287 27.29 Topic 263 8.90 Topic 288 5.79 CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300) Topic 264 49.58 Topic 289 73.95 1 Topic 265 28.87 Topic 290 11.96 RIMfuzzTD050 Difference (average precision) Topic 266 7.19 Topic 291 48.10 0.5 Topic 267 40.69 Topic 292 2.30 Topic 268 10.35 Topic 293 63.99 Topic 269 0.91 Topic 294 14.61 0 Topic 270 38.65 Topic 295 35.18 Topic 271 49.33 Topic 296 61.25 Topic 272 16.94 Topic 297 31.57 −0.5 Topic 273 5.36 Topic 298 20.70 Topic 274 33.57 Topic 299 2.65 −1 Topic 275 25.08 Topic 300 22.35 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.253 hildesheim UHIFR1 AH-Monolingual-FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual French Retrieved 50,000 RunType= automatic Relevant 2,537 QueryType= TD Relevant retrieved 2,346 Pooled= true CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 71.18 UHIFR1 90% 10 59.24 20 53.82 80% 30 49.43 70% 40 46.27 50 42.59 Average Precision 60% 60 35.92 50% 70 30.49 80 22.82 40% 90 14.84 30% 100 4.76 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 38.07 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 53.60 UHIFR1 90% 10 docs 51.40 15 docs 47.60 80% 20 docs 44.30 70% 30 docs 41.07 100 docs 27.44 60% R−Precision 200 docs 17.93 50% 500 docs 8.76 1000 docs 4.69 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 38.49 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275) queries 1 UHIFR1 Topic 251 27.92 Topic 276 12.07 Difference (average precision) Topic 252 18.91 Topic 277 45.60 0.5 Topic 253 53.37 Topic 278 45.64 Topic 254 60.26 Topic 279 9.74 Topic 255 1.56 Topic 280 46.41 0 Topic 256 80.04 Topic 281 32.42 Topic 257 14.82 Topic 282 0.50 −0.5 Topic 258 1.11 Topic 283 66.62 Topic 259 2.65 Topic 284 66.94 Topic 260 50.70 Topic 285 61.66 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.07 Topic 286 4.96 Topic Number Topic 262 25.21 Topic 287 42.13 Topic 263 36.49 Topic 288 13.69 CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300) Topic 264 82.44 Topic 289 64.42 1 Topic 265 30.52 Topic 290 19.23 UHIFR1 Difference (average precision) Topic 266 3.34 Topic 291 61.46 0.5 Topic 267 35.11 Topic 292 10.28 Topic 268 49.98 Topic 293 76.71 Topic 269 36.03 Topic 294 59.12 0 Topic 270 60.88 Topic 295 49.14 Topic 271 83.93 Topic 296 27.92 Topic 272 7.53 Topic 297 63.01 −0.5 Topic 273 55.81 Topic 298 52.57 Topic 274 85.12 Topic 299 6.51 −1 Topic 275 48.05 Topic 300 12.67 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.254 hildesheim UHIFR2 AH-Monolingual-FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual French Retrieved 50,000 RunType= automatic Relevant 2,537 QueryType= TD Relevant retrieved 2,364 Pooled= false CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 69.73 UHIFR2 90% 10 59.10 20 53.83 80% 30 49.67 70% 40 46.44 50 42.60 Average Precision 60% 60 36.77 50% 70 31.07 80 23.43 40% 90 15.77 30% 100 5.22 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 38.32 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 52.80 UHIFR2 90% 10 docs 51.20 15 docs 47.73 80% 20 docs 44.80 70% 30 docs 41.27 100 docs 27.68 60% R−Precision 200 docs 18.36 50% 500 docs 8.86 1000 docs 4.73 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 38.18 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275) queries 1 UHIFR2 Topic 251 27.78 Topic 276 12.07 Difference (average precision) Topic 252 11.46 Topic 277 45.60 0.5 Topic 253 62.21 Topic 278 45.64 Topic 254 62.03 Topic 279 9.74 Topic 255 2.27 Topic 280 46.41 0 Topic 256 80.04 Topic 281 32.42 Topic 257 18.54 Topic 282 0.50 −0.5 Topic 258 2.05 Topic 283 66.62 Topic 259 2.65 Topic 284 66.61 Topic 260 50.70 Topic 285 61.66 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.07 Topic 286 4.96 Topic Number Topic 262 25.21 Topic 287 42.13 Topic 263 36.49 Topic 288 13.69 CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300) Topic 264 79.52 Topic 289 64.42 1 Topic 265 30.52 Topic 290 19.23 UHIFR2 Difference (average precision) Topic 266 3.34 Topic 291 61.46 0.5 Topic 267 35.11 Topic 292 10.28 Topic 268 51.61 Topic 293 76.71 Topic 269 37.99 Topic 294 59.12 0 Topic 270 60.88 Topic 295 49.14 Topic 271 83.93 Topic 296 27.92 Topic 272 7.53 Topic 297 63.01 −0.5 Topic 273 55.81 Topic 298 52.57 Topic 274 85.12 Topic 299 6.51 −1 Topic 275 52.31 Topic 300 12.67 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.255 hildesheim UHIFR3 AH-Monolingual-FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual French Retrieved 50,000 RunType= automatic Relevant 2,537 QueryType= TD Relevant retrieved 1,816 Pooled= false CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 58.44 UHIFR3 90% 10 47.32 20 41.56 80% 30 36.97 70% 40 32.76 50 27.28 Average Precision 60% 60 23.03 50% 70 18.27 80 13.97 40% 90 10.15 30% 100 3.46 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 27.04 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 41.20 UHIFR3 90% 10 docs 39.40 15 docs 36.53 80% 20 docs 34.20 70% 30 docs 31.20 100 docs 18.94 60% R−Precision 200 docs 12.68 50% 500 docs 6.52 1000 docs 3.63 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 29.55 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275) queries 1 UHIFR3 Topic 251 41.93 Topic 276 19.83 Difference (average precision) Topic 252 3.61 Topic 277 48.93 0.5 Topic 253 2.47 Topic 278 57.63 Topic 254 61.51 Topic 279 7.96 Topic 255 0.00 Topic 280 3.38 0 Topic 256 97.65 Topic 281 20.72 Topic 257 22.50 Topic 282 0.72 −0.5 Topic 258 2.88 Topic 283 69.25 Topic 259 2.67 Topic 284 23.00 Topic 260 31.28 Topic 285 34.39 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.00 Topic 286 4.26 Topic Number Topic 262 28.58 Topic 287 2.27 Topic 263 24.94 Topic 288 4.05 CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300) Topic 264 45.34 Topic 289 60.09 1 Topic 265 9.89 Topic 290 6.92 UHIFR3 Difference (average precision) Topic 266 1.51 Topic 291 50.31 0.5 Topic 267 39.69 Topic 292 22.68 Topic 268 36.40 Topic 293 51.23 Topic 269 12.74 Topic 294 37.20 0 Topic 270 54.36 Topic 295 39.00 Topic 271 72.15 Topic 296 0.02 Topic 272 4.46 Topic 297 50.20 −0.5 Topic 273 5.20 Topic 298 20.98 Topic 274 58.36 Topic 299 0.02 −1 Topic 275 47.64 Topic 300 9.41 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.256 hildesheim UHIFR4 AH-Monolingual-FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual French Retrieved 50,000 RunType= automatic Relevant 2,537 QueryType= TD Relevant retrieved 1,851 Pooled= false CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 59.61 UHIFR4 90% 10 47.64 20 42.35 80% 30 37.46 70% 40 33.12 50 27.89 Average Precision 60% 60 23.54 50% 70 18.62 80 14.15 40% 90 10.37 30% 100 3.71 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 27.36 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 40.40 UHIFR4 90% 10 docs 40.60 15 docs 37.47 80% 20 docs 34.90 70% 30 docs 31.40 100 docs 19.20 60% R−Precision 200 docs 12.80 50% 500 docs 6.66 1000 docs 3.70 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 29.98 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275) queries 1 UHIFR4 Topic 251 40.36 Topic 276 19.83 Difference (average precision) Topic 252 10.16 Topic 277 48.93 0.5 Topic 253 6.89 Topic 278 57.63 Topic 254 59.36 Topic 279 7.96 Topic 255 0.00 Topic 280 3.38 0 Topic 256 97.65 Topic 281 20.72 Topic 257 25.07 Topic 282 0.72 −0.5 Topic 258 3.72 Topic 283 69.25 Topic 259 2.67 Topic 284 22.76 Topic 260 31.28 Topic 285 37.97 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.00 Topic 286 4.26 Topic Number Topic 262 28.58 Topic 287 2.27 Topic 263 24.94 Topic 288 4.05 CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300) Topic 264 41.15 Topic 289 60.09 1 Topic 265 9.89 Topic 290 6.92 UHIFR4 Difference (average precision) Topic 266 1.51 Topic 291 50.31 0.5 Topic 267 39.69 Topic 292 22.68 Topic 268 41.79 Topic 293 51.23 Topic 269 13.18 Topic 294 37.20 0 Topic 270 54.36 Topic 295 39.00 Topic 271 72.15 Topic 296 0.02 Topic 272 4.46 Topic 297 50.20 −0.5 Topic 273 5.20 Topic 298 20.98 Topic 274 58.36 Topic 299 0.02 −1 Topic 275 47.86 Topic 300 9.41 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.257 hummingbird humFR05t AH-Monolingual-FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual French Retrieved 49,041 RunType= automatic Relevant 2,537 QueryType= T Relevant retrieved 2,091 Pooled= true CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 68.04 humFR05t 90% 10 53.79 20 45.23 80% 30 40.84 70% 40 35.46 50 30.44 Average Precision 60% 60 26.12 50% 70 21.33 80 16.42 40% 90 9.78 30% 100 2.06 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 30.17 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 45.60 humFR05t 90% 10 docs 43.60 15 docs 41.60 80% 20 docs 40.70 70% 30 docs 36.80 100 docs 21.94 60% R−Precision 200 docs 14.64 50% 500 docs 7.57 1000 docs 4.18 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 32.87 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275) queries 1 humFR05t Topic 251 4.96 Topic 276 12.76 Difference (average precision) Topic 252 4.00 Topic 277 51.08 0.5 Topic 253 30.81 Topic 278 53.92 Topic 254 53.55 Topic 279 7.35 Topic 255 2.00 Topic 280 15.41 0 Topic 256 23.84 Topic 281 10.68 Topic 257 27.03 Topic 282 0.03 −0.5 Topic 258 3.51 Topic 283 71.54 Topic 259 0.92 Topic 284 46.13 Topic 260 37.48 Topic 285 59.84 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.00 Topic 286 8.31 Topic Number Topic 262 30.60 Topic 287 26.13 Topic 263 16.65 Topic 288 3.14 CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300) Topic 264 67.56 Topic 289 61.44 1 Topic 265 34.64 Topic 290 19.33 humFR05t Difference (average precision) Topic 266 17.85 Topic 291 27.54 0.5 Topic 267 36.85 Topic 292 21.05 Topic 268 63.05 Topic 293 69.49 Topic 269 14.87 Topic 294 50.59 0 Topic 270 60.15 Topic 295 42.72 Topic 271 90.28 Topic 296 26.20 Topic 272 3.79 Topic 297 65.70 −0.5 Topic 273 21.61 Topic 298 27.15 Topic 274 39.10 Topic 299 0.46 −1 Topic 275 30.56 Topic 300 14.77 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.258 hummingbird humFR05td AH-Monolingual-FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual French Retrieved 50,000 RunType= automatic Relevant 2,537 QueryType= TD Relevant retrieved 2,266 Pooled= false CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 72.44 humFR05td 90% 10 59.55 20 55.40 80% 30 50.31 70% 40 43.85 50 39.47 Average Precision 60% 60 33.06 50% 70 27.92 80 21.25 40% 90 12.23 30% 100 3.59 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 36.94 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 54.80 humFR05td 90% 10 docs 49.60 15 docs 47.07 80% 20 docs 45.80 70% 30 docs 41.93 100 docs 26.36 60% R−Precision 200 docs 17.04 50% 500 docs 8.26 1000 docs 4.53 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 37.86 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275) queries 1 humFR05td Topic 251 30.18 Topic 276 21.21 Difference (average precision) Topic 252 3.32 Topic 277 33.34 0.5 Topic 253 29.33 Topic 278 39.81 Topic 254 58.08 Topic 279 6.96 Topic 255 2.44 Topic 280 27.56 0 Topic 256 84.90 Topic 281 43.98 Topic 257 20.72 Topic 282 2.35 −0.5 Topic 258 2.19 Topic 283 72.68 Topic 259 7.87 Topic 284 61.70 Topic 260 49.69 Topic 285 65.02 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.23 Topic 286 7.33 Topic Number Topic 262 36.27 Topic 287 47.82 Topic 263 29.38 Topic 288 9.63 CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300) Topic 264 70.13 Topic 289 60.68 1 Topic 265 32.84 Topic 290 30.05 humFR05td Difference (average precision) Topic 266 32.86 Topic 291 42.60 0.5 Topic 267 45.59 Topic 292 6.46 Topic 268 72.55 Topic 293 72.44 Topic 269 15.18 Topic 294 67.63 0 Topic 270 61.27 Topic 295 45.95 Topic 271 87.38 Topic 296 21.64 Topic 272 13.41 Topic 297 58.76 −0.5 Topic 273 39.29 Topic 298 46.99 Topic 274 70.50 Topic 299 9.01 −1 Topic 275 35.09 Topic 300 14.77 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.259 hummingbird humFR05tde AH-Monolingual-FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual French Retrieved 50,000 RunType= automatic Relevant 2,537 QueryType= TD Relevant retrieved 2,271 Pooled= false CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 73.01 humFR05tde 90% 10 62.78 20 58.96 80% 30 52.36 70% 40 49.09 50 43.02 Average Precision 60% 60 38.53 50% 70 32.10 80 24.44 40% 90 13.45 30% 100 4.27 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 40.06 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 57.60 humFR05tde 90% 10 docs 52.20 15 docs 49.73 80% 20 docs 47.00 70% 30 docs 43.80 100 docs 28.14 60% R−Precision 200 docs 18.16 50% 500 docs 8.67 1000 docs 4.54 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 40.87 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275) queries 1 humFR05tde Topic 251 29.01 Topic 276 19.08 Difference (average precision) Topic 252 5.41 Topic 277 29.97 0.5 Topic 253 39.79 Topic 278 46.21 Topic 254 63.67 Topic 279 9.93 Topic 255 2.86 Topic 280 31.71 0 Topic 256 86.37 Topic 281 47.99 Topic 257 22.21 Topic 282 1.59 −0.5 Topic 258 1.37 Topic 283 78.74 Topic 259 6.07 Topic 284 62.05 Topic 260 54.54 Topic 285 60.28 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.42 Topic 286 5.59 Topic Number Topic 262 39.41 Topic 287 53.19 Topic 263 41.64 Topic 288 13.63 CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300) Topic 264 75.20 Topic 289 73.38 1 Topic 265 31.23 Topic 290 46.52 humFR05tde Difference (average precision) Topic 266 36.17 Topic 291 41.33 0.5 Topic 267 48.69 Topic 292 9.26 Topic 268 65.40 Topic 293 69.47 Topic 269 24.06 Topic 294 69.43 0 Topic 270 70.89 Topic 295 47.36 Topic 271 87.74 Topic 296 28.69 Topic 272 11.63 Topic 297 63.56 −0.5 Topic 273 56.54 Topic 298 44.78 Topic 274 78.02 Topic 299 5.92 −1 Topic 275 50.55 Topic 300 14.52 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.260 jhu-apl aplmofra AH-Monolingual-FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual French Retrieved 50,000 RunType= automatic Relevant 2,537 QueryType= TD Relevant retrieved 2,422 Pooled= true CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 69.77 aplmofra 90% 10 62.68 20 56.52 80% 30 51.45 70% 40 48.55 50 44.32 Average Precision 60% 60 40.20 50% 70 35.84 80 30.95 40% 90 22.27 30% 100 9.89 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 42.14 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 54.40 aplmofra 90% 10 docs 51.00 15 docs 48.53 80% 20 docs 46.60 70% 30 docs 44.00 100 docs 29.48 60% R−Precision 200 docs 19.20 50% 500 docs 9.02 1000 docs 4.84 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 40.47 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275) queries 1 aplmofra Topic 251 37.93 Topic 276 30.52 Difference (average precision) Topic 252 7.82 Topic 277 48.93 0.5 Topic 253 66.07 Topic 278 46.72 Topic 254 64.10 Topic 279 7.30 Topic 255 0.94 Topic 280 33.13 0 Topic 256 90.32 Topic 281 32.04 Topic 257 20.70 Topic 282 1.88 −0.5 Topic 258 1.25 Topic 283 75.14 Topic 259 11.60 Topic 284 66.40 Topic 260 58.91 Topic 285 70.52 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.10 Topic 286 4.38 Topic Number Topic 262 31.78 Topic 287 48.91 Topic 263 41.50 Topic 288 11.38 CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300) Topic 264 82.38 Topic 289 66.92 1 Topic 265 26.18 Topic 290 56.13 aplmofra Difference (average precision) Topic 266 9.69 Topic 291 56.77 0.5 Topic 267 47.04 Topic 292 7.04 Topic 268 69.88 Topic 293 77.78 Topic 269 30.92 Topic 294 60.91 0 Topic 270 63.08 Topic 295 48.37 Topic 271 86.53 Topic 296 31.04 Topic 272 9.71 Topic 297 74.64 −0.5 Topic 273 65.20 Topic 298 58.55 Topic 274 92.19 Topic 299 0.70 −1 Topic 275 62.32 Topic 300 12.46 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.261 jhu-apl aplmofrb AH-Monolingual-FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual French Retrieved 50,000 RunType= automatic Relevant 2,537 QueryType= TD Relevant retrieved 2,427 Pooled= false CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 70.94 aplmofrb 90% 10 62.59 20 56.52 80% 30 51.43 70% 40 48.04 50 43.31 Average Precision 60% 60 38.78 50% 70 33.84 80 28.52 40% 90 20.21 30% 100 8.70 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 41.22 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 54.40 aplmofrb 90% 10 docs 52.80 15 docs 49.47 80% 20 docs 47.80 70% 30 docs 44.00 100 docs 28.82 60% R−Precision 200 docs 18.33 50% 500 docs 8.82 1000 docs 4.85 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 39.95 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275) queries 1 aplmofrb Topic 251 39.36 Topic 276 26.93 Difference (average precision) Topic 252 4.58 Topic 277 48.59 0.5 Topic 253 56.37 Topic 278 44.13 Topic 254 35.93 Topic 279 4.74 Topic 255 0.96 Topic 280 46.68 0 Topic 256 90.38 Topic 281 26.76 Topic 257 18.01 Topic 282 3.80 −0.5 Topic 258 1.19 Topic 283 74.55 Topic 259 8.26 Topic 284 74.45 Topic 260 58.18 Topic 285 68.06 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.06 Topic 286 1.65 Topic Number Topic 262 29.92 Topic 287 47.98 Topic 263 38.01 Topic 288 8.08 CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300) Topic 264 84.99 Topic 289 67.34 1 Topic 265 23.40 Topic 290 48.92 aplmofrb Difference (average precision) Topic 266 35.61 Topic 291 58.08 0.5 Topic 267 39.45 Topic 292 7.09 Topic 268 72.38 Topic 293 77.48 Topic 269 27.95 Topic 294 58.91 0 Topic 270 61.22 Topic 295 51.34 Topic 271 86.86 Topic 296 32.00 Topic 272 10.05 Topic 297 74.32 −0.5 Topic 273 67.88 Topic 298 44.89 Topic 274 85.84 Topic 299 7.92 −1 Topic 275 64.99 Topic 300 14.26 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.262 jhu-apl aplmofrc AH-Monolingual-FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual French Retrieved 50,000 RunType= automatic Relevant 2,537 QueryType= TD Relevant retrieved 2,283 Pooled= false CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 69.50 aplmofrc 90% 10 59.90 20 52.22 80% 30 46.82 70% 40 42.61 50 38.76 Average Precision 60% 60 35.28 50% 70 30.20 80 26.09 40% 90 17.02 30% 100 7.52 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 37.65 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 52.80 aplmofrc 90% 10 docs 48.80 15 docs 46.27 80% 20 docs 43.80 70% 30 docs 40.40 100 docs 26.56 60% R−Precision 200 docs 17.05 50% 500 docs 8.18 1000 docs 4.57 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 37.29 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275) queries 1 aplmofrc Topic 251 39.16 Topic 276 30.64 Difference (average precision) Topic 252 1.55 Topic 277 48.57 0.5 Topic 253 56.61 Topic 278 34.59 Topic 254 22.67 Topic 279 2.23 Topic 255 0.69 Topic 280 38.64 0 Topic 256 90.58 Topic 281 20.99 Topic 257 13.58 Topic 282 4.53 −0.5 Topic 258 1.25 Topic 283 71.96 Topic 259 10.92 Topic 284 67.18 Topic 260 56.98 Topic 285 69.47 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.02 Topic 286 1.58 Topic Number Topic 262 29.19 Topic 287 25.64 Topic 263 36.65 Topic 288 7.81 CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300) Topic 264 80.21 Topic 289 66.36 1 Topic 265 25.55 Topic 290 35.66 aplmofrc Difference (average precision) Topic 266 12.10 Topic 291 56.21 0.5 Topic 267 47.64 Topic 292 4.81 Topic 268 62.78 Topic 293 76.13 Topic 269 25.19 Topic 294 55.21 0 Topic 270 59.11 Topic 295 46.10 Topic 271 86.51 Topic 296 30.38 Topic 272 10.20 Topic 297 70.53 −0.5 Topic 273 60.87 Topic 298 19.51 Topic 274 88.26 Topic 299 4.90 −1 Topic 275 61.07 Topic 300 13.57 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.263 jhu-apl aplmofre AH-Monolingual-FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual French Retrieved 50,000 RunType= automatic Relevant 2,537 QueryType= TD Relevant retrieved 2,274 Pooled= false CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 68.60 aplmofre 90% 10 60.82 20 52.48 80% 30 47.60 70% 40 42.99 50 39.28 Average Precision 60% 60 35.88 50% 70 30.51 80 26.28 40% 90 17.35 30% 100 7.18 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 38.01 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 53.60 aplmofre 90% 10 docs 49.80 15 docs 45.47 80% 20 docs 43.40 70% 30 docs 41.13 100 docs 26.88 60% R−Precision 200 docs 17.49 50% 500 docs 8.38 1000 docs 4.55 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 37.94 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275) queries 1 aplmofre Topic 251 38.21 Topic 276 27.27 Difference (average precision) Topic 252 4.71 Topic 277 49.33 0.5 Topic 253 60.41 Topic 278 39.40 Topic 254 50.05 Topic 279 3.83 Topic 255 0.81 Topic 280 21.29 0 Topic 256 90.36 Topic 281 23.33 Topic 257 16.19 Topic 282 2.35 −0.5 Topic 258 1.39 Topic 283 72.40 Topic 259 12.85 Topic 284 60.35 Topic 260 57.72 Topic 285 69.59 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.08 Topic 286 3.33 Topic Number Topic 262 28.05 Topic 287 25.02 Topic 263 36.12 Topic 288 8.69 CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300) Topic 264 77.05 Topic 289 67.03 1 Topic 265 27.02 Topic 290 48.10 aplmofre Difference (average precision) Topic 266 2.14 Topic 291 54.29 0.5 Topic 267 50.81 Topic 292 3.97 Topic 268 61.85 Topic 293 76.34 Topic 269 27.87 Topic 294 58.51 0 Topic 270 60.11 Topic 295 44.01 Topic 271 85.90 Topic 296 28.53 Topic 272 10.04 Topic 297 68.85 −0.5 Topic 273 56.01 Topic 298 34.46 Topic 274 85.66 Topic 299 0.09 −1 Topic 275 57.49 Topic 300 11.05 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.264 miracle aHRSR AH-Monolingual-FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual French Retrieved 50,000 RunType= automatic Relevant 2,537 QueryType= TDN Relevant retrieved 2,304 Pooled= false CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 74.86 aHRSR 90% 10 65.43 20 57.05 80% 30 51.65 70% 40 44.85 50 40.68 Average Precision 60% 60 34.60 50% 70 28.64 80 21.32 40% 90 13.30 30% 100 3.98 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 38.33 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 55.60 aHRSR 90% 10 docs 51.40 15 docs 49.87 80% 20 docs 46.60 70% 30 docs 43.00 100 docs 26.94 60% R−Precision 200 docs 17.58 50% 500 docs 8.48 1000 docs 4.61 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 40.33 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275) queries 1 aHRSR Topic 251 26.44 Topic 276 18.60 Difference (average precision) Topic 252 24.57 Topic 277 46.77 0.5 Topic 253 26.68 Topic 278 29.40 Topic 254 57.76 Topic 279 6.36 Topic 255 2.50 Topic 280 40.29 0 Topic 256 61.63 Topic 281 40.64 Topic 257 22.92 Topic 282 1.81 −0.5 Topic 258 1.72 Topic 283 63.38 Topic 259 2.54 Topic 284 59.33 Topic 260 25.08 Topic 285 61.10 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 29.07 Topic 286 12.17 Topic Number Topic 262 16.22 Topic 287 51.16 Topic 263 34.18 Topic 288 12.34 CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300) Topic 264 64.66 Topic 289 71.61 1 Topic 265 25.69 Topic 290 31.50 aHRSR Difference (average precision) Topic 266 39.50 Topic 291 54.99 0.5 Topic 267 47.15 Topic 292 10.40 Topic 268 78.94 Topic 293 65.80 Topic 269 23.64 Topic 294 65.43 0 Topic 270 54.87 Topic 295 49.20 Topic 271 87.02 Topic 296 35.47 Topic 272 14.00 Topic 297 61.26 −0.5 Topic 273 68.04 Topic 298 49.15 Topic 274 73.76 Topic 299 7.93 −1 Topic 275 49.69 Topic 300 11.96 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.265 miracle aHRSRxNP01HR1 AH-Monolingual-FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual French Retrieved 50,000 RunType= automatic Relevant 2,537 QueryType= TDN Relevant retrieved 2,207 Pooled= true CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 73.47 aHRSRxNP01HR1 90% 10 64.34 20 56.85 80% 30 49.15 70% 40 43.14 50 39.71 Average Precision 60% 60 32.76 50% 70 27.08 80 19.98 40% 90 11.55 30% 100 2.89 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 36.75 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 54.00 aHRSRxNP01HR1 90% 10 docs 49.00 15 docs 47.87 80% 20 docs 45.80 70% 30 docs 42.40 100 docs 26.24 60% R−Precision 200 docs 17.18 50% 500 docs 8.41 1000 docs 4.41 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 39.39 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275) queries 1 aHRSRxNP01HR1 Topic 251 23.28 Topic 276 16.42 Difference (average precision) Topic 252 24.30 Topic 277 46.60 0.5 Topic 253 27.11 Topic 278 25.04 Topic 254 56.11 Topic 279 6.07 Topic 255 2.56 Topic 280 38.42 0 Topic 256 54.44 Topic 281 39.71 Topic 257 22.58 Topic 282 1.18 −0.5 Topic 258 2.51 Topic 283 63.13 Topic 259 2.33 Topic 284 56.79 Topic 260 21.90 Topic 285 59.24 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 28.29 Topic 286 11.18 Topic Number Topic 262 13.86 Topic 287 46.97 Topic 263 30.06 Topic 288 11.26 CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300) Topic 264 63.38 Topic 289 73.30 1 Topic 265 24.87 Topic 290 29.25 aHRSRxNP01HR1 Difference (average precision) Topic 266 38.14 Topic 291 54.40 0.5 Topic 267 45.13 Topic 292 7.96 Topic 268 76.63 Topic 293 63.78 Topic 269 22.29 Topic 294 64.12 0 Topic 270 50.80 Topic 295 49.30 Topic 271 86.27 Topic 296 34.34 Topic 272 14.05 Topic 297 61.57 −0.5 Topic 273 66.71 Topic 298 47.10 Topic 274 71.18 Topic 299 4.98 −1 Topic 275 45.83 Topic 300 10.93 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.266 miracle aHTST AH-Monolingual-FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual French Retrieved 50,000 RunType= automatic Relevant 2,537 QueryType= TD Relevant retrieved 2,242 Pooled= false CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 69.51 aHTST 90% 10 58.72 20 54.43 80% 30 49.79 70% 40 45.60 50 39.27 Average Precision 60% 60 33.03 50% 70 27.68 80 21.62 40% 90 13.93 30% 100 5.01 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 36.92 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 52.40 aHTST 90% 10 docs 51.40 15 docs 48.00 80% 20 docs 46.20 70% 30 docs 41.60 100 docs 26.14 60% R−Precision 200 docs 17.09 50% 500 docs 8.34 1000 docs 4.48 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 38.32 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275) queries 1 aHTST Topic 251 28.83 Topic 276 19.26 Difference (average precision) Topic 252 7.00 Topic 277 40.86 0.5 Topic 253 5.97 Topic 278 42.25 Topic 254 57.02 Topic 279 5.72 Topic 255 1.05 Topic 280 31.15 0 Topic 256 81.39 Topic 281 35.21 Topic 257 17.65 Topic 282 3.90 −0.5 Topic 258 4.01 Topic 283 64.47 Topic 259 4.41 Topic 284 69.01 Topic 260 33.47 Topic 285 59.88 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.12 Topic 286 8.01 Topic Number Topic 262 21.38 Topic 287 54.14 Topic 263 40.28 Topic 288 14.34 CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300) Topic 264 71.48 Topic 289 64.83 1 Topic 265 27.52 Topic 290 32.49 aHTST Difference (average precision) Topic 266 31.21 Topic 291 53.24 0.5 Topic 267 48.89 Topic 292 8.02 Topic 268 67.11 Topic 293 71.10 Topic 269 18.73 Topic 294 65.33 0 Topic 270 62.97 Topic 295 50.32 Topic 271 89.50 Topic 296 25.68 Topic 272 14.37 Topic 297 55.65 −0.5 Topic 273 52.06 Topic 298 51.91 Topic 274 71.67 Topic 299 9.87 −1 Topic 275 39.45 Topic 300 11.57 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.267 miracle xNP01r1SR1 AH-Monolingual-FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual French Retrieved 50,000 RunType= automatic Relevant 2,537 QueryType= TDN Relevant retrieved 1,811 Pooled= false CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 73.41 xNP01r1SR1 90% 10 55.87 20 43.42 80% 30 34.85 70% 40 29.46 50 25.57 Average Precision 60% 60 19.67 50% 70 13.63 80 9.53 40% 90 4.55 30% 100 1.09 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 26.36 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 51.60 xNP01r1SR1 90% 10 docs 45.80 15 docs 40.53 80% 20 docs 37.70 70% 30 docs 32.13 100 docs 19.02 60% R−Precision 200 docs 12.53 50% 500 docs 6.36 1000 docs 3.62 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 28.42 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275) queries 1 xNP01r1SR1 Topic 251 13.59 Topic 276 10.40 Difference (average precision) Topic 252 0.83 Topic 277 62.65 0.5 Topic 253 15.43 Topic 278 17.41 Topic 254 19.59 Topic 279 5.31 Topic 255 0.96 Topic 280 34.97 0 Topic 256 59.93 Topic 281 46.60 Topic 257 0.19 Topic 282 0.37 −0.5 Topic 258 0.00 Topic 283 47.95 Topic 259 1.62 Topic 284 43.37 Topic 260 47.99 Topic 285 24.86 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 16.89 Topic 286 19.42 Topic Number Topic 262 1.00 Topic 287 3.43 Topic 263 37.51 Topic 288 11.52 CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300) Topic 264 64.26 Topic 289 41.78 1 Topic 265 19.19 Topic 290 0.36 xNP01r1SR1 Difference (average precision) Topic 266 27.69 Topic 291 39.00 0.5 Topic 267 22.55 Topic 292 0.30 Topic 268 38.25 Topic 293 60.93 Topic 269 25.61 Topic 294 51.46 0 Topic 270 65.23 Topic 295 8.95 Topic 271 46.09 Topic 296 7.20 Topic 272 2.29 Topic 297 18.83 −0.5 Topic 273 51.33 Topic 298 39.80 Topic 274 61.18 Topic 299 5.40 −1 Topic 275 64.58 Topic 300 12.05 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.268 sics sics-fr-b AH-Monolingual-FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual French Retrieved 50,000 RunType= automatic Relevant 2,537 QueryType= TD Relevant retrieved 2,136 Pooled= true CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 68.50 sics−fr−b 90% 10 58.04 20 52.05 80% 30 45.23 70% 40 36.40 50 30.84 Average Precision 60% 60 25.80 50% 70 19.97 80 14.78 40% 90 8.51 30% 100 3.15 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 31.74 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 54.40 sics−fr−b 90% 10 docs 50.20 15 docs 45.47 80% 20 docs 42.10 70% 30 docs 37.60 100 docs 22.94 60% R−Precision 200 docs 14.93 50% 500 docs 7.65 1000 docs 4.27 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 33.30 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275) queries 1 sics−fr−b Topic 251 24.64 Topic 276 17.04 Difference (average precision) Topic 252 4.48 Topic 277 26.91 0.5 Topic 253 28.05 Topic 278 41.16 Topic 254 52.44 Topic 279 7.56 Topic 255 3.57 Topic 280 0.53 0 Topic 256 86.63 Topic 281 38.06 Topic 257 11.61 Topic 282 2.11 −0.5 Topic 258 5.15 Topic 283 49.54 Topic 259 7.31 Topic 284 59.22 Topic 260 43.74 Topic 285 43.24 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.12 Topic 286 7.03 Topic Number Topic 262 20.68 Topic 287 41.11 Topic 263 30.73 Topic 288 4.57 CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300) Topic 264 71.47 Topic 289 58.31 1 Topic 265 34.42 Topic 290 25.73 sics−fr−b Difference (average precision) Topic 266 26.65 Topic 291 39.03 0.5 Topic 267 58.25 Topic 292 8.99 Topic 268 64.41 Topic 293 29.41 Topic 269 14.05 Topic 294 67.86 0 Topic 270 57.67 Topic 295 44.09 Topic 271 84.49 Topic 296 12.62 Topic 272 15.35 Topic 297 43.89 −0.5 Topic 273 35.87 Topic 298 48.84 Topic 274 35.47 Topic 299 6.52 −1 Topic 275 34.22 Topic 300 12.15 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.269 sics sics-fr-k AH-Monolingual-FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual French Retrieved 50,000 RunType= automatic Relevant 2,537 QueryType= TD Relevant retrieved 2,128 Pooled= false CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 72.26 sics−fr−k 90% 10 58.94 20 52.37 80% 30 45.50 70% 40 38.25 50 34.44 Average Precision 60% 60 26.91 50% 70 20.98 80 14.04 40% 90 8.46 30% 100 2.84 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 32.71 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 53.20 sics−fr−k 90% 10 docs 50.60 15 docs 46.80 80% 20 docs 42.70 70% 30 docs 38.33 100 docs 23.48 60% R−Precision 200 docs 15.37 50% 500 docs 7.79 1000 docs 4.26 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 34.66 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275) queries 1 sics−fr−k Topic 251 27.20 Topic 276 10.37 Difference (average precision) Topic 252 2.42 Topic 277 43.53 0.5 Topic 253 21.89 Topic 278 39.96 Topic 254 59.10 Topic 279 7.77 Topic 255 5.88 Topic 280 1.57 0 Topic 256 82.36 Topic 281 46.17 Topic 257 14.07 Topic 282 1.61 −0.5 Topic 258 4.98 Topic 283 40.25 Topic 259 8.63 Topic 284 55.93 Topic 260 41.47 Topic 285 58.23 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.05 Topic 286 4.01 Topic Number Topic 262 34.42 Topic 287 48.52 Topic 263 27.99 Topic 288 5.50 CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300) Topic 264 71.27 Topic 289 58.61 1 Topic 265 32.21 Topic 290 28.47 sics−fr−k Difference (average precision) Topic 266 34.67 Topic 291 37.49 0.5 Topic 267 49.95 Topic 292 12.79 Topic 268 49.29 Topic 293 28.66 Topic 269 15.58 Topic 294 66.13 0 Topic 270 61.44 Topic 295 43.23 Topic 271 82.44 Topic 296 11.01 Topic 272 20.55 Topic 297 43.09 −0.5 Topic 273 46.82 Topic 298 44.95 Topic 274 39.31 Topic 299 10.03 −1 Topic 275 42.10 Topic 300 11.74 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.270 sics sics-fr-van AH-Monolingual-FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual French Retrieved 50,000 RunType= automatic Relevant 2,537 QueryType= TD Relevant retrieved 2,118 Pooled= false CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 68.72 sics−fr−van 90% 10 57.05 20 51.12 80% 30 45.10 70% 40 36.26 50 31.27 Average Precision 60% 60 25.38 50% 70 19.43 80 13.77 40% 90 8.68 30% 100 3.23 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 31.35 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 52.80 sics−fr−van 90% 10 docs 49.00 15 docs 45.20 80% 20 docs 42.00 70% 30 docs 38.00 100 docs 22.90 60% R−Precision 200 docs 14.66 50% 500 docs 7.54 1000 docs 4.24 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 33.15 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275) queries 1 sics−fr−van Topic 251 24.64 Topic 276 16.99 Difference (average precision) Topic 252 4.35 Topic 277 28.73 0.5 Topic 253 26.19 Topic 278 36.42 Topic 254 49.62 Topic 279 7.63 Topic 255 3.70 Topic 280 1.05 0 Topic 256 84.68 Topic 281 44.51 Topic 257 11.47 Topic 282 2.16 −0.5 Topic 258 4.41 Topic 283 50.51 Topic 259 7.65 Topic 284 58.23 Topic 260 42.82 Topic 285 42.93 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.23 Topic 286 6.99 Topic Number Topic 262 20.03 Topic 287 41.04 Topic 263 30.70 Topic 288 4.82 CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300) Topic 264 71.24 Topic 289 57.68 1 Topic 265 32.45 Topic 290 23.21 sics−fr−van Difference (average precision) Topic 266 26.13 Topic 291 37.42 0.5 Topic 267 55.99 Topic 292 7.78 Topic 268 64.41 Topic 293 29.53 Topic 269 14.65 Topic 294 66.86 0 Topic 270 57.09 Topic 295 42.64 Topic 271 83.54 Topic 296 13.71 Topic 272 21.43 Topic 297 43.15 −0.5 Topic 273 30.28 Topic 298 48.10 Topic 274 32.55 Topic 299 7.79 −1 Topic 275 35.40 Topic 300 11.98 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.271 tlr tlrTDfr3 AH-Monolingual-FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual French Retrieved 50,000 RunType= automatic Relevant 2,537 QueryType= TD Relevant retrieved 2,275 Pooled= false CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 73.09 tlrTDfr3 90% 10 60.52 20 55.05 80% 30 51.19 70% 40 45.36 50 40.68 Average Precision 60% 60 32.96 50% 70 26.15 80 20.28 40% 90 14.86 30% 100 5.17 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 37.35 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 52.40 tlrTDfr3 90% 10 docs 50.20 15 docs 45.73 80% 20 docs 43.50 70% 30 docs 40.07 100 docs 25.62 60% R−Precision 200 docs 16.62 50% 500 docs 8.25 1000 docs 4.55 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 38.79 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275) queries 1 tlrTDfr3 Topic 251 29.03 Topic 276 22.16 Difference (average precision) Topic 252 4.64 Topic 277 29.62 0.5 Topic 253 33.78 Topic 278 58.51 Topic 254 45.83 Topic 279 7.00 Topic 255 0.75 Topic 280 17.40 0 Topic 256 79.69 Topic 281 45.62 Topic 257 15.38 Topic 282 2.44 −0.5 Topic 258 57.14 Topic 283 76.24 Topic 259 7.75 Topic 284 53.01 Topic 260 41.30 Topic 285 58.93 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.06 Topic 286 7.43 Topic Number Topic 262 32.67 Topic 287 43.55 Topic 263 33.40 Topic 288 6.49 CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300) Topic 264 67.84 Topic 289 62.57 1 Topic 265 35.30 Topic 290 25.50 tlrTDfr3 Difference (average precision) Topic 266 36.11 Topic 291 39.91 0.5 Topic 267 57.43 Topic 292 6.65 Topic 268 81.07 Topic 293 63.56 Topic 269 13.72 Topic 294 60.82 0 Topic 270 61.29 Topic 295 39.65 Topic 271 89.54 Topic 296 24.64 Topic 272 13.21 Topic 297 50.34 −0.5 Topic 273 45.16 Topic 298 51.88 Topic 274 66.51 Topic 299 11.13 −1 Topic 275 41.81 Topic 300 11.87 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.272 tlr tlrTDfrRFS1 AH-Monolingual-FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual French Retrieved 50,000 RunType= automatic Relevant 2,537 QueryType= TD Relevant retrieved 2,333 Pooled= true CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 73.89 tlrTDfrRFS1 90% 10 63.04 20 54.55 80% 30 51.43 70% 40 47.31 50 43.16 Average Precision 60% 60 38.18 50% 70 32.15 80 24.43 40% 90 18.31 30% 100 5.68 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 40.00 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 56.40 tlrTDfrRFS1 90% 10 docs 51.00 15 docs 47.47 80% 20 docs 45.10 70% 30 docs 41.93 100 docs 27.28 60% R−Precision 200 docs 17.84 50% 500 docs 8.66 1000 docs 4.67 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 39.90 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275) queries 1 tlrTDfrRFS1 Topic 251 29.03 Topic 276 16.55 Difference (average precision) Topic 252 6.10 Topic 277 37.98 0.5 Topic 253 33.78 Topic 278 60.91 Topic 254 55.74 Topic 279 13.04 Topic 255 0.79 Topic 280 24.32 0 Topic 256 82.32 Topic 281 49.13 Topic 257 16.98 Topic 282 1.91 −0.5 Topic 258 19.17 Topic 283 77.83 Topic 259 11.36 Topic 284 56.90 Topic 260 59.32 Topic 285 58.93 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.05 Topic 286 7.74 Topic Number Topic 262 32.68 Topic 287 53.71 Topic 263 44.10 Topic 288 4.87 CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300) Topic 264 79.24 Topic 289 72.82 1 Topic 265 39.26 Topic 290 16.93 tlrTDfrRFS1 Difference (average precision) Topic 266 36.11 Topic 291 40.26 0.5 Topic 267 47.38 Topic 292 7.92 Topic 268 57.48 Topic 293 71.96 Topic 269 15.19 Topic 294 60.53 0 Topic 270 76.68 Topic 295 39.65 Topic 271 88.16 Topic 296 26.88 Topic 272 21.53 Topic 297 67.36 −0.5 Topic 273 64.97 Topic 298 53.61 Topic 274 86.06 Topic 299 9.46 −1 Topic 275 51.75 Topic 300 13.76 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.273 u.glasgow glafrtdn AH-Monolingual-FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual French Retrieved 50,000 RunType= automatic Relevant 2,537 QueryType= TDN Relevant retrieved 2,052 Pooled= false CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 68.60 glafrtdn 90% 10 57.53 20 49.62 80% 30 44.02 70% 40 37.78 50 32.84 Average Precision 60% 60 26.86 50% 70 21.56 80 16.41 40% 90 10.21 30% 100 3.66 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 32.06 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 50.80 glafrtdn 90% 10 docs 49.40 15 docs 46.40 80% 20 docs 43.00 70% 30 docs 38.47 100 docs 23.06 60% R−Precision 200 docs 15.07 50% 500 docs 7.44 1000 docs 4.10 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 35.32 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275) queries 1 glafrtdn Topic 251 11.04 Topic 276 13.00 Difference (average precision) Topic 252 29.35 Topic 277 49.38 0.5 Topic 253 21.35 Topic 278 13.08 Topic 254 52.99 Topic 279 0.51 Topic 255 1.96 Topic 280 32.64 0 Topic 256 68.94 Topic 281 33.71 Topic 257 7.75 Topic 282 1.55 −0.5 Topic 258 1.24 Topic 283 60.69 Topic 259 4.94 Topic 284 51.30 Topic 260 42.95 Topic 285 63.49 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 6.36 Topic 286 15.36 Topic Number Topic 262 0.40 Topic 287 42.47 Topic 263 34.47 Topic 288 13.82 CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300) Topic 264 62.15 Topic 289 62.87 1 Topic 265 19.68 Topic 290 0.23 glafrtdn Difference (average precision) Topic 266 36.53 Topic 291 44.61 0.5 Topic 267 35.02 Topic 292 13.98 Topic 268 55.20 Topic 293 36.64 Topic 269 11.33 Topic 294 67.24 0 Topic 270 44.15 Topic 295 45.74 Topic 271 90.94 Topic 296 31.77 Topic 272 10.87 Topic 297 49.68 −0.5 Topic 273 62.30 Topic 298 32.44 Topic 274 57.61 Topic 299 3.99 −1 Topic 275 39.33 Topic 300 13.77 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.274 u.glasgow glafrtdqe1 AH-Monolingual-FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual French Retrieved 50,000 RunType= automatic Relevant 2,537 QueryType= TD Relevant retrieved 2,269 Pooled= true CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 77.50 glafrtdqe1 90% 10 66.83 20 56.62 80% 30 50.51 70% 40 45.67 50 41.06 Average Precision 60% 60 36.42 50% 70 31.96 80 24.38 40% 90 18.45 30% 100 7.36 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 40.17 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 57.60 glafrtdqe1 90% 10 docs 52.40 15 docs 49.60 80% 20 docs 48.00 70% 30 docs 43.33 100 docs 27.14 60% R−Precision 200 docs 17.64 50% 500 docs 8.44 1000 docs 4.54 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 39.69 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275) queries 1 glafrtdqe1 Topic 251 18.45 Topic 276 18.42 Difference (average precision) Topic 252 47.88 Topic 277 53.58 0.5 Topic 253 40.99 Topic 278 22.91 Topic 254 55.05 Topic 279 2.36 Topic 255 1.82 Topic 280 40.05 0 Topic 256 86.62 Topic 281 40.74 Topic 257 9.78 Topic 282 4.20 −0.5 Topic 258 4.08 Topic 283 77.69 Topic 259 3.76 Topic 284 59.08 Topic 260 64.16 Topic 285 66.96 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 9.27 Topic 286 27.67 Topic Number Topic 262 0.27 Topic 287 54.58 Topic 263 42.20 Topic 288 6.83 CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300) Topic 264 79.97 Topic 289 74.24 1 Topic 265 22.49 Topic 290 0.22 glafrtdqe1 Difference (average precision) Topic 266 36.24 Topic 291 45.04 0.5 Topic 267 30.58 Topic 292 21.47 Topic 268 58.81 Topic 293 47.74 Topic 269 20.36 Topic 294 63.33 0 Topic 270 63.20 Topic 295 47.49 Topic 271 90.00 Topic 296 41.29 Topic 272 46.47 Topic 297 64.69 −0.5 Topic 273 71.71 Topic 298 58.73 Topic 274 71.94 Topic 299 12.94 −1 Topic 275 68.57 Topic 300 11.51 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.275 u.glasgow glafrtdqe2 AH-Monolingual-FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual French Retrieved 50,000 RunType= automatic Relevant 2,537 QueryType= TD Relevant retrieved 2,245 Pooled= false CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 69.91 glafrtdqe2 90% 10 61.95 20 53.82 80% 30 48.84 70% 40 43.60 50 39.39 Average Precision 60% 60 34.58 50% 70 29.92 80 23.77 40% 90 16.60 30% 100 5.85 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 37.65 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 53.20 glafrtdqe2 90% 10 docs 50.00 15 docs 47.73 80% 20 docs 45.70 70% 30 docs 40.73 100 docs 26.26 60% R−Precision 200 docs 17.04 50% 500 docs 8.33 1000 docs 4.49 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 37.67 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275) queries 1 glafrtdqe2 Topic 251 5.47 Topic 276 14.59 Difference (average precision) Topic 252 43.66 Topic 277 54.03 0.5 Topic 253 41.27 Topic 278 19.10 Topic 254 53.65 Topic 279 0.31 Topic 255 1.52 Topic 280 35.29 0 Topic 256 76.94 Topic 281 36.46 Topic 257 7.46 Topic 282 2.24 −0.5 Topic 258 0.73 Topic 283 67.38 Topic 259 3.52 Topic 284 59.44 Topic 260 63.81 Topic 285 63.76 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 8.88 Topic 286 9.14 Topic Number Topic 262 0.25 Topic 287 36.78 Topic 263 45.68 Topic 288 8.96 CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300) Topic 264 80.72 Topic 289 67.70 1 Topic 265 20.12 Topic 290 0.27 glafrtdqe2 Difference (average precision) Topic 266 36.22 Topic 291 47.00 0.5 Topic 267 31.48 Topic 292 21.40 Topic 268 59.38 Topic 293 39.17 Topic 269 23.63 Topic 294 65.43 0 Topic 270 59.63 Topic 295 46.60 Topic 271 89.16 Topic 296 37.65 Topic 272 39.09 Topic 297 63.15 −0.5 Topic 273 72.03 Topic 298 59.46 Topic 274 77.39 Topic 299 8.56 −1 Topic 275 65.32 Topic 300 11.81 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.276 u.surugadai SrgdMono01 AH-Monolingual-FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual French Retrieved 50,000 RunType= automatic Relevant 2,537 QueryType= TD Relevant retrieved 2,380 Pooled= true CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 69.05 SrgdMono01 90% 10 63.19 20 56.35 80% 30 50.97 70% 40 45.87 50 41.57 Average Precision 60% 60 37.23 50% 70 30.29 80 25.21 40% 90 15.59 30% 100 4.40 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 39.10 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 54.80 SrgdMono01 90% 10 docs 52.60 15 docs 49.87 80% 20 docs 48.00 70% 30 docs 43.00 100 docs 28.14 60% R−Precision 200 docs 18.80 50% 500 docs 9.01 1000 docs 4.76 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 39.98 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275) queries 1 SrgdMono01 Topic 251 28.53 Topic 276 19.14 Difference (average precision) Topic 252 11.01 Topic 277 52.79 0.5 Topic 253 65.57 Topic 278 36.95 Topic 254 51.19 Topic 279 8.08 Topic 255 0.89 Topic 280 30.73 0 Topic 256 83.93 Topic 281 31.41 Topic 257 21.88 Topic 282 0.70 −0.5 Topic 258 0.30 Topic 283 68.86 Topic 259 4.87 Topic 284 62.03 Topic 260 54.93 Topic 285 60.20 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.03 Topic 286 2.96 Topic Number Topic 262 22.99 Topic 287 47.32 Topic 263 24.81 Topic 288 8.64 CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300) Topic 264 81.26 Topic 289 49.72 1 Topic 265 27.22 Topic 290 41.63 SrgdMono01 Difference (average precision) Topic 266 23.09 Topic 291 57.15 0.5 Topic 267 48.63 Topic 292 8.91 Topic 268 54.29 Topic 293 71.69 Topic 269 39.46 Topic 294 66.79 0 Topic 270 59.68 Topic 295 44.31 Topic 271 84.82 Topic 296 31.03 Topic 272 9.25 Topic 297 68.64 −0.5 Topic 273 63.42 Topic 298 72.39 Topic 274 79.87 Topic 299 9.62 −1 Topic 275 49.60 Topic 300 11.69 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.277 unine UniNEfr1 AH-Monolingual-FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual French Retrieved 50,000 RunType= automatic Relevant 2,537 QueryType= TD Relevant retrieved 2,398 Pooled= true CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 71.56 UniNEfr1 90% 10 65.96 20 58.04 80% 30 52.99 70% 40 49.28 50 45.15 Average Precision 60% 60 40.62 50% 70 34.64 80 27.58 40% 90 18.90 30% 100 6.04 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 42.07 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 56.80 UniNEfr1 90% 10 docs 54.40 15 docs 51.47 80% 20 docs 49.50 70% 30 docs 45.87 100 docs 29.36 60% R−Precision 200 docs 18.98 50% 500 docs 9.11 1000 docs 4.80 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 42.81 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275) queries 1 UniNEfr1 Topic 251 29.28 Topic 276 23.90 Difference (average precision) Topic 252 15.65 Topic 277 39.24 0.5 Topic 253 59.78 Topic 278 32.50 Topic 254 66.87 Topic 279 8.65 Topic 255 0.73 Topic 280 34.73 0 Topic 256 86.80 Topic 281 49.91 Topic 257 20.52 Topic 282 3.45 −0.5 Topic 258 2.28 Topic 283 77.28 Topic 259 5.39 Topic 284 72.36 Topic 260 61.13 Topic 285 65.40 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.02 Topic 286 6.70 Topic Number Topic 262 31.81 Topic 287 50.58 Topic 263 41.26 Topic 288 12.81 CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300) Topic 264 85.20 Topic 289 73.32 1 Topic 265 41.39 Topic 290 45.64 UniNEfr1 Difference (average precision) Topic 266 32.08 Topic 291 54.53 0.5 Topic 267 41.77 Topic 292 5.99 Topic 268 57.96 Topic 293 72.25 Topic 269 31.22 Topic 294 74.56 0 Topic 270 74.80 Topic 295 47.87 Topic 271 87.95 Topic 296 21.77 Topic 272 17.21 Topic 297 43.85 −0.5 Topic 273 62.64 Topic 298 58.45 Topic 274 88.17 Topic 299 5.69 −1 Topic 275 65.05 Topic 300 15.22 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.278 unine UniNEfr2 AH-Monolingual-FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual French Retrieved 50,000 RunType= automatic Relevant 2,537 QueryType= TD Relevant retrieved 2,385 Pooled= false CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 71.56 UniNEfr2 90% 10 62.67 20 56.97 80% 30 52.52 70% 40 48.16 50 43.67 Average Precision 60% 60 38.64 50% 70 32.46 80 25.14 40% 90 18.48 30% 100 6.09 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 40.51 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 55.60 UniNEfr2 90% 10 docs 53.20 15 docs 50.40 80% 20 docs 48.50 70% 30 docs 43.93 100 docs 28.28 60% R−Precision 200 docs 18.41 50% 500 docs 9.02 1000 docs 4.77 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 41.57 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275) queries 1 UniNEfr2 Topic 251 23.32 Topic 276 20.77 Difference (average precision) Topic 252 13.53 Topic 277 45.12 0.5 Topic 253 66.77 Topic 278 43.72 Topic 254 56.17 Topic 279 8.05 Topic 255 1.20 Topic 280 28.01 0 Topic 256 81.34 Topic 281 48.13 Topic 257 13.29 Topic 282 2.46 −0.5 Topic 258 3.32 Topic 283 79.94 Topic 259 4.23 Topic 284 71.22 Topic 260 59.53 Topic 285 70.21 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.00 Topic 286 9.38 Topic Number Topic 262 24.28 Topic 287 45.71 Topic 263 39.21 Topic 288 16.30 CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300) Topic 264 74.48 Topic 289 72.67 1 Topic 265 36.13 Topic 290 25.86 UniNEfr2 Difference (average precision) Topic 266 37.84 Topic 291 42.46 0.5 Topic 267 39.59 Topic 292 13.45 Topic 268 67.39 Topic 293 72.65 Topic 269 25.95 Topic 294 65.29 0 Topic 270 71.11 Topic 295 44.72 Topic 271 86.03 Topic 296 30.57 Topic 272 22.04 Topic 297 31.97 −0.5 Topic 273 73.24 Topic 298 51.86 Topic 274 87.94 Topic 299 3.31 −1 Topic 275 62.47 Topic 300 11.38 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.279 unine UniNEfr3 AH-Monolingual-FR Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual French Retrieved 50,000 RunType= automatic Relevant 2,537 QueryType= TD Relevant retrieved 2,345 Pooled= false CLEF 2005 AH−Monolingual−FR − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 73.44 UniNEfr3 90% 10 66.83 20 58.11 80% 30 52.38 70% 40 48.32 50 43.72 Average Precision 60% 60 38.58 50% 70 31.42 80 22.69 40% 90 16.05 30% 100 3.81 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 40.66 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−FR − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 60.40 UniNEfr3 90% 10 docs 55.40 15 docs 52.40 80% 20 docs 50.30 70% 30 docs 44.87 100 docs 28.48 60% R−Precision 200 docs 18.28 50% 500 docs 8.81 1000 docs 4.69 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 41.96 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 251 to 275) queries 1 UniNEfr3 Topic 251 25.12 Topic 276 21.60 Difference (average precision) Topic 252 13.70 Topic 277 38.68 0.5 Topic 253 54.85 Topic 278 31.39 Topic 254 61.49 Topic 279 8.52 Topic 255 1.04 Topic 280 35.10 0 Topic 256 85.00 Topic 281 50.03 Topic 257 20.08 Topic 282 4.35 −0.5 Topic 258 3.56 Topic 283 73.16 Topic 259 7.29 Topic 284 70.06 Topic 260 51.32 Topic 285 66.74 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.00 Topic 286 8.91 Topic Number Topic 262 30.41 Topic 287 53.60 Topic 263 39.31 Topic 288 10.54 CLEF 2005 AH−Monolingual−FR − Comparison to median by topic (topics 276 to 300) Topic 264 83.39 Topic 289 76.50 1 Topic 265 44.38 Topic 290 39.93 UniNEfr3 Difference (average precision) Topic 266 31.75 Topic 291 51.50 0.5 Topic 267 47.06 Topic 292 7.07 Topic 268 51.51 Topic 293 74.01 Topic 269 22.64 Topic 294 71.22 0 Topic 270 67.27 Topic 295 42.71 Topic 271 87.81 Topic 296 21.21 Topic 272 28.35 Topic 297 41.11 −0.5 Topic 273 63.75 Topic 298 56.32 Topic 274 79.62 Topic 299 7.27 −1 Topic 275 50.27 Topic 300 20.62 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.280 alicante IRn-hu-fexp AH-Monolingual-HU Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Hungarian Retrieved 50,000 RunType= automatic Relevant 939 QueryType= TD Relevant retrieved 828 Pooled= true CLEF 2005 AH−Monolingual−HU − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 59.29 IRn−hu−fexp 90% 10 52.96 20 44.86 80% 30 39.83 70% 40 34.37 50 31.97 Average Precision 60% 60 27.75 50% 70 23.94 80 18.43 40% 90 13.55 30% 100 8.18 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 30.55 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−HU − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 37.20 IRn−hu−fexp 90% 10 docs 31.60 15 docs 28.53 80% 20 docs 26.20 70% 30 docs 22.60 100 docs 11.30 60% R−Precision 200 docs 6.71 50% 500 docs 3.12 1000 docs 1.66 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 30.27 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 251 to 275) queries 1 IRn−hu−fexp Topic 251 13.26 Topic 276 22.77 Difference (average precision) Topic 252 4.63 Topic 277 6.46 0.5 Topic 253 33.53 Topic 278 26.83 Topic 254 43.43 Topic 279 79.01 Topic 255 26.74 Topic 280 6.19 0 Topic 256 64.28 Topic 281 96.74 Topic 257 8.71 Topic 282 3.93 −0.5 Topic 258 17.78 Topic 283 56.97 Topic 259 17.39 Topic 284 1.46 Topic 260 13.28 Topic 285 1.42 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 33.33 Topic 286 5.41 Topic Number Topic 262 2.83 Topic 287 42.74 Topic 263 0.50 Topic 288 33.69 CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 276 to 300) Topic 264 16.61 Topic 289 95.26 1 Topic 265 24.49 Topic 290 60.58 IRn−hu−fexp Difference (average precision) Topic 266 13.45 Topic 291 71.04 0.5 Topic 267 35.68 Topic 292 26.82 Topic 268 59.46 Topic 293 88.26 Topic 269 11.57 Topic 294 95.00 0 Topic 270 23.42 Topic 295 27.75 Topic 271 16.96 Topic 296 27.11 Topic 272 7.69 Topic 297 40.63 −0.5 Topic 273 15.88 Topic 298 5.27 Topic 274 51.13 Topic 299 5.39 −1 Topic 275 30.95 Topic 300 13.90 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.281 alicante IRn-hu-vexp AH-Monolingual-HU Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Hungarian Retrieved 50,000 RunType= automatic Relevant 939 QueryType= TD Relevant retrieved 838 Pooled= true CLEF 2005 AH−Monolingual−HU − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 64.47 IRn−hu−vexp 90% 10 56.75 20 46.53 80% 30 42.53 70% 40 36.11 50 33.50 Average Precision 60% 60 27.03 50% 70 23.24 80 18.38 40% 90 13.23 30% 100 8.40 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 31.74 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−HU − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 38.40 IRn−hu−vexp 90% 10 docs 33.60 15 docs 29.33 80% 20 docs 26.70 70% 30 docs 22.73 100 docs 11.34 60% R−Precision 200 docs 6.82 50% 500 docs 3.16 1000 docs 1.68 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 30.87 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 251 to 275) queries 1 IRn−hu−vexp Topic 251 15.36 Topic 276 26.76 Difference (average precision) Topic 252 3.94 Topic 277 6.48 0.5 Topic 253 35.60 Topic 278 31.70 Topic 254 45.31 Topic 279 77.41 Topic 255 46.59 Topic 280 5.87 0 Topic 256 62.97 Topic 281 97.39 Topic 257 17.16 Topic 282 4.49 −0.5 Topic 258 17.78 Topic 283 56.67 Topic 259 16.97 Topic 284 1.30 Topic 260 15.14 Topic 285 1.17 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 33.33 Topic 286 7.08 Topic Number Topic 262 3.29 Topic 287 44.71 Topic 263 2.82 Topic 288 34.95 CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 276 to 300) Topic 264 18.79 Topic 289 95.26 1 Topic 265 22.95 Topic 290 63.91 IRn−hu−vexp Difference (average precision) Topic 266 15.81 Topic 291 68.01 0.5 Topic 267 34.30 Topic 292 51.72 Topic 268 54.16 Topic 293 87.89 Topic 269 9.93 Topic 294 95.00 0 Topic 270 20.02 Topic 295 27.17 Topic 271 17.06 Topic 296 24.92 Topic 272 3.33 Topic 297 35.60 −0.5 Topic 273 20.97 Topic 298 5.81 Topic 274 37.83 Topic 299 4.48 −1 Topic 275 45.00 Topic 300 14.89 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.282 alicante IRn-hu-vnexp AH-Monolingual-HU Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Hungarian Retrieved 50,000 RunType= automatic Relevant 939 QueryType= TD Relevant retrieved 802 Pooled= false CLEF 2005 AH−Monolingual−HU − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 66.84 IRn−hu−vnexp 90% 10 57.54 20 46.69 80% 30 38.21 70% 40 34.72 50 32.50 Average Precision 60% 60 23.98 50% 70 20.41 80 16.00 40% 90 10.71 30% 100 7.22 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 30.36 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−HU − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 35.60 IRn−hu−vnexp 90% 10 docs 31.60 15 docs 26.53 80% 20 docs 24.50 70% 30 docs 20.40 100 docs 10.24 60% R−Precision 200 docs 6.22 50% 500 docs 3.03 1000 docs 1.60 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 30.98 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 251 to 275) queries 1 IRn−hu−vnexp Topic 251 12.59 Topic 276 20.69 Difference (average precision) Topic 252 2.35 Topic 277 3.31 0.5 Topic 253 37.54 Topic 278 31.00 Topic 254 26.50 Topic 279 81.62 Topic 255 50.00 Topic 280 6.29 0 Topic 256 62.32 Topic 281 96.89 Topic 257 6.34 Topic 282 4.19 −0.5 Topic 258 14.07 Topic 283 53.94 Topic 259 17.00 Topic 284 1.86 Topic 260 26.77 Topic 285 12.25 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 16.67 Topic 286 5.29 Topic Number Topic 262 5.84 Topic 287 24.18 Topic 263 4.28 Topic 288 17.81 CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 276 to 300) Topic 264 31.14 Topic 289 90.85 1 Topic 265 17.97 Topic 290 35.65 IRn−hu−vnexp Difference (average precision) Topic 266 12.65 Topic 291 68.98 0.5 Topic 267 34.23 Topic 292 27.70 Topic 268 58.28 Topic 293 78.62 Topic 269 14.72 Topic 294 100.00 0 Topic 270 12.41 Topic 295 25.21 Topic 271 23.33 Topic 296 21.47 Topic 272 0.99 Topic 297 55.27 −0.5 Topic 273 17.10 Topic 298 5.51 Topic 274 36.21 Topic 299 26.25 −1 Topic 275 58.33 Topic 300 23.42 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.283 hildesheim UHIHU1 AH-Monolingual-HU Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Hungarian Retrieved 49,401 RunType= automatic Relevant 939 QueryType= TD Relevant retrieved 733 Pooled= true CLEF 2005 AH−Monolingual−HU − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 61.49 UHIHU1 90% 10 51.72 20 45.80 80% 30 39.01 70% 40 34.88 50 31.56 Average Precision 60% 60 26.58 50% 70 23.67 80 20.37 40% 90 15.09 30% 100 8.59 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 31.00 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−HU − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 36.40 UHIHU1 90% 10 docs 29.40 15 docs 26.13 80% 20 docs 22.60 70% 30 docs 19.47 100 docs 9.52 60% R−Precision 200 docs 5.61 50% 500 docs 2.60 1000 docs 1.47 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 31.13 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 251 to 275) queries 1 UHIHU1 Topic 251 14.66 Topic 276 19.94 Difference (average precision) Topic 252 8.22 Topic 277 0.00 0.5 Topic 253 43.72 Topic 278 33.07 Topic 254 48.03 Topic 279 8.97 Topic 255 100.00 Topic 280 1.51 0 Topic 256 81.62 Topic 281 92.08 Topic 257 33.82 Topic 282 14.76 −0.5 Topic 258 30.00 Topic 283 0.00 Topic 259 35.34 Topic 284 20.32 Topic 260 27.73 Topic 285 71.03 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 16.67 Topic 286 16.36 Topic Number Topic 262 16.88 Topic 287 27.01 Topic 263 14.43 Topic 288 3.56 CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 276 to 300) Topic 264 35.57 Topic 289 87.49 1 Topic 265 17.45 Topic 290 2.95 UHIHU1 Difference (average precision) Topic 266 3.19 Topic 291 65.07 0.5 Topic 267 71.65 Topic 292 10.14 Topic 268 53.99 Topic 293 0.67 Topic 269 14.29 Topic 294 77.08 0 Topic 270 19.52 Topic 295 18.44 Topic 271 25.93 Topic 296 0.33 Topic 272 0.13 Topic 297 54.69 −0.5 Topic 273 2.19 Topic 298 26.96 Topic 274 82.95 Topic 299 13.35 −1 Topic 275 61.11 Topic 300 25.09 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.284 hildesheim UHIHU2 AH-Monolingual-HU Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Hungarian Retrieved 50,000 RunType= automatic Relevant 939 QueryType= TD Relevant retrieved 776 Pooled= true CLEF 2005 AH−Monolingual−HU − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 63.94 UHIHU2 90% 10 54.74 20 47.27 80% 30 41.57 70% 40 36.24 50 32.40 Average Precision 60% 60 28.51 50% 70 25.32 80 21.92 40% 90 16.22 30% 100 9.97 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 32.64 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−HU − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 40.40 UHIHU2 90% 10 docs 30.60 15 docs 26.67 80% 20 docs 24.00 70% 30 docs 20.60 100 docs 10.18 60% R−Precision 200 docs 6.03 50% 500 docs 2.81 1000 docs 1.55 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 32.91 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 251 to 275) queries 1 UHIHU2 Topic 251 7.97 Topic 276 18.89 Difference (average precision) Topic 252 9.95 Topic 277 0.00 0.5 Topic 253 44.40 Topic 278 37.91 Topic 254 47.04 Topic 279 9.65 Topic 255 100.00 Topic 280 3.10 0 Topic 256 83.87 Topic 281 92.80 Topic 257 27.81 Topic 282 4.86 −0.5 Topic 258 26.19 Topic 283 0.76 Topic 259 33.81 Topic 284 19.15 Topic 260 27.27 Topic 285 67.11 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 16.76 Topic 286 21.43 Topic Number Topic 262 22.05 Topic 287 22.35 Topic 263 12.90 Topic 288 3.85 CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 276 to 300) Topic 264 35.67 Topic 289 88.82 1 Topic 265 19.27 Topic 290 5.46 UHIHU2 Difference (average precision) Topic 266 3.14 Topic 291 68.94 0.5 Topic 267 70.95 Topic 292 10.20 Topic 268 58.05 Topic 293 32.27 Topic 269 18.40 Topic 294 80.42 0 Topic 270 31.29 Topic 295 22.89 Topic 271 32.16 Topic 296 0.44 Topic 272 1.96 Topic 297 38.05 −0.5 Topic 273 5.16 Topic 298 37.32 Topic 274 82.13 Topic 299 13.69 −1 Topic 275 83.33 Topic 300 30.25 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.285 hummingbird humHU05t AH-Monolingual-HU Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Hungarian Retrieved 30,646 RunType= automatic Relevant 939 QueryType= T Relevant retrieved 626 Pooled= true CLEF 2005 AH−Monolingual−HU − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 65.57 humHU05t 90% 10 51.78 20 42.94 80% 30 35.53 70% 40 30.26 50 28.33 Average Precision 60% 60 21.03 50% 70 17.53 80 14.19 40% 90 7.03 30% 100 5.33 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 27.41 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−HU − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 35.60 humHU05t 90% 10 docs 27.80 15 docs 24.13 80% 20 docs 21.40 70% 30 docs 17.87 100 docs 8.68 60% R−Precision 200 docs 5.20 50% 500 docs 2.39 1000 docs 1.25 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 27.90 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 251 to 275) queries 1 humHU05t Topic 251 4.07 Topic 276 22.49 Difference (average precision) Topic 252 0.85 Topic 277 0.00 0.5 Topic 253 33.98 Topic 278 33.64 Topic 254 26.61 Topic 279 89.53 Topic 255 50.00 Topic 280 13.58 0 Topic 256 60.74 Topic 281 93.78 Topic 257 11.12 Topic 282 6.36 −0.5 Topic 258 13.26 Topic 283 61.81 Topic 259 41.67 Topic 284 22.02 Topic 260 8.33 Topic 285 18.18 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.00 Topic 286 0.00 Topic Number Topic 262 4.26 Topic 287 13.86 Topic 263 14.15 Topic 288 4.45 CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 276 to 300) Topic 264 24.44 Topic 289 85.82 1 Topic 265 10.16 Topic 290 15.26 humHU05t Difference (average precision) Topic 266 16.26 Topic 291 51.89 0.5 Topic 267 46.37 Topic 292 10.00 Topic 268 61.31 Topic 293 70.16 Topic 269 0.00 Topic 294 77.08 0 Topic 270 10.83 Topic 295 15.95 Topic 271 11.11 Topic 296 13.83 Topic 272 3.03 Topic 297 43.24 −0.5 Topic 273 33.53 Topic 298 5.62 Topic 274 45.06 Topic 299 2.78 −1 Topic 275 61.11 Topic 300 6.78 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.286 hummingbird humHU05td AH-Monolingual-HU Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Hungarian Retrieved 50,000 RunType= automatic Relevant 939 QueryType= TD Relevant retrieved 809 Pooled= true CLEF 2005 AH−Monolingual−HU − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 64.66 humHU05td 90% 10 54.25 20 47.21 80% 30 40.99 70% 40 36.74 50 32.46 Average Precision 60% 60 24.33 50% 70 20.72 80 15.65 40% 90 9.13 30% 100 6.73 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 30.55 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−HU − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 40.80 humHU05td 90% 10 docs 32.80 15 docs 27.87 80% 20 docs 23.70 70% 30 docs 20.07 100 docs 10.26 60% R−Precision 200 docs 6.22 50% 500 docs 3.02 1000 docs 1.62 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 31.59 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 251 to 275) queries 1 humHU05td Topic 251 4.55 Topic 276 26.42 Difference (average precision) Topic 252 4.46 Topic 277 0.99 0.5 Topic 253 34.20 Topic 278 30.09 Topic 254 21.25 Topic 279 72.43 Topic 255 50.42 Topic 280 9.06 0 Topic 256 72.06 Topic 281 95.84 Topic 257 11.99 Topic 282 1.39 −0.5 Topic 258 4.83 Topic 283 62.10 Topic 259 18.69 Topic 284 14.36 Topic 260 11.85 Topic 285 6.72 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 26.19 Topic 286 32.53 Topic Number Topic 262 4.64 Topic 287 14.19 Topic 263 13.41 Topic 288 13.70 CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 276 to 300) Topic 264 36.58 Topic 289 84.11 1 Topic 265 9.39 Topic 290 46.20 humHU05td Difference (average precision) Topic 266 20.41 Topic 291 66.14 0.5 Topic 267 60.76 Topic 292 25.22 Topic 268 66.35 Topic 293 65.52 Topic 269 1.19 Topic 294 100.00 0 Topic 270 17.19 Topic 295 27.38 Topic 271 33.80 Topic 296 11.79 Topic 272 8.33 Topic 297 53.43 −0.5 Topic 273 24.80 Topic 298 5.04 Topic 274 21.56 Topic 299 5.75 −1 Topic 275 62.50 Topic 300 15.90 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.287 hummingbird humHU05tde AH-Monolingual-HU Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Hungarian Retrieved 50,000 RunType= automatic Relevant 939 QueryType= TD Relevant retrieved 830 Pooled= true CLEF 2005 AH−Monolingual−HU − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 63.63 humHU05tde 90% 10 56.34 20 51.10 80% 30 42.22 70% 40 39.42 50 36.51 Average Precision 60% 60 28.24 50% 70 23.78 80 19.63 40% 90 12.14 30% 100 8.33 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 33.09 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−HU − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 40.00 humHU05tde 90% 10 docs 34.40 15 docs 31.20 80% 20 docs 28.40 70% 30 docs 23.00 100 docs 11.10 60% R−Precision 200 docs 6.72 50% 500 docs 3.14 1000 docs 1.66 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 34.00 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 251 to 275) queries 1 humHU05tde Topic 251 13.48 Topic 276 30.01 Difference (average precision) Topic 252 3.99 Topic 277 4.02 0.5 Topic 253 38.16 Topic 278 42.35 Topic 254 49.81 Topic 279 54.03 Topic 255 50.42 Topic 280 6.32 0 Topic 256 78.17 Topic 281 95.31 Topic 257 26.40 Topic 282 2.00 −0.5 Topic 258 5.77 Topic 283 56.91 Topic 259 18.89 Topic 284 21.66 Topic 260 15.83 Topic 285 6.45 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 38.89 Topic 286 37.09 Topic Number Topic 262 3.66 Topic 287 17.99 Topic 263 7.36 Topic 288 15.28 CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 276 to 300) Topic 264 28.73 Topic 289 97.05 1 Topic 265 10.26 Topic 290 63.86 humHU05tde Difference (average precision) Topic 266 26.99 Topic 291 65.86 0.5 Topic 267 57.43 Topic 292 25.33 Topic 268 64.77 Topic 293 79.58 Topic 269 1.99 Topic 294 100.00 0 Topic 270 22.01 Topic 295 22.09 Topic 271 41.64 Topic 296 14.07 Topic 272 11.11 Topic 297 61.00 −0.5 Topic 273 26.43 Topic 298 2.19 Topic 274 24.17 Topic 299 3.89 −1 Topic 275 59.09 Topic 300 4.66 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.288 ilps UAmsMoHu1AnH AH-Monolingual-HU Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Hungarian Retrieved 49,703 RunType= automatic Relevant 939 QueryType= TD Relevant retrieved 740 Pooled= true CLEF 2005 AH−Monolingual−HU − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 65.17 UAmsMoHu1AnH 90% 10 51.85 20 45.81 80% 30 41.03 70% 40 34.03 50 29.89 Average Precision 60% 60 22.84 50% 70 18.13 80 11.56 40% 90 7.11 30% 100 5.12 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 28.19 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−HU − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 36.40 UAmsMoHu1AnH 90% 10 docs 28.80 15 docs 25.20 80% 20 docs 23.10 70% 30 docs 19.67 100 docs 9.56 60% R−Precision 200 docs 5.64 50% 500 docs 2.74 1000 docs 1.48 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 28.39 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 251 to 275) queries 1 UAmsMoHu1AnH Topic 251 6.36 Topic 276 17.34 Difference (average precision) Topic 252 3.01 Topic 277 0.11 0.5 Topic 253 36.29 Topic 278 16.98 Topic 254 38.76 Topic 279 42.61 Topic 255 35.96 Topic 280 13.36 0 Topic 256 71.99 Topic 281 94.73 Topic 257 18.09 Topic 282 1.93 −0.5 Topic 258 7.68 Topic 283 59.17 Topic 259 59.65 Topic 284 0.03 Topic 260 10.98 Topic 285 10.82 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 5.53 Topic 286 7.12 Topic Number Topic 262 35.66 Topic 287 17.38 Topic 263 4.06 Topic 288 8.09 CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 276 to 300) Topic 264 40.30 Topic 289 62.50 1 Topic 265 25.13 Topic 290 29.83 UAmsMoHu1AnH Difference (average precision) Topic 266 11.10 Topic 291 58.89 0.5 Topic 267 26.49 Topic 292 50.27 Topic 268 43.92 Topic 293 80.77 Topic 269 2.99 Topic 294 74.63 0 Topic 270 18.79 Topic 295 21.06 Topic 271 29.00 Topic 296 19.56 Topic 272 1.15 Topic 297 45.78 −0.5 Topic 273 12.30 Topic 298 1.18 Topic 274 57.44 Topic 299 5.89 −1 Topic 275 41.67 Topic 300 24.94 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.289 ilps UAmsMoHu2AnG AH-Monolingual-HU Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Hungarian Retrieved 49,434 RunType= automatic Relevant 939 QueryType= TD Relevant retrieved 717 Pooled= true CLEF 2005 AH−Monolingual−HU − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 57.01 UAmsMoHu2AnG 90% 10 50.25 20 38.70 80% 30 30.58 70% 40 25.56 50 21.05 Average Precision 60% 60 16.96 50% 70 13.43 80 11.29 40% 90 8.75 30% 100 6.60 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 23.30 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−HU − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 33.60 UAmsMoHu2AnG 90% 10 docs 25.80 15 docs 22.67 80% 20 docs 21.20 70% 30 docs 18.93 100 docs 9.00 60% R−Precision 200 docs 5.46 50% 500 docs 2.66 1000 docs 1.43 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 25.56 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 251 to 275) queries 1 UAmsMoHu2AnG Topic 251 6.84 Topic 276 17.83 Difference (average precision) Topic 252 4.12 Topic 277 2.00 0.5 Topic 253 16.66 Topic 278 27.57 Topic 254 29.13 Topic 279 27.44 Topic 255 6.62 Topic 280 13.39 0 Topic 256 47.05 Topic 281 92.16 Topic 257 14.70 Topic 282 1.09 −0.5 Topic 258 3.94 Topic 283 27.11 Topic 259 21.87 Topic 284 0.03 Topic 260 5.35 Topic 285 18.53 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 11.60 Topic 286 11.66 Topic Number Topic 262 35.45 Topic 287 17.18 Topic 263 5.99 Topic 288 8.93 CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 276 to 300) Topic 264 40.12 Topic 289 62.50 1 Topic 265 30.68 Topic 290 22.14 UAmsMoHu2AnG Difference (average precision) Topic 266 11.72 Topic 291 55.99 0.5 Topic 267 20.41 Topic 292 3.71 Topic 268 47.88 Topic 293 96.66 Topic 269 2.58 Topic 294 80.42 0 Topic 270 18.47 Topic 295 26.32 Topic 271 13.55 Topic 296 13.76 Topic 272 1.04 Topic 297 26.17 −0.5 Topic 273 5.53 Topic 298 0.66 Topic 274 37.61 Topic 299 6.14 −1 Topic 275 41.67 Topic 300 25.22 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.290 ilps UAmsMoHu3AnL AH-Monolingual-HU Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Hungarian Retrieved 49,703 RunType= automatic Relevant 939 QueryType= TD Relevant retrieved 734 Pooled= false CLEF 2005 AH−Monolingual−HU − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 64.68 UAmsMoHu3AnL 90% 10 51.68 20 45.80 80% 30 40.32 70% 40 33.43 50 29.56 Average Precision 60% 60 22.69 50% 70 17.88 80 10.54 40% 90 7.19 30% 100 4.84 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 27.99 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−HU − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 36.40 UAmsMoHu3AnL 90% 10 docs 29.60 15 docs 25.60 80% 20 docs 22.70 70% 30 docs 19.80 100 docs 9.56 60% R−Precision 200 docs 5.60 50% 500 docs 2.72 1000 docs 1.47 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 29.05 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 251 to 275) queries 1 UAmsMoHu3AnL Topic 251 6.68 Topic 276 17.47 Difference (average precision) Topic 252 0.97 Topic 277 0.20 0.5 Topic 253 36.08 Topic 278 17.64 Topic 254 34.49 Topic 279 43.35 Topic 255 39.58 Topic 280 13.40 0 Topic 256 72.35 Topic 281 94.08 Topic 257 18.10 Topic 282 1.84 −0.5 Topic 258 10.00 Topic 283 61.43 Topic 259 51.55 Topic 284 0.03 Topic 260 10.98 Topic 285 10.91 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 6.09 Topic 286 6.94 Topic Number Topic 262 34.93 Topic 287 17.44 Topic 263 3.86 Topic 288 7.12 CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 276 to 300) Topic 264 40.31 Topic 289 62.50 1 Topic 265 25.24 Topic 290 25.30 UAmsMoHu3AnL Difference (average precision) Topic 266 13.82 Topic 291 59.03 0.5 Topic 267 25.60 Topic 292 50.30 Topic 268 44.26 Topic 293 80.57 Topic 269 2.70 Topic 294 74.63 0 Topic 270 19.65 Topic 295 22.94 Topic 271 29.00 Topic 296 21.82 Topic 272 1.09 Topic 297 47.92 −0.5 Topic 273 12.35 Topic 298 1.25 Topic 274 51.52 Topic 299 8.40 −1 Topic 275 36.67 Topic 300 24.94 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.291 ilps UAmsMoHu4AnV AH-Monolingual-HU Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Hungarian Retrieved 49,360 RunType= automatic Relevant 939 QueryType= TD Relevant retrieved 700 Pooled= false CLEF 2005 AH−Monolingual−HU − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 55.56 UAmsMoHu4AnV 90% 10 44.46 20 36.75 80% 30 30.50 70% 40 25.67 50 20.09 Average Precision 60% 60 13.80 50% 70 12.53 80 9.20 40% 90 6.05 30% 100 4.01 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 21.50 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−HU − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 33.60 UAmsMoHu4AnV 90% 10 docs 25.80 15 docs 22.67 80% 20 docs 20.40 70% 30 docs 17.33 100 docs 8.60 60% R−Precision 200 docs 5.12 50% 500 docs 2.60 1000 docs 1.40 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 24.16 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 251 to 275) queries 1 UAmsMoHu4AnV Topic 251 9.70 Topic 276 18.55 Difference (average precision) Topic 252 1.22 Topic 277 1.12 0.5 Topic 253 19.62 Topic 278 19.34 Topic 254 29.65 Topic 279 15.44 Topic 255 9.05 Topic 280 14.28 0 Topic 256 48.98 Topic 281 92.76 Topic 257 11.88 Topic 282 2.10 −0.5 Topic 258 2.78 Topic 283 54.56 Topic 259 18.12 Topic 284 0.02 Topic 260 5.50 Topic 285 11.02 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 6.62 Topic 286 2.99 Topic Number Topic 262 35.95 Topic 287 15.47 Topic 263 4.78 Topic 288 8.34 CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 276 to 300) Topic 264 40.42 Topic 289 50.00 1 Topic 265 23.85 Topic 290 26.14 UAmsMoHu4AnV Difference (average precision) Topic 266 13.71 Topic 291 51.58 0.5 Topic 267 24.34 Topic 292 1.76 Topic 268 36.21 Topic 293 83.87 Topic 269 2.23 Topic 294 68.11 0 Topic 270 15.74 Topic 295 24.65 Topic 271 20.71 Topic 296 18.52 Topic 272 1.30 Topic 297 8.20 −0.5 Topic 273 3.22 Topic 298 0.43 Topic 274 38.93 Topic 299 7.71 −1 Topic 275 29.17 Topic 300 24.57 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.292 jhu-apl aplmohuc AH-Monolingual-HU Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Hungarian Retrieved 50,000 RunType= automatic Relevant 939 QueryType= TD Relevant retrieved 893 Pooled= true CLEF 2005 AH−Monolingual−HU − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 70.58 aplmohuc 90% 10 61.32 20 55.95 80% 30 48.55 70% 40 44.94 50 42.31 Average Precision 60% 60 38.05 50% 70 34.33 80 29.07 40% 90 24.12 30% 100 16.30 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 40.63 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−HU − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 41.60 aplmohuc 90% 10 docs 38.80 15 docs 33.87 80% 20 docs 31.00 70% 30 docs 26.40 100 docs 13.06 60% R−Precision 200 docs 7.50 50% 500 docs 3.47 1000 docs 1.79 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 39.37 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 251 to 275) queries 1 aplmohuc Topic 251 26.78 Topic 276 18.73 Difference (average precision) Topic 252 12.79 Topic 277 0.09 0.5 Topic 253 39.81 Topic 278 34.65 Topic 254 58.52 Topic 279 77.10 Topic 255 97.62 Topic 280 15.15 0 Topic 256 85.65 Topic 281 91.60 Topic 257 19.57 Topic 282 2.77 −0.5 Topic 258 17.86 Topic 283 67.87 Topic 259 22.26 Topic 284 35.95 Topic 260 37.20 Topic 285 71.52 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 20.58 Topic 286 12.89 Topic Number Topic 262 43.90 Topic 287 49.98 Topic 263 9.66 Topic 288 8.90 CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 276 to 300) Topic 264 29.20 Topic 289 100.00 1 Topic 265 30.19 Topic 290 69.98 aplmohuc Difference (average precision) Topic 266 9.51 Topic 291 64.34 0.5 Topic 267 50.12 Topic 292 17.14 Topic 268 52.57 Topic 293 96.39 Topic 269 18.45 Topic 294 95.00 0 Topic 270 28.07 Topic 295 29.61 Topic 271 36.35 Topic 296 19.92 Topic 272 6.67 Topic 297 66.12 −0.5 Topic 273 28.08 Topic 298 29.83 Topic 274 84.43 Topic 299 8.68 −1 Topic 275 75.00 Topic 300 6.35 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.293 jhu-apl aplmohud AH-Monolingual-HU Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Hungarian Retrieved 50,000 RunType= automatic Relevant 939 QueryType= TD Relevant retrieved 893 Pooled= true CLEF 2005 AH−Monolingual−HU − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 74.15 aplmohud 90% 10 62.47 20 56.59 80% 30 48.59 70% 40 46.15 50 43.76 Average Precision 60% 60 39.35 50% 70 34.17 80 28.73 40% 90 23.82 30% 100 16.56 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 41.12 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−HU − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 43.20 aplmohud 90% 10 docs 37.20 15 docs 32.80 80% 20 docs 30.70 70% 30 docs 25.73 100 docs 13.06 60% R−Precision 200 docs 7.39 50% 500 docs 3.42 1000 docs 1.79 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 40.92 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 251 to 275) queries 1 aplmohud Topic 251 30.07 Topic 276 21.98 Difference (average precision) Topic 252 13.74 Topic 277 0.18 0.5 Topic 253 33.38 Topic 278 33.08 Topic 254 59.29 Topic 279 80.67 Topic 255 94.84 Topic 280 11.44 0 Topic 256 87.24 Topic 281 91.34 Topic 257 14.29 Topic 282 3.84 −0.5 Topic 258 3.97 Topic 283 65.99 Topic 259 20.62 Topic 284 38.06 Topic 260 42.19 Topic 285 68.29 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 48.89 Topic 286 9.84 Topic Number Topic 262 38.56 Topic 287 50.73 Topic 263 7.95 Topic 288 8.45 CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 276 to 300) Topic 264 31.45 Topic 289 98.61 1 Topic 265 29.17 Topic 290 69.37 aplmohud Difference (average precision) Topic 266 10.33 Topic 291 62.66 0.5 Topic 267 51.80 Topic 292 25.45 Topic 268 56.93 Topic 293 96.22 Topic 269 20.58 Topic 294 88.75 0 Topic 270 28.15 Topic 295 29.86 Topic 271 27.12 Topic 296 20.47 Topic 272 5.56 Topic 297 70.50 −0.5 Topic 273 23.54 Topic 298 26.81 Topic 274 87.26 Topic 299 27.41 −1 Topic 275 83.33 Topic 300 5.95 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.294 jhu-apl aplmohue AH-Monolingual-HU Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Hungarian Retrieved 50,000 RunType= automatic Relevant 939 QueryType= TD Relevant retrieved 891 Pooled= false CLEF 2005 AH−Monolingual−HU − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 72.12 aplmohue 90% 10 63.78 20 57.10 80% 30 48.84 70% 40 45.33 50 41.81 Average Precision 60% 60 37.44 50% 70 32.52 80 28.37 40% 90 23.76 30% 100 15.60 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 40.56 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−HU − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 42.80 aplmohue 90% 10 docs 39.40 15 docs 34.53 80% 20 docs 31.20 70% 30 docs 26.80 100 docs 13.06 60% R−Precision 200 docs 7.57 50% 500 docs 3.43 1000 docs 1.78 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 39.11 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 251 to 275) queries 1 aplmohue Topic 251 23.11 Topic 276 16.90 Difference (average precision) Topic 252 12.06 Topic 277 0.04 0.5 Topic 253 41.61 Topic 278 36.31 Topic 254 57.87 Topic 279 73.02 Topic 255 97.62 Topic 280 17.33 0 Topic 256 82.08 Topic 281 90.73 Topic 257 24.22 Topic 282 1.81 −0.5 Topic 258 21.67 Topic 283 64.75 Topic 259 22.91 Topic 284 27.54 Topic 260 33.55 Topic 285 73.03 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 17.04 Topic 286 22.83 Topic Number Topic 262 49.14 Topic 287 49.40 Topic 263 10.48 Topic 288 8.97 CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 276 to 300) Topic 264 28.85 Topic 289 100.00 1 Topic 265 31.10 Topic 290 68.17 aplmohue Difference (average precision) Topic 266 9.06 Topic 291 64.78 0.5 Topic 267 54.45 Topic 292 17.17 Topic 268 45.85 Topic 293 96.17 Topic 269 17.86 Topic 294 95.00 0 Topic 270 28.24 Topic 295 29.42 Topic 271 42.50 Topic 296 19.42 Topic 272 9.09 Topic 297 65.93 −0.5 Topic 273 29.71 Topic 298 32.69 Topic 274 85.38 Topic 299 7.46 −1 Topic 275 66.67 Topic 300 6.99 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.295 miracle HUHT AH-Monolingual-HU Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Hungarian Retrieved 50,000 RunType= automatic Relevant 939 QueryType= TD Relevant retrieved 785 Pooled= false CLEF 2005 AH−Monolingual−HU − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 64.52 HUHT 90% 10 52.15 20 44.27 80% 30 37.18 70% 40 33.11 50 30.49 Average Precision 60% 60 22.40 50% 70 18.18 80 11.09 40% 90 7.15 30% 100 4.14 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 27.70 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−HU − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 38.40 HUHT 90% 10 docs 30.00 15 docs 25.60 80% 20 docs 22.50 70% 30 docs 19.33 100 docs 9.16 60% R−Precision 200 docs 5.60 50% 500 docs 2.86 1000 docs 1.57 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 28.45 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 251 to 275) queries 1 HUHT Topic 251 1.64 Topic 276 19.72 Difference (average precision) Topic 252 6.91 Topic 277 0.43 0.5 Topic 253 30.21 Topic 278 13.67 Topic 254 32.24 Topic 279 51.06 Topic 255 30.29 Topic 280 5.54 0 Topic 256 82.65 Topic 281 91.41 Topic 257 8.38 Topic 282 0.79 −0.5 Topic 258 31.45 Topic 283 59.23 Topic 259 50.28 Topic 284 23.98 Topic 260 9.47 Topic 285 8.23 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 5.71 Topic 286 15.55 Topic Number Topic 262 8.05 Topic 287 14.06 Topic 263 13.21 Topic 288 5.81 CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 276 to 300) Topic 264 16.10 Topic 289 74.10 1 Topic 265 14.68 Topic 290 30.45 HUHT Difference (average precision) Topic 266 16.32 Topic 291 55.92 0.5 Topic 267 47.19 Topic 292 9.90 Topic 268 52.80 Topic 293 77.83 Topic 269 4.46 Topic 294 87.50 0 Topic 270 14.15 Topic 295 11.53 Topic 271 19.05 Topic 296 12.81 Topic 272 6.25 Topic 297 44.53 −0.5 Topic 273 31.76 Topic 298 1.31 Topic 274 26.71 Topic 299 8.93 −1 Topic 275 62.50 Topic 300 38.23 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.296 miracle aHTSTxNP01ST1 AH-Monolingual-HU Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Hungarian Retrieved 50,000 RunType= automatic Relevant 939 QueryType= TD Relevant retrieved 827 Pooled= true CLEF 2005 AH−Monolingual−HU − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 70.96 aHTSTxNP01ST1 90% 10 59.77 20 53.75 80% 30 44.14 70% 40 39.67 50 37.29 Average Precision 60% 60 29.95 50% 70 25.02 80 17.23 40% 90 11.19 30% 100 7.33 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 34.35 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−HU − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 44.40 aHTSTxNP01ST1 90% 10 docs 34.00 15 docs 28.40 80% 20 docs 26.20 70% 30 docs 21.47 100 docs 10.72 60% R−Precision 200 docs 6.37 50% 500 docs 3.00 1000 docs 1.65 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 33.85 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 251 to 275) queries 1 aHTSTxNP01ST1 Topic 251 2.64 Topic 276 25.46 Difference (average precision) Topic 252 5.88 Topic 277 0.63 0.5 Topic 253 38.06 Topic 278 34.85 Topic 254 34.24 Topic 279 81.13 Topic 255 46.43 Topic 280 7.44 0 Topic 256 82.78 Topic 281 96.30 Topic 257 10.91 Topic 282 1.19 −0.5 Topic 258 25.50 Topic 283 60.28 Topic 259 36.18 Topic 284 23.86 Topic 260 15.93 Topic 285 8.44 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 23.33 Topic 286 21.56 Topic Number Topic 262 6.45 Topic 287 14.78 Topic 263 13.59 Topic 288 10.13 CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 276 to 300) Topic 264 33.77 Topic 289 78.57 1 Topic 265 27.42 Topic 290 47.31 aHTSTxNP01ST1 Difference (average precision) Topic 266 21.20 Topic 291 66.00 0.5 Topic 267 64.97 Topic 292 52.00 Topic 268 64.83 Topic 293 82.35 Topic 269 3.61 Topic 294 95.00 0 Topic 270 23.80 Topic 295 18.20 Topic 271 36.79 Topic 296 18.19 Topic 272 14.29 Topic 297 51.05 −0.5 Topic 273 28.78 Topic 298 2.48 Topic 274 27.08 Topic 299 5.02 −1 Topic 275 83.33 Topic 300 43.33 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.297 miracle xNP01ST1 AH-Monolingual-HU Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Hungarian Retrieved 50,000 RunType= automatic Relevant 939 QueryType= TD Relevant retrieved 827 Pooled= true CLEF 2005 AH−Monolingual−HU − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 72.72 xNP01ST1 90% 10 60.86 20 53.83 80% 30 46.56 70% 40 40.75 50 37.76 Average Precision 60% 60 30.16 50% 70 24.98 80 19.22 40% 90 11.05 30% 100 7.03 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 35.20 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−HU − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 44.80 xNP01ST1 90% 10 docs 35.00 15 docs 29.60 80% 20 docs 25.90 70% 30 docs 22.00 100 docs 10.92 60% R−Precision 200 docs 6.53 50% 500 docs 3.11 1000 docs 1.65 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 34.24 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 251 to 275) queries 1 xNP01ST1 Topic 251 3.97 Topic 276 26.05 Difference (average precision) Topic 252 6.25 Topic 277 1.08 0.5 Topic 253 39.01 Topic 278 32.16 Topic 254 32.72 Topic 279 88.00 Topic 255 46.30 Topic 280 8.75 0 Topic 256 80.33 Topic 281 96.91 Topic 257 12.34 Topic 282 1.19 −0.5 Topic 258 13.75 Topic 283 60.07 Topic 259 15.80 Topic 284 20.49 Topic 260 18.51 Topic 285 5.20 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 44.44 Topic 286 24.46 Topic Number Topic 262 5.92 Topic 287 13.94 Topic 263 13.38 Topic 288 11.48 CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 276 to 300) Topic 264 38.74 Topic 289 85.74 1 Topic 265 37.51 Topic 290 51.56 xNP01ST1 Difference (average precision) Topic 266 23.03 Topic 291 68.59 0.5 Topic 267 66.35 Topic 292 51.79 Topic 268 65.39 Topic 293 83.30 Topic 269 2.85 Topic 294 95.00 0 Topic 270 29.85 Topic 295 30.98 Topic 271 43.36 Topic 296 17.93 Topic 272 14.29 Topic 297 58.60 −0.5 Topic 273 26.37 Topic 298 4.27 Topic 274 24.10 Topic 299 2.23 −1 Topic 275 70.00 Topic 300 45.59 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.298 tlr tlrTDhuE AH-Monolingual-HU Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Hungarian Retrieved 50,000 RunType= automatic Relevant 939 QueryType= TD Relevant retrieved 665 Pooled= true CLEF 2005 AH−Monolingual−HU − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 62.91 tlrTDhuE 90% 10 54.70 20 45.92 80% 30 40.11 70% 40 32.39 50 29.55 Average Precision 60% 60 23.47 50% 70 20.95 80 17.61 40% 90 10.48 30% 100 6.91 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 29.52 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−HU − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 42.40 tlrTDhuE 90% 10 docs 35.20 15 docs 30.40 80% 20 docs 27.30 70% 30 docs 21.33 100 docs 9.52 60% R−Precision 200 docs 5.58 50% 500 docs 2.59 1000 docs 1.33 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 32.10 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 251 to 275) queries 1 tlrTDhuE Topic 251 9.04 Topic 276 21.84 Difference (average precision) Topic 252 4.98 Topic 277 0.00 0.5 Topic 253 0.02 Topic 278 0.02 Topic 254 24.30 Topic 279 36.73 Topic 255 47.24 Topic 280 8.49 0 Topic 256 75.14 Topic 281 76.40 Topic 257 28.12 Topic 282 0.47 −0.5 Topic 258 0.00 Topic 283 47.08 Topic 259 32.29 Topic 284 17.93 Topic 260 15.04 Topic 285 36.04 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 17.19 Topic 286 18.11 Topic Number Topic 262 2.19 Topic 287 32.22 Topic 263 3.39 Topic 288 16.85 CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 276 to 300) Topic 264 13.75 Topic 289 94.72 1 Topic 265 34.67 Topic 290 48.53 tlrTDhuE Difference (average precision) Topic 266 17.18 Topic 291 42.76 0.5 Topic 267 58.52 Topic 292 18.10 Topic 268 68.17 Topic 293 84.75 Topic 269 1.45 Topic 294 100.00 0 Topic 270 15.79 Topic 295 26.41 Topic 271 35.07 Topic 296 24.76 Topic 272 0.00 Topic 297 61.76 −0.5 Topic 273 28.75 Topic 298 30.10 Topic 274 33.01 Topic 299 2.76 −1 Topic 275 33.33 Topic 300 30.28 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.299 tlr tlrTDhuSC AH-Monolingual-HU Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Hungarian Retrieved 50,000 RunType= automatic Relevant 939 QueryType= TD Relevant retrieved 661 Pooled= true CLEF 2005 AH−Monolingual−HU − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 65.15 tlrTDhuSC 90% 10 56.74 20 46.01 80% 30 39.26 70% 40 31.24 50 28.84 Average Precision 60% 60 23.50 50% 70 19.77 80 16.79 40% 90 12.12 30% 100 8.56 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 29.64 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−HU − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 41.20 tlrTDhuSC 90% 10 docs 33.60 15 docs 28.67 80% 20 docs 26.10 70% 30 docs 21.73 100 docs 9.74 60% R−Precision 200 docs 5.59 50% 500 docs 2.57 1000 docs 1.32 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 29.99 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 251 to 275) queries 1 tlrTDhuSC Topic 251 8.32 Topic 276 25.77 Difference (average precision) Topic 252 8.74 Topic 277 0.00 0.5 Topic 253 0.08 Topic 278 0.00 Topic 254 36.16 Topic 279 41.49 Topic 255 47.26 Topic 280 6.47 0 Topic 256 79.27 Topic 281 92.59 Topic 257 28.37 Topic 282 0.46 −0.5 Topic 258 0.00 Topic 283 46.62 Topic 259 34.05 Topic 284 19.02 Topic 260 21.25 Topic 285 12.73 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 17.21 Topic 286 16.81 Topic Number Topic 262 2.28 Topic 287 32.94 Topic 263 2.68 Topic 288 20.36 CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 276 to 300) Topic 264 13.94 Topic 289 94.72 1 Topic 265 20.22 Topic 290 47.28 tlrTDhuSC Difference (average precision) Topic 266 17.10 Topic 291 46.96 0.5 Topic 267 44.47 Topic 292 25.00 Topic 268 68.18 Topic 293 71.07 Topic 269 1.20 Topic 294 100.00 0 Topic 270 15.80 Topic 295 26.84 Topic 271 35.06 Topic 296 24.21 Topic 272 0.00 Topic 297 46.74 −0.5 Topic 273 26.45 Topic 298 23.96 Topic 274 59.05 Topic 299 27.00 −1 Topic 275 15.48 Topic 300 30.44 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.300 u.budapest qalltall AH-Monolingual-HU Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Hungarian Retrieved 48,867 RunType= automatic Relevant 939 QueryType= TD Relevant retrieved 759 Pooled= true CLEF 2005 AH−Monolingual−HU − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 64.91 qalltall 90% 10 50.57 20 43.35 80% 30 37.95 70% 40 31.62 50 28.19 Average Precision 60% 60 23.18 50% 70 19.76 80 14.09 40% 90 9.75 30% 100 6.88 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 28.02 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−HU − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 37.60 qalltall 90% 10 docs 29.40 15 docs 24.93 80% 20 docs 23.10 70% 30 docs 18.93 100 docs 9.38 60% R−Precision 200 docs 5.84 50% 500 docs 2.73 1000 docs 1.52 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 28.39 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 251 to 275) queries 1 qalltall Topic 251 24.47 Topic 276 18.23 Difference (average precision) Topic 252 3.63 Topic 277 0.06 0.5 Topic 253 21.80 Topic 278 20.52 Topic 254 3.24 Topic 279 22.45 Topic 255 50.12 Topic 280 9.65 0 Topic 256 67.72 Topic 281 68.40 Topic 257 22.50 Topic 282 0.79 −0.5 Topic 258 1.09 Topic 283 50.54 Topic 259 33.33 Topic 284 6.75 Topic 260 31.82 Topic 285 0.43 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 18.27 Topic 286 21.36 Topic Number Topic 262 57.69 Topic 287 13.21 Topic 263 12.78 Topic 288 7.47 CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 276 to 300) Topic 264 33.60 Topic 289 79.80 1 Topic 265 31.14 Topic 290 9.16 qalltall Difference (average precision) Topic 266 5.04 Topic 291 54.94 0.5 Topic 267 44.91 Topic 292 13.62 Topic 268 70.25 Topic 293 95.64 Topic 269 4.16 Topic 294 80.42 0 Topic 270 18.70 Topic 295 8.90 Topic 271 29.13 Topic 296 9.87 Topic 272 0.95 Topic 297 51.19 −0.5 Topic 273 29.50 Topic 298 5.96 Topic 274 55.91 Topic 299 7.42 −1 Topic 275 26.67 Topic 300 45.88 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.301 u.budapest qfirststemtall AH-Monolingual-HU Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Hungarian Retrieved 48,867 RunType= automatic Relevant 939 QueryType= TD Relevant retrieved 815 Pooled= true CLEF 2005 AH−Monolingual−HU − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 65.29 qfirststemtall 90% 10 59.02 20 49.24 80% 30 42.76 70% 40 38.15 50 33.22 Average Precision 60% 60 24.90 50% 70 20.82 80 14.43 40% 90 10.13 30% 100 6.96 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 31.03 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−HU − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 39.60 qfirststemtall 90% 10 docs 32.00 15 docs 28.40 80% 20 docs 25.00 70% 30 docs 22.13 100 docs 11.02 60% R−Precision 200 docs 6.68 50% 500 docs 3.03 1000 docs 1.63 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 31.60 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 251 to 275) queries 1 qfirststemtall Topic 251 16.26 Topic 276 15.71 Difference (average precision) Topic 252 3.23 Topic 277 0.16 0.5 Topic 253 45.19 Topic 278 24.79 Topic 254 29.10 Topic 279 48.06 Topic 255 50.61 Topic 280 6.34 0 Topic 256 73.39 Topic 281 88.31 Topic 257 15.43 Topic 282 1.19 −0.5 Topic 258 22.77 Topic 283 50.54 Topic 259 27.26 Topic 284 15.13 Topic 260 16.73 Topic 285 19.00 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 18.98 Topic 286 11.71 Topic Number Topic 262 27.19 Topic 287 25.29 Topic 263 14.19 Topic 288 9.70 CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 276 to 300) Topic 264 40.21 Topic 289 79.80 1 Topic 265 35.63 Topic 290 47.08 qfirststemtall Difference (average precision) Topic 266 17.91 Topic 291 48.96 0.5 Topic 267 44.81 Topic 292 51.37 Topic 268 25.70 Topic 293 95.94 Topic 269 4.81 Topic 294 67.92 0 Topic 270 18.70 Topic 295 18.91 Topic 271 29.34 Topic 296 16.51 Topic 272 1.47 Topic 297 60.81 −0.5 Topic 273 20.08 Topic 298 17.09 Topic 274 77.67 Topic 299 6.96 −1 Topic 275 1.64 Topic 300 45.88 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.302 u.budapest qfstfs AH-Monolingual-HU Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Hungarian Retrieved 48,803 RunType= automatic Relevant 939 QueryType= TD Relevant retrieved 806 Pooled= true CLEF 2005 AH−Monolingual−HU − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 70.46 qfstfs 90% 10 56.78 20 50.97 80% 30 43.60 70% 40 38.03 50 33.12 Average Precision 60% 60 24.86 50% 70 21.00 80 14.17 40% 90 8.66 30% 100 6.22 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 31.38 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−HU − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 38.80 qfstfs 90% 10 docs 32.00 15 docs 28.67 80% 20 docs 25.80 70% 30 docs 21.60 100 docs 10.88 60% R−Precision 200 docs 6.59 50% 500 docs 3.06 1000 docs 1.61 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 32.16 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 251 to 275) queries 1 qfstfs Topic 251 10.87 Topic 276 19.07 Difference (average precision) Topic 252 2.60 Topic 277 0.20 0.5 Topic 253 43.08 Topic 278 18.36 Topic 254 26.19 Topic 279 62.00 Topic 255 50.57 Topic 280 13.26 0 Topic 256 71.29 Topic 281 88.48 Topic 257 15.83 Topic 282 3.19 −0.5 Topic 258 13.00 Topic 283 57.46 Topic 259 33.94 Topic 284 17.60 Topic 260 10.17 Topic 285 4.96 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 36.22 Topic 286 9.21 Topic Number Topic 262 24.84 Topic 287 25.74 Topic 263 11.79 Topic 288 10.62 CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 276 to 300) Topic 264 40.28 Topic 289 79.45 1 Topic 265 31.61 Topic 290 46.80 qfstfs Difference (average precision) Topic 266 19.51 Topic 291 51.43 0.5 Topic 267 42.99 Topic 292 51.32 Topic 268 43.97 Topic 293 84.50 Topic 269 1.21 Topic 294 80.42 0 Topic 270 20.85 Topic 295 16.69 Topic 271 32.92 Topic 296 19.73 Topic 272 1.54 Topic 297 50.63 −0.5 Topic 273 20.96 Topic 298 15.70 Topic 274 57.94 Topic 299 6.79 −1 Topic 275 25.23 Topic 300 46.19 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.303 u.budapest qnostemtall AH-Monolingual-HU Overall statistics for 48 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Hungarian Retrieved 42,831 RunType= automatic Relevant 922 QueryType= TD Relevant retrieved 626 Pooled= false CLEF 2005 AH−Monolingual−HU − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 47.89 qnostemtall 90% 10 41.56 20 34.95 80% 30 32.33 70% 40 27.01 50 21.65 Average Precision 60% 60 18.97 50% 70 15.19 80 12.77 40% 90 9.36 30% 100 7.26 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 22.61 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−HU − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 27.60 qnostemtall 90% 10 docs 25.80 15 docs 23.33 80% 20 docs 20.70 70% 30 docs 17.53 100 docs 8.40 60% R−Precision 200 docs 5.06 50% 500 docs 2.31 1000 docs 1.25 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 24.78 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 251 to 275) queries 1 qnostemtall Topic 251 7.76 Topic 276 17.33 Difference (average precision) Topic 252 0.00 Topic 277 1.08 0.5 Topic 253 30.52 Topic 278 4.44 Topic 254 23.23 Topic 279 0.01 Topic 255 12.62 Topic 280 5.09 0 Topic 256 72.04 Topic 281 88.29 Topic 257 22.53 Topic 282 2.35 −0.5 Topic 258 27.78 Topic 283 57.40 Topic 259 46.59 Topic 284 23.17 Topic 260 16.67 Topic 285 37.03 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.00 Topic 286 0.03 Topic Number Topic 262 23.80 Topic 287 17.91 Topic 263 0.05 Topic 288 6.18 CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 276 to 300) Topic 264 40.63 Topic 289 89.57 1 Topic 265 32.98 Topic 290 35.98 qnostemtall Difference (average precision) Topic 266 9.46 Topic 291 44.39 0.5 Topic 267 30.03 Topic 292 7.75 Topic 268 28.55 Topic 293 95.85 Topic 269 0.19 Topic 294 39.88 0 Topic 270 13.27 Topic 295 13.29 Topic 271 5.00 Topic 296 13.53 Topic 272 0.85 Topic 297 0.00 −0.5 Topic 273 18.08 Topic 298 0.00 Topic 274 59.37 Topic 299 7.86 −1 Topic 275 0.12 Topic 300 0.00 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.304 u.budapest qnostemtfirsstem AH-Monolingual-HU Overall statistics for 48 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Hungarian Retrieved 42,690 RunType= automatic Relevant 922 QueryType= TD Relevant retrieved 632 Pooled= false CLEF 2005 AH−Monolingual−HU − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 52.63 qnostemtfirsstem 90% 10 41.90 20 34.08 80% 30 30.23 70% 40 26.43 50 23.26 Average Precision 60% 60 19.80 50% 70 16.78 80 13.77 40% 90 9.47 30% 100 7.30 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 23.58 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−HU − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 30.80 qnostemtfirsstem 90% 10 docs 25.60 15 docs 22.93 80% 20 docs 20.60 70% 30 docs 17.27 100 docs 8.68 60% R−Precision 200 docs 5.16 50% 500 docs 2.36 1000 docs 1.26 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 23.80 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 251 to 275) queries 1 qnostemtfirsstem Topic 251 2.61 Topic 276 13.10 Difference (average precision) Topic 252 0.00 Topic 277 0.96 0.5 Topic 253 22.76 Topic 278 2.59 Topic 254 47.56 Topic 279 6.51 Topic 255 2.21 Topic 280 11.71 0 Topic 256 70.04 Topic 281 88.32 Topic 257 12.04 Topic 282 6.35 −0.5 Topic 258 24.44 Topic 283 54.29 Topic 259 42.99 Topic 284 23.76 Topic 260 23.95 Topic 285 24.88 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.00 Topic 286 0.23 Topic Number Topic 262 24.57 Topic 287 16.37 Topic 263 0.05 Topic 288 7.30 CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 276 to 300) Topic 264 24.16 Topic 289 89.57 1 Topic 265 35.52 Topic 290 37.17 qnostemtfirsstem Difference (average precision) Topic 266 10.76 Topic 291 50.51 0.5 Topic 267 45.71 Topic 292 2.63 Topic 268 39.70 Topic 293 84.98 Topic 269 0.05 Topic 294 95.00 0 Topic 270 13.03 Topic 295 13.38 Topic 271 5.37 Topic 296 16.97 Topic 272 0.82 Topic 297 0.00 −0.5 Topic 273 19.25 Topic 298 0.02 Topic 274 49.71 Topic 299 6.80 −1 Topic 275 8.33 Topic 300 0.00 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.305 u.budapest qnostemtnostem AH-Monolingual-HU Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Hungarian Retrieved 46,123 RunType= automatic Relevant 939 QueryType= TD Relevant retrieved 651 Pooled= true CLEF 2005 AH−Monolingual−HU − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 55.05 qnostemtnostem 90% 10 41.97 20 33.96 80% 30 29.44 70% 40 23.79 50 21.79 Average Precision 60% 60 16.66 50% 70 14.33 80 10.20 40% 90 6.56 30% 100 4.95 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 21.51 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−HU − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 29.20 qnostemtnostem 90% 10 docs 25.20 15 docs 23.07 80% 20 docs 20.40 70% 30 docs 17.67 100 docs 8.48 60% R−Precision 200 docs 5.24 50% 500 docs 2.42 1000 docs 1.30 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 23.91 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 251 to 275) queries 1 qnostemtnostem Topic 251 1.73 Topic 276 21.15 Difference (average precision) Topic 252 0.00 Topic 277 1.40 0.5 Topic 253 16.92 Topic 278 11.74 Topic 254 16.04 Topic 279 3.86 Topic 255 11.16 Topic 280 12.63 0 Topic 256 60.47 Topic 281 87.02 Topic 257 13.24 Topic 282 5.22 −0.5 Topic 258 4.17 Topic 283 44.57 Topic 259 19.68 Topic 284 9.42 Topic 260 20.04 Topic 285 1.27 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 4.49 Topic 286 0.42 Topic Number Topic 262 19.91 Topic 287 13.27 Topic 263 0.82 Topic 288 3.12 CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 276 to 300) Topic 264 30.71 Topic 289 91.16 1 Topic 265 34.07 Topic 290 39.82 qnostemtnostem Difference (average precision) Topic 266 14.75 Topic 291 51.43 0.5 Topic 267 30.74 Topic 292 2.35 Topic 268 40.22 Topic 293 70.51 Topic 269 1.88 Topic 294 69.64 0 Topic 270 15.67 Topic 295 21.41 Topic 271 26.05 Topic 296 17.82 Topic 272 0.53 Topic 297 18.52 −0.5 Topic 273 19.86 Topic 298 0.17 Topic 274 43.41 Topic 299 5.11 −1 Topic 275 25.80 Topic 300 0.00 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.306 u.glasgow glahutdn AH-Monolingual-HU Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Hungarian Retrieved 50,000 RunType= automatic Relevant 939 QueryType= TDN Relevant retrieved 386 Pooled= true CLEF 2005 AH−Monolingual−HU − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 41.91 glahutdn 90% 10 31.72 20 23.76 80% 30 11.78 70% 40 8.14 50 5.03 Average Precision 60% 60 1.34 50% 70 0.03 80 0.01 40% 90 0.01 30% 100 0.01 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 9.59 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−HU − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 20.80 glahutdn 90% 10 docs 16.40 15 docs 14.27 80% 20 docs 12.90 70% 30 docs 11.13 100 docs 4.78 60% R−Precision 200 docs 2.73 50% 500 docs 1.34 1000 docs 0.77 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 12.80 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 251 to 275) queries 1 glahutdn Topic 251 0.55 Topic 276 4.15 Difference (average precision) Topic 252 7.22 Topic 277 2.61 0.5 Topic 253 11.30 Topic 278 0.71 Topic 254 31.19 Topic 279 6.11 Topic 255 0.12 Topic 280 1.69 0 Topic 256 24.19 Topic 281 41.29 Topic 257 0.02 Topic 282 0.13 −0.5 Topic 258 3.03 Topic 283 15.53 Topic 259 0.46 Topic 284 1.57 Topic 260 0.14 Topic 285 0.14 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 1.39 Topic 286 4.38 Topic Number Topic 262 26.84 Topic 287 2.37 Topic 263 8.24 Topic 288 0.95 CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 276 to 300) Topic 264 0.32 Topic 289 3.28 1 Topic 265 14.04 Topic 290 19.07 glahutdn Difference (average precision) Topic 266 2.92 Topic 291 8.29 0.5 Topic 267 5.77 Topic 292 0.00 Topic 268 24.20 Topic 293 32.62 Topic 269 0.74 Topic 294 31.25 0 Topic 270 11.07 Topic 295 9.81 Topic 271 22.22 Topic 296 9.00 Topic 272 0.45 Topic 297 17.63 −0.5 Topic 273 10.55 Topic 298 0.92 Topic 274 42.37 Topic 299 12.50 −1 Topic 275 3.57 Topic 300 0.34 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.307 u.glasgow glahutdnqe AH-Monolingual-HU Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Hungarian Retrieved 50,000 RunType= automatic Relevant 939 QueryType= TDN Relevant retrieved 392 Pooled= false CLEF 2005 AH−Monolingual−HU − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 42.82 glahutdnqe 90% 10 33.28 20 25.92 80% 30 14.38 70% 40 8.99 50 5.70 Average Precision 60% 60 1.84 50% 70 0.05 80 0.02 40% 90 0.02 30% 100 0.02 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 10.39 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−HU − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 21.20 glahutdnqe 90% 10 docs 18.40 15 docs 15.60 80% 20 docs 13.50 70% 30 docs 10.87 100 docs 5.18 60% R−Precision 200 docs 2.88 50% 500 docs 1.40 1000 docs 0.78 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 14.41 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 251 to 275) queries 1 glahutdnqe Topic 251 0.49 Topic 276 4.34 Difference (average precision) Topic 252 13.64 Topic 277 3.97 0.5 Topic 253 14.58 Topic 278 0.25 Topic 254 32.85 Topic 279 4.12 Topic 255 0.09 Topic 280 1.91 0 Topic 256 25.42 Topic 281 47.52 Topic 257 0.02 Topic 282 0.11 −0.5 Topic 258 0.93 Topic 283 16.30 Topic 259 0.61 Topic 284 0.76 Topic 260 0.14 Topic 285 0.13 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.53 Topic 286 5.86 Topic Number Topic 262 27.83 Topic 287 3.10 Topic 263 11.07 Topic 288 1.27 CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 276 to 300) Topic 264 0.58 Topic 289 1.50 1 Topic 265 13.82 Topic 290 22.51 glahutdnqe Difference (average precision) Topic 266 3.53 Topic 291 7.66 0.5 Topic 267 9.18 Topic 292 0.00 Topic 268 24.07 Topic 293 40.46 Topic 269 0.89 Topic 294 37.50 0 Topic 270 13.73 Topic 295 9.67 Topic 271 22.22 Topic 296 10.77 Topic 272 1.23 Topic 297 16.40 −0.5 Topic 273 10.02 Topic 298 0.89 Topic 274 40.19 Topic 299 8.33 −1 Topic 275 6.25 Topic 300 0.20 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.308 u.glasgow glahutdqe AH-Monolingual-HU Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Hungarian Retrieved 50,000 RunType= automatic Relevant 939 QueryType= TD Relevant retrieved 392 Pooled= true CLEF 2005 AH−Monolingual−HU − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 42.82 glahutdqe 90% 10 33.28 20 25.92 80% 30 14.38 70% 40 8.99 50 5.70 Average Precision 60% 60 1.84 50% 70 0.05 80 0.02 40% 90 0.02 30% 100 0.02 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 10.39 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−HU − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 21.20 glahutdqe 90% 10 docs 18.40 15 docs 15.60 80% 20 docs 13.50 70% 30 docs 10.87 100 docs 5.18 60% R−Precision 200 docs 2.88 50% 500 docs 1.40 1000 docs 0.78 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 14.41 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 251 to 275) queries 1 glahutdqe Topic 251 0.49 Topic 276 4.34 Difference (average precision) Topic 252 13.64 Topic 277 3.97 0.5 Topic 253 14.58 Topic 278 0.25 Topic 254 32.85 Topic 279 4.12 Topic 255 0.09 Topic 280 1.91 0 Topic 256 25.42 Topic 281 47.52 Topic 257 0.02 Topic 282 0.11 −0.5 Topic 258 0.93 Topic 283 16.30 Topic 259 0.61 Topic 284 0.76 Topic 260 0.14 Topic 285 0.13 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.53 Topic 286 5.86 Topic Number Topic 262 27.83 Topic 287 3.10 Topic 263 11.07 Topic 288 1.27 CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 276 to 300) Topic 264 0.58 Topic 289 1.50 1 Topic 265 13.82 Topic 290 22.51 glahutdqe Difference (average precision) Topic 266 3.53 Topic 291 7.66 0.5 Topic 267 9.18 Topic 292 0.00 Topic 268 24.07 Topic 293 40.46 Topic 269 0.89 Topic 294 37.50 0 Topic 270 13.73 Topic 295 9.67 Topic 271 22.22 Topic 296 10.77 Topic 272 1.23 Topic 297 16.40 −0.5 Topic 273 10.02 Topic 298 0.89 Topic 274 40.19 Topic 299 8.33 −1 Topic 275 6.25 Topic 300 0.20 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.309 unine UniNEhu1 AH-Monolingual-HU Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Hungarian Retrieved 50,000 RunType= automatic Relevant 939 QueryType= TD Relevant retrieved 897 Pooled= true CLEF 2005 AH−Monolingual−HU − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 66.09 UniNEhu1 90% 10 57.66 20 54.04 80% 30 47.80 70% 40 43.21 50 41.21 Average Precision 60% 60 34.59 50% 70 29.38 80 22.02 40% 90 14.40 30% 100 9.27 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 36.99 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−HU − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 42.80 UniNEhu1 90% 10 docs 37.00 15 docs 31.73 80% 20 docs 28.50 70% 30 docs 24.53 100 docs 12.24 60% R−Precision 200 docs 7.35 50% 500 docs 3.39 1000 docs 1.79 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 36.34 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 251 to 275) queries 1 UniNEhu1 Topic 251 1.88 Topic 276 33.39 Difference (average precision) Topic 252 20.95 Topic 277 0.70 0.5 Topic 253 40.09 Topic 278 36.10 Topic 254 57.92 Topic 279 89.41 Topic 255 42.00 Topic 280 8.68 0 Topic 256 78.86 Topic 281 97.50 Topic 257 32.84 Topic 282 1.66 −0.5 Topic 258 22.55 Topic 283 61.94 Topic 259 16.75 Topic 284 23.90 Topic 260 7.48 Topic 285 33.17 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 0.86 Topic 286 13.46 Topic Number Topic 262 4.79 Topic 287 72.46 Topic 263 9.90 Topic 288 25.08 CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 276 to 300) Topic 264 32.73 Topic 289 92.84 1 Topic 265 23.02 Topic 290 66.10 UniNEhu1 Difference (average precision) Topic 266 22.71 Topic 291 63.52 0.5 Topic 267 55.91 Topic 292 25.60 Topic 268 68.03 Topic 293 88.96 Topic 269 4.30 Topic 294 85.00 0 Topic 270 21.38 Topic 295 18.92 Topic 271 74.87 Topic 296 17.70 Topic 272 20.00 Topic 297 70.96 −0.5 Topic 273 33.32 Topic 298 8.98 Topic 274 44.97 Topic 299 4.11 −1 Topic 275 66.67 Topic 300 4.78 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.310 unine UniNEhu2 AH-Monolingual-HU Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Hungarian Retrieved 50,000 RunType= automatic Relevant 939 QueryType= TD Relevant retrieved 797 Pooled= true CLEF 2005 AH−Monolingual−HU − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 69.07 UniNEhu2 90% 10 60.25 20 53.00 80% 30 44.68 70% 40 40.38 50 38.15 Average Precision 60% 60 28.53 50% 70 23.12 80 16.45 40% 90 10.82 30% 100 7.91 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 33.95 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−HU − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 41.60 UniNEhu2 90% 10 docs 34.00 15 docs 29.33 80% 20 docs 26.90 70% 30 docs 21.87 100 docs 10.48 60% R−Precision 200 docs 6.40 50% 500 docs 3.03 1000 docs 1.59 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 33.77 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 251 to 275) queries 1 UniNEhu2 Topic 251 0.63 Topic 276 28.84 Difference (average precision) Topic 252 2.46 Topic 277 0.18 0.5 Topic 253 34.38 Topic 278 39.48 Topic 254 52.88 Topic 279 78.09 Topic 255 50.07 Topic 280 8.67 0 Topic 256 71.64 Topic 281 97.20 Topic 257 16.20 Topic 282 10.15 −0.5 Topic 258 33.46 Topic 283 51.63 Topic 259 25.92 Topic 284 29.13 Topic 260 11.98 Topic 285 19.57 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 39.73 Topic 286 7.61 Topic Number Topic 262 15.48 Topic 287 23.81 Topic 263 8.53 Topic 288 8.22 CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 276 to 300) Topic 264 33.86 Topic 289 93.18 1 Topic 265 17.62 Topic 290 51.59 UniNEhu2 Difference (average precision) Topic 266 24.01 Topic 291 70.23 0.5 Topic 267 45.59 Topic 292 50.93 Topic 268 59.27 Topic 293 87.45 Topic 269 6.62 Topic 294 77.08 0 Topic 270 8.30 Topic 295 26.30 Topic 271 47.68 Topic 296 20.29 Topic 272 14.29 Topic 297 56.03 −0.5 Topic 273 39.28 Topic 298 9.04 Topic 274 25.79 Topic 299 3.82 −1 Topic 275 50.55 Topic 300 12.91 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.311 unine UniNEhu3 AH-Monolingual-HU Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Hungarian Retrieved 50,000 RunType= automatic Relevant 939 QueryType= TD Relevant retrieved 882 Pooled= false CLEF 2005 AH−Monolingual−HU − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 68.57 UniNEhu3 90% 10 61.11 20 56.79 80% 30 50.79 70% 40 46.75 50 43.10 Average Precision 60% 60 33.18 50% 70 30.12 80 26.01 40% 90 17.76 30% 100 10.27 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 38.89 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−HU − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 42.00 UniNEhu3 90% 10 docs 38.00 15 docs 34.80 80% 20 docs 31.50 70% 30 docs 26.67 100 docs 13.20 60% R−Precision 200 docs 7.61 50% 500 docs 3.41 1000 docs 1.76 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 38.64 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 251 to 275) queries 1 UniNEhu3 Topic 251 7.61 Topic 276 32.09 Difference (average precision) Topic 252 14.79 Topic 277 2.98 0.5 Topic 253 47.95 Topic 278 30.55 Topic 254 64.27 Topic 279 90.53 Topic 255 45.77 Topic 280 7.29 0 Topic 256 80.16 Topic 281 97.22 Topic 257 36.13 Topic 282 8.62 −0.5 Topic 258 22.42 Topic 283 57.55 Topic 259 22.95 Topic 284 32.35 Topic 260 24.76 Topic 285 46.76 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 5.80 Topic 286 8.38 Topic Number Topic 262 12.19 Topic 287 68.62 Topic 263 13.84 Topic 288 19.06 CLEF 2005 AH−Monolingual−HU − Comparison to median by topic (topics 276 to 300) Topic 264 31.88 Topic 289 97.50 1 Topic 265 27.81 Topic 290 74.67 UniNEhu3 Difference (average precision) Topic 266 19.13 Topic 291 63.94 0.5 Topic 267 66.65 Topic 292 51.54 Topic 268 66.26 Topic 293 93.56 Topic 269 3.50 Topic 294 89.29 0 Topic 270 22.65 Topic 295 18.58 Topic 271 41.24 Topic 296 27.15 Topic 272 5.88 Topic 297 58.85 −0.5 Topic 273 36.85 Topic 298 8.22 Topic 274 73.47 Topic 299 2.92 −1 Topic 275 58.33 Topic 300 4.04 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.312 alicante IRn-pt-fexp AH-Monolingual-PT Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Portuguese Retrieved 50,000 RunType= automatic Relevant 2,904 QueryType= TD Relevant retrieved 2,441 Pooled= false CLEF 2005 AH−Monolingual−PT − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 75.26 IRn−pt−fexp 90% 10 61.91 20 53.54 80% 30 47.17 70% 40 39.64 50 34.27 Average Precision 60% 60 27.55 50% 70 22.67 80 17.06 40% 90 11.31 30% 100 5.29 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 34.46 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−PT − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 56.40 IRn−pt−fexp 90% 10 docs 53.00 15 docs 49.87 80% 20 docs 46.70 70% 30 docs 42.27 100 docs 26.20 60% R−Precision 200 docs 17.34 50% 500 docs 8.82 1000 docs 4.88 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 35.91 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 251 to 275) queries 1 IRn−pt−fexp Topic 251 54.75 Topic 276 30.63 Difference (average precision) Topic 252 39.20 Topic 277 12.65 0.5 Topic 253 33.64 Topic 278 45.91 Topic 254 54.60 Topic 279 48.93 Topic 255 23.78 Topic 280 3.97 0 Topic 256 96.13 Topic 281 58.26 Topic 257 14.80 Topic 282 20.19 −0.5 Topic 258 15.00 Topic 283 77.48 Topic 259 41.79 Topic 284 32.79 Topic 260 9.47 Topic 285 29.01 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 20.25 Topic 286 48.09 Topic Number Topic 262 15.01 Topic 287 15.39 Topic 263 8.55 Topic 288 1.71 CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 276 to 300) Topic 264 54.80 Topic 289 40.51 1 Topic 265 23.30 Topic 290 71.15 IRn−pt−fexp Difference (average precision) Topic 266 50.81 Topic 291 29.60 0.5 Topic 267 13.82 Topic 292 5.66 Topic 268 26.67 Topic 293 69.64 Topic 269 10.58 Topic 294 66.93 0 Topic 270 34.83 Topic 295 35.72 Topic 271 56.33 Topic 296 37.90 Topic 272 16.39 Topic 297 38.53 −0.5 Topic 273 50.74 Topic 298 48.31 Topic 274 7.91 Topic 299 39.44 −1 Topic 275 38.21 Topic 300 3.00 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.313 alicante IRn-pt-vexp AH-Monolingual-PT Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Portuguese Retrieved 50,000 RunType= automatic Relevant 2,904 QueryType= TD Relevant retrieved 2,490 Pooled= true CLEF 2005 AH−Monolingual−PT − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 75.78 IRn−pt−vexp 90% 10 63.61 20 55.39 80% 30 48.70 70% 40 42.34 50 36.05 Average Precision 60% 60 29.43 50% 70 24.80 80 17.99 40% 90 11.84 30% 100 4.80 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 36.03 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−PT − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 58.80 IRn−pt−vexp 90% 10 docs 52.20 15 docs 48.13 80% 20 docs 46.90 70% 30 docs 42.80 100 docs 27.26 60% R−Precision 200 docs 18.05 50% 500 docs 8.96 1000 docs 4.98 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 37.59 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 251 to 275) queries 1 IRn−pt−vexp Topic 251 58.84 Topic 276 30.70 Difference (average precision) Topic 252 36.81 Topic 277 11.55 0.5 Topic 253 38.19 Topic 278 47.47 Topic 254 52.57 Topic 279 57.08 Topic 255 31.91 Topic 280 6.08 0 Topic 256 94.88 Topic 281 61.85 Topic 257 16.30 Topic 282 21.27 −0.5 Topic 258 7.32 Topic 283 78.45 Topic 259 39.63 Topic 284 35.59 Topic 260 9.65 Topic 285 30.40 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 18.43 Topic 286 53.36 Topic Number Topic 262 15.23 Topic 287 14.69 Topic 263 7.91 Topic 288 2.12 CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 276 to 300) Topic 264 57.18 Topic 289 46.52 1 Topic 265 31.81 Topic 290 74.23 IRn−pt−vexp Difference (average precision) Topic 266 52.38 Topic 291 26.86 0.5 Topic 267 21.46 Topic 292 6.87 Topic 268 28.80 Topic 293 66.16 Topic 269 11.18 Topic 294 69.39 0 Topic 270 38.07 Topic 295 42.06 Topic 271 56.67 Topic 296 42.49 Topic 272 17.23 Topic 297 44.45 −0.5 Topic 273 47.49 Topic 298 38.73 Topic 274 16.31 Topic 299 42.09 −1 Topic 275 40.35 Topic 300 4.24 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.314 alicante IRn-pt-vnexp AH-Monolingual-PT Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Portuguese Retrieved 50,000 RunType= automatic Relevant 2,904 QueryType= TD Relevant retrieved 2,409 Pooled= false CLEF 2005 AH−Monolingual−PT − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 79.40 IRn−pt−vnexp 90% 10 64.35 20 51.23 80% 30 42.83 70% 40 36.74 50 32.21 Average Precision 60% 60 26.90 50% 70 21.23 80 15.37 40% 90 10.33 30% 100 4.89 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 33.15 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−PT − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 57.60 IRn−pt−vnexp 90% 10 docs 51.00 15 docs 47.47 80% 20 docs 43.40 70% 30 docs 39.87 100 docs 25.14 60% R−Precision 200 docs 16.95 50% 500 docs 8.59 1000 docs 4.82 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 35.01 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 251 to 275) queries 1 IRn−pt−vnexp Topic 251 54.17 Topic 276 21.91 Difference (average precision) Topic 252 18.61 Topic 277 5.43 0.5 Topic 253 27.69 Topic 278 33.54 Topic 254 34.56 Topic 279 39.61 Topic 255 22.75 Topic 280 7.27 0 Topic 256 94.88 Topic 281 50.29 Topic 257 15.09 Topic 282 20.56 −0.5 Topic 258 25.00 Topic 283 66.69 Topic 259 45.73 Topic 284 32.53 Topic 260 12.63 Topic 285 34.12 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 19.91 Topic 286 52.12 Topic Number Topic 262 8.42 Topic 287 15.86 Topic 263 10.19 Topic 288 6.07 CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 276 to 300) Topic 264 50.67 Topic 289 45.51 1 Topic 265 27.53 Topic 290 47.38 IRn−pt−vnexp Difference (average precision) Topic 266 53.12 Topic 291 26.10 0.5 Topic 267 30.34 Topic 292 8.40 Topic 268 50.41 Topic 293 58.78 Topic 269 8.83 Topic 294 70.99 0 Topic 270 27.85 Topic 295 38.43 Topic 271 59.33 Topic 296 39.98 Topic 272 30.72 Topic 297 28.95 −0.5 Topic 273 37.77 Topic 298 35.26 Topic 274 38.87 Topic 299 43.38 −1 Topic 275 20.77 Topic 300 2.39 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.315 buffalo UBmono-pt-comb1 AH-Monolingual-PT Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Portuguese Retrieved 50,000 RunType= automatic Relevant 2,904 QueryType= TD Relevant retrieved 2,379 Pooled= false CLEF 2005 AH−Monolingual−PT − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 77.33 UBmono−pt−comb1 90% 10 58.93 20 49.60 80% 30 43.11 70% 40 35.83 50 30.56 Average Precision 60% 60 24.69 50% 70 20.30 80 14.66 40% 90 9.54 30% 100 3.67 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 31.66 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−PT − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 52.80 UBmono−pt−comb1 90% 10 docs 50.00 15 docs 45.87 80% 20 docs 43.60 70% 30 docs 38.87 100 docs 24.84 60% R−Precision 200 docs 16.78 50% 500 docs 8.51 1000 docs 4.76 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 33.76 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 251 to 275) queries 1 UBmono−pt−comb1 Topic 251 50.14 Topic 276 21.54 Difference (average precision) Topic 252 21.71 Topic 277 6.95 0.5 Topic 253 31.18 Topic 278 24.76 Topic 254 38.04 Topic 279 16.72 Topic 255 19.90 Topic 280 6.77 0 Topic 256 94.88 Topic 281 33.45 Topic 257 15.19 Topic 282 16.14 −0.5 Topic 258 5.80 Topic 283 69.67 Topic 259 37.20 Topic 284 31.48 Topic 260 16.79 Topic 285 45.66 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 11.21 Topic 286 29.31 Topic Number Topic 262 9.71 Topic 287 25.01 Topic 263 10.83 Topic 288 2.59 CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 276 to 300) Topic 264 50.47 Topic 289 62.68 1 Topic 265 27.38 Topic 290 50.63 UBmono−pt−comb1 Difference (average precision) Topic 266 53.55 Topic 291 26.11 0.5 Topic 267 39.96 Topic 292 26.51 Topic 268 44.30 Topic 293 57.98 Topic 269 9.11 Topic 294 75.74 0 Topic 270 21.45 Topic 295 44.45 Topic 271 70.06 Topic 296 36.59 Topic 272 15.89 Topic 297 16.83 −0.5 Topic 273 38.74 Topic 298 24.45 Topic 274 13.26 Topic 299 51.77 −1 Topic 275 31.82 Topic 300 0.82 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.316 buffalo UBmono-pt-rf1 AH-Monolingual-PT Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Portuguese Retrieved 50,000 RunType= automatic Relevant 2,904 QueryType= TD Relevant retrieved 2,375 Pooled= true CLEF 2005 AH−Monolingual−PT − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 74.14 UBmono−pt−rf1 90% 10 58.35 20 50.36 80% 30 43.83 70% 40 37.15 50 31.40 Average Precision 60% 60 25.09 50% 70 20.62 80 14.41 40% 90 9.24 30% 100 3.52 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 31.71 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−PT − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 54.00 UBmono−pt−rf1 90% 10 docs 50.00 15 docs 45.47 80% 20 docs 42.90 70% 30 docs 38.93 100 docs 24.86 60% R−Precision 200 docs 16.78 50% 500 docs 8.56 1000 docs 4.75 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 34.16 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 251 to 275) queries 1 UBmono−pt−rf1 Topic 251 52.40 Topic 276 15.48 Difference (average precision) Topic 252 21.38 Topic 277 5.01 0.5 Topic 253 30.29 Topic 278 20.50 Topic 254 41.53 Topic 279 17.83 Topic 255 20.16 Topic 280 6.02 0 Topic 256 94.06 Topic 281 33.17 Topic 257 14.59 Topic 282 16.99 −0.5 Topic 258 17.16 Topic 283 69.68 Topic 259 35.20 Topic 284 30.82 Topic 260 17.83 Topic 285 48.48 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 11.55 Topic 286 30.60 Topic Number Topic 262 11.21 Topic 287 24.30 Topic 263 11.01 Topic 288 2.20 CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 276 to 300) Topic 264 47.96 Topic 289 64.37 1 Topic 265 26.80 Topic 290 54.89 UBmono−pt−rf1 Difference (average precision) Topic 266 53.17 Topic 291 23.70 0.5 Topic 267 42.06 Topic 292 20.76 Topic 268 43.90 Topic 293 62.81 Topic 269 7.96 Topic 294 76.35 0 Topic 270 21.02 Topic 295 47.11 Topic 271 69.87 Topic 296 30.93 Topic 272 16.81 Topic 297 19.99 −0.5 Topic 273 40.05 Topic 298 20.38 Topic 274 13.88 Topic 299 50.37 −1 Topic 275 29.83 Topic 300 0.82 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.317 buffalo UBmono-pt-rf2 AH-Monolingual-PT Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Portuguese Retrieved 50,000 RunType= automatic Relevant 2,904 QueryType= TD Relevant retrieved 2,396 Pooled= false CLEF 2005 AH−Monolingual−PT − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 74.40 UBmono−pt−rf2 90% 10 59.13 20 50.09 80% 30 43.86 70% 40 36.89 50 31.32 Average Precision 60% 60 25.30 50% 70 20.90 80 14.75 40% 90 9.36 30% 100 3.71 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 31.89 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−PT − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 54.00 UBmono−pt−rf2 90% 10 docs 50.40 15 docs 45.60 80% 20 docs 42.80 70% 30 docs 38.47 100 docs 24.92 60% R−Precision 200 docs 16.81 50% 500 docs 8.60 1000 docs 4.79 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 34.40 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 251 to 275) queries 1 UBmono−pt−rf2 Topic 251 52.76 Topic 276 16.06 Difference (average precision) Topic 252 22.40 Topic 277 5.31 0.5 Topic 253 30.21 Topic 278 22.99 Topic 254 40.46 Topic 279 17.08 Topic 255 20.35 Topic 280 6.97 0 Topic 256 94.06 Topic 281 34.48 Topic 257 15.08 Topic 282 16.60 −0.5 Topic 258 17.01 Topic 283 69.67 Topic 259 35.09 Topic 284 31.49 Topic 260 18.77 Topic 285 48.92 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 11.34 Topic 286 29.21 Topic Number Topic 262 10.46 Topic 287 23.57 Topic 263 11.67 Topic 288 2.52 CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 276 to 300) Topic 264 47.89 Topic 289 64.53 1 Topic 265 27.12 Topic 290 57.20 UBmono−pt−rf2 Difference (average precision) Topic 266 52.57 Topic 291 23.80 0.5 Topic 267 41.92 Topic 292 25.44 Topic 268 43.08 Topic 293 63.92 Topic 269 7.93 Topic 294 75.62 0 Topic 270 21.24 Topic 295 48.34 Topic 271 69.97 Topic 296 31.47 Topic 272 15.60 Topic 297 19.91 −0.5 Topic 273 39.26 Topic 298 20.69 Topic 274 12.63 Topic 299 50.49 −1 Topic 275 28.62 Topic 300 0.84 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.318 buffalo UBmono-pt-rf3 AH-Monolingual-PT Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Portuguese Retrieved 50,000 RunType= automatic Relevant 2,904 QueryType= TD Relevant retrieved 2,375 Pooled= false CLEF 2005 AH−Monolingual−PT − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 76.72 UBmono−pt−rf3 90% 10 58.92 20 49.46 80% 30 43.08 70% 40 36.22 50 30.54 Average Precision 60% 60 25.07 50% 70 20.07 80 14.81 40% 90 9.47 30% 100 3.74 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 31.62 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−PT − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 54.00 UBmono−pt−rf3 90% 10 docs 50.40 15 docs 46.00 80% 20 docs 43.50 70% 30 docs 38.93 100 docs 24.72 60% R−Precision 200 docs 16.79 50% 500 docs 8.52 1000 docs 4.75 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 33.46 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 251 to 275) queries 1 UBmono−pt−rf3 Topic 251 50.44 Topic 276 21.44 Difference (average precision) Topic 252 22.98 Topic 277 6.31 0.5 Topic 253 30.82 Topic 278 24.31 Topic 254 41.00 Topic 279 17.72 Topic 255 19.52 Topic 280 6.09 0 Topic 256 94.44 Topic 281 31.68 Topic 257 14.73 Topic 282 16.28 −0.5 Topic 258 5.34 Topic 283 69.49 Topic 259 37.01 Topic 284 30.68 Topic 260 16.46 Topic 285 46.18 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 11.46 Topic 286 31.24 Topic Number Topic 262 10.43 Topic 287 24.31 Topic 263 10.54 Topic 288 2.59 CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 276 to 300) Topic 264 49.86 Topic 289 62.22 1 Topic 265 27.80 Topic 290 54.78 UBmono−pt−rf3 Difference (average precision) Topic 266 55.02 Topic 291 25.65 0.5 Topic 267 39.52 Topic 292 20.33 Topic 268 45.91 Topic 293 57.86 Topic 269 9.34 Topic 294 76.29 0 Topic 270 21.07 Topic 295 43.26 Topic 271 70.52 Topic 296 36.28 Topic 272 16.38 Topic 297 17.49 −0.5 Topic 273 39.28 Topic 298 23.30 Topic 274 11.75 Topic 299 51.53 −1 Topic 275 31.51 Topic 300 0.76 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.319 hummingbird humPT05t AH-Monolingual-PT Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Portuguese Retrieved 48,503 RunType= automatic Relevant 2,904 QueryType= T Relevant retrieved 2,074 Pooled= true CLEF 2005 AH−Monolingual−PT − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 77.30 humPT05t 90% 10 58.32 20 47.81 80% 30 41.66 70% 40 35.97 50 31.53 Average Precision 60% 60 22.59 50% 70 16.87 80 10.44 40% 90 6.79 30% 100 3.73 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 29.99 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−PT − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 51.20 humPT05t 90% 10 docs 47.80 15 docs 43.07 80% 20 docs 38.80 70% 30 docs 34.33 100 docs 22.02 60% R−Precision 200 docs 14.17 50% 500 docs 7.38 1000 docs 4.15 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 34.07 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 251 to 275) queries 1 humPT05t Topic 251 20.70 Topic 276 22.93 Difference (average precision) Topic 252 36.26 Topic 277 8.17 0.5 Topic 253 34.96 Topic 278 60.36 Topic 254 11.20 Topic 279 51.82 Topic 255 62.62 Topic 280 39.16 0 Topic 256 100.00 Topic 281 23.93 Topic 257 26.01 Topic 282 3.84 −0.5 Topic 258 50.00 Topic 283 73.51 Topic 259 44.95 Topic 284 40.69 Topic 260 0.21 Topic 285 43.72 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 10.17 Topic 286 48.79 Topic Number Topic 262 6.22 Topic 287 18.20 Topic 263 8.21 Topic 288 1.11 CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 276 to 300) Topic 264 15.81 Topic 289 78.82 1 Topic 265 29.03 Topic 290 37.94 humPT05t Difference (average precision) Topic 266 42.17 Topic 291 21.67 0.5 Topic 267 29.10 Topic 292 12.13 Topic 268 46.91 Topic 293 36.23 Topic 269 9.54 Topic 294 43.22 0 Topic 270 23.78 Topic 295 45.09 Topic 271 34.19 Topic 296 31.72 Topic 272 0.85 Topic 297 11.75 −0.5 Topic 273 13.21 Topic 298 30.49 Topic 274 9.63 Topic 299 20.34 −1 Topic 275 26.58 Topic 300 1.64 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.320 hummingbird humPT05td AH-Monolingual-PT Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Portuguese Retrieved 50,000 RunType= automatic Relevant 2,904 QueryType= TD Relevant retrieved 2,472 Pooled= false CLEF 2005 AH−Monolingual−PT − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 83.81 humPT05td 90% 10 66.50 20 53.30 80% 30 46.46 70% 40 40.67 50 36.60 Average Precision 60% 60 29.34 50% 70 22.76 80 17.38 40% 90 10.94 30% 100 4.77 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 35.72 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−PT − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 57.60 humPT05td 90% 10 docs 54.00 15 docs 49.73 80% 20 docs 46.10 70% 30 docs 41.60 100 docs 26.20 60% R−Precision 200 docs 17.81 50% 500 docs 9.08 1000 docs 4.94 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 38.21 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 251 to 275) queries 1 humPT05td Topic 251 47.50 Topic 276 29.28 Difference (average precision) Topic 252 27.04 Topic 277 8.91 0.5 Topic 253 24.20 Topic 278 37.23 Topic 254 37.88 Topic 279 47.85 Topic 255 38.68 Topic 280 10.25 0 Topic 256 96.53 Topic 281 47.71 Topic 257 16.66 Topic 282 24.94 −0.5 Topic 258 5.00 Topic 283 70.94 Topic 259 34.21 Topic 284 36.08 Topic 260 27.19 Topic 285 35.05 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 15.58 Topic 286 61.54 Topic Number Topic 262 8.69 Topic 287 17.72 Topic 263 18.71 Topic 288 12.17 CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 276 to 300) Topic 264 50.23 Topic 289 78.82 1 Topic 265 24.59 Topic 290 43.71 humPT05td Difference (average precision) Topic 266 52.16 Topic 291 26.33 0.5 Topic 267 41.43 Topic 292 23.83 Topic 268 40.70 Topic 293 49.73 Topic 269 9.19 Topic 294 74.58 0 Topic 270 32.33 Topic 295 31.44 Topic 271 64.92 Topic 296 40.91 Topic 272 24.50 Topic 297 38.59 −0.5 Topic 273 39.22 Topic 298 34.46 Topic 274 36.45 Topic 299 54.62 −1 Topic 275 34.00 Topic 300 1.70 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.321 hummingbird humPT05tde AH-Monolingual-PT Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Portuguese Retrieved 50,000 RunType= automatic Relevant 2,904 QueryType= TD Relevant retrieved 2,476 Pooled= false CLEF 2005 AH−Monolingual−PT − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 82.64 humPT05tde 90% 10 67.71 20 55.97 80% 30 50.86 70% 40 45.43 50 40.82 Average Precision 60% 60 33.60 50% 70 26.61 80 20.08 40% 90 13.13 30% 100 6.19 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 38.64 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−PT − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 58.80 humPT05tde 90% 10 docs 57.00 15 docs 52.13 80% 20 docs 48.70 70% 30 docs 44.67 100 docs 28.80 60% R−Precision 200 docs 18.75 50% 500 docs 9.24 1000 docs 4.95 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 40.55 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 251 to 275) queries 1 humPT05tde Topic 251 50.03 Topic 276 33.80 Difference (average precision) Topic 252 25.25 Topic 277 12.05 0.5 Topic 253 28.59 Topic 278 43.35 Topic 254 57.17 Topic 279 56.23 Topic 255 34.01 Topic 280 13.32 0 Topic 256 97.22 Topic 281 52.88 Topic 257 19.67 Topic 282 29.94 −0.5 Topic 258 0.49 Topic 283 75.46 Topic 259 33.38 Topic 284 36.13 Topic 260 22.87 Topic 285 28.17 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 16.73 Topic 286 56.30 Topic Number Topic 262 6.44 Topic 287 17.46 Topic 263 19.80 Topic 288 19.17 CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 276 to 300) Topic 264 69.92 Topic 289 72.12 1 Topic 265 25.82 Topic 290 74.13 humPT05tde Difference (average precision) Topic 266 58.89 Topic 291 30.78 0.5 Topic 267 32.13 Topic 292 21.87 Topic 268 42.66 Topic 293 62.68 Topic 269 10.22 Topic 294 79.11 0 Topic 270 29.24 Topic 295 37.63 Topic 271 69.57 Topic 296 39.71 Topic 272 23.42 Topic 297 43.98 −0.5 Topic 273 51.67 Topic 298 40.46 Topic 274 12.49 Topic 299 61.51 −1 Topic 275 54.32 Topic 300 1.87 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.322 jhu-apl aplmopta AH-Monolingual-PT Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Portuguese Retrieved 50,000 RunType= automatic Relevant 2,904 QueryType= TD Relevant retrieved 2,263 Pooled= false CLEF 2005 AH−Monolingual−PT − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 64.44 aplmopta 90% 10 53.48 20 47.59 80% 30 40.74 70% 40 35.29 50 31.06 Average Precision 60% 60 25.84 50% 70 20.92 80 16.24 40% 90 11.08 30% 100 7.37 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 30.63 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−PT − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 45.20 aplmopta 90% 10 docs 42.60 15 docs 40.27 80% 20 docs 38.80 70% 30 docs 35.87 100 docs 24.54 60% R−Precision 200 docs 16.38 50% 500 docs 8.24 1000 docs 4.53 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 32.62 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 251 to 275) queries 1 aplmopta Topic 251 43.29 Topic 276 23.06 Difference (average precision) Topic 252 32.91 Topic 277 10.46 0.5 Topic 253 12.29 Topic 278 30.58 Topic 254 58.59 Topic 279 49.90 Topic 255 5.20 Topic 280 0.84 0 Topic 256 100.00 Topic 281 36.85 Topic 257 13.90 Topic 282 12.07 −0.5 Topic 258 7.13 Topic 283 80.96 Topic 259 33.51 Topic 284 23.50 Topic 260 13.44 Topic 285 41.32 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 18.60 Topic 286 37.29 Topic Number Topic 262 1.02 Topic 287 15.22 Topic 263 7.94 Topic 288 0.63 CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 276 to 300) Topic 264 43.25 Topic 289 84.15 1 Topic 265 27.20 Topic 290 68.44 aplmopta Difference (average precision) Topic 266 24.65 Topic 291 22.22 0.5 Topic 267 49.06 Topic 292 29.20 Topic 268 12.44 Topic 293 73.10 Topic 269 5.00 Topic 294 51.03 0 Topic 270 25.06 Topic 295 24.33 Topic 271 47.94 Topic 296 49.39 Topic 272 27.83 Topic 297 35.79 −0.5 Topic 273 40.00 Topic 298 9.66 Topic 274 5.40 Topic 299 45.43 −1 Topic 275 19.90 Topic 300 0.73 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.323 jhu-apl aplmoptc AH-Monolingual-PT Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Portuguese Retrieved 50,000 RunType= automatic Relevant 2,904 QueryType= TD Relevant retrieved 2,446 Pooled= true CLEF 2005 AH−Monolingual−PT − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 79.71 aplmoptc 90% 10 62.87 20 54.27 80% 30 45.97 70% 40 40.61 50 35.75 Average Precision 60% 60 31.22 50% 70 24.42 80 19.32 40% 90 13.90 30% 100 7.34 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 36.10 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−PT − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 57.20 aplmoptc 90% 10 docs 52.60 15 docs 48.67 80% 20 docs 46.20 70% 30 docs 41.67 100 docs 26.26 60% R−Precision 200 docs 17.41 50% 500 docs 8.74 1000 docs 4.89 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 36.62 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 251 to 275) queries 1 aplmoptc Topic 251 72.62 Topic 276 40.17 Difference (average precision) Topic 252 7.51 Topic 277 14.77 0.5 Topic 253 20.24 Topic 278 35.86 Topic 254 68.11 Topic 279 44.31 Topic 255 6.16 Topic 280 17.66 0 Topic 256 100.00 Topic 281 38.62 Topic 257 23.43 Topic 282 16.91 −0.5 Topic 258 1.55 Topic 283 80.64 Topic 259 22.66 Topic 284 26.78 Topic 260 20.51 Topic 285 48.63 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 11.88 Topic 286 29.86 Topic Number Topic 262 3.55 Topic 287 26.03 Topic 263 9.79 Topic 288 0.52 CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 276 to 300) Topic 264 45.95 Topic 289 82.54 1 Topic 265 26.02 Topic 290 67.08 aplmoptc Difference (average precision) Topic 266 43.59 Topic 291 25.69 0.5 Topic 267 49.00 Topic 292 32.42 Topic 268 44.89 Topic 293 78.51 Topic 269 7.83 Topic 294 76.20 0 Topic 270 22.21 Topic 295 51.57 Topic 271 52.61 Topic 296 45.55 Topic 272 28.25 Topic 297 58.55 −0.5 Topic 273 49.96 Topic 298 10.65 Topic 274 20.59 Topic 299 46.90 −1 Topic 275 48.04 Topic 300 1.72 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.324 jhu-apl aplmoptd AH-Monolingual-PT Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Portuguese Retrieved 50,000 RunType= automatic Relevant 2,904 QueryType= TD Relevant retrieved 2,343 Pooled= false CLEF 2005 AH−Monolingual−PT − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 76.85 aplmoptd 90% 10 57.56 20 48.83 80% 30 41.20 70% 40 36.27 50 31.77 Average Precision 60% 60 26.73 50% 70 21.54 80 17.49 40% 90 11.72 30% 100 6.48 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 32.46 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−PT − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 52.00 aplmoptd 90% 10 docs 48.80 15 docs 45.87 80% 20 docs 44.00 70% 30 docs 38.73 100 docs 24.38 60% R−Precision 200 docs 16.47 50% 500 docs 8.33 1000 docs 4.69 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 32.33 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 251 to 275) queries 1 aplmoptd Topic 251 70.49 Topic 276 43.26 Difference (average precision) Topic 252 0.19 Topic 277 13.31 0.5 Topic 253 15.17 Topic 278 26.25 Topic 254 56.14 Topic 279 8.41 Topic 255 2.69 Topic 280 29.23 0 Topic 256 100.00 Topic 281 40.90 Topic 257 25.29 Topic 282 13.46 −0.5 Topic 258 0.85 Topic 283 80.43 Topic 259 19.51 Topic 284 25.83 Topic 260 18.34 Topic 285 39.75 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 11.84 Topic 286 28.52 Topic Number Topic 262 1.36 Topic 287 9.98 Topic 263 8.30 Topic 288 0.67 CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 276 to 300) Topic 264 42.93 Topic 289 82.21 1 Topic 265 25.83 Topic 290 55.12 aplmoptd Difference (average precision) Topic 266 41.07 Topic 291 26.59 0.5 Topic 267 42.64 Topic 292 19.10 Topic 268 43.25 Topic 293 69.64 Topic 269 5.75 Topic 294 57.89 0 Topic 270 21.23 Topic 295 50.47 Topic 271 49.88 Topic 296 48.10 Topic 272 29.79 Topic 297 59.07 −0.5 Topic 273 53.57 Topic 298 11.17 Topic 274 3.77 Topic 299 47.15 −1 Topic 275 44.64 Topic 300 1.91 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.325 jhu-apl aplmopte AH-Monolingual-PT Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Portuguese Retrieved 50,000 RunType= automatic Relevant 2,904 QueryType= TD Relevant retrieved 2,450 Pooled= false CLEF 2005 AH−Monolingual−PT − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 78.41 aplmopte 90% 10 62.96 20 54.44 80% 30 48.15 70% 40 41.24 50 36.52 Average Precision 60% 60 30.96 50% 70 25.55 80 19.14 40% 90 13.68 30% 100 7.39 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 36.54 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−PT − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 55.60 aplmopte 90% 10 docs 53.00 15 docs 48.93 80% 20 docs 46.60 70% 30 docs 41.87 100 docs 26.76 60% R−Precision 200 docs 17.67 50% 500 docs 8.82 1000 docs 4.90 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 37.00 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 251 to 275) queries 1 aplmopte Topic 251 72.60 Topic 276 35.91 Difference (average precision) Topic 252 24.58 Topic 277 15.61 0.5 Topic 253 22.67 Topic 278 34.79 Topic 254 68.82 Topic 279 50.71 Topic 255 13.27 Topic 280 2.99 0 Topic 256 100.00 Topic 281 36.92 Topic 257 21.67 Topic 282 19.00 −0.5 Topic 258 2.66 Topic 283 78.10 Topic 259 26.64 Topic 284 28.23 Topic 260 21.50 Topic 285 47.95 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 11.95 Topic 286 29.75 Topic Number Topic 262 5.78 Topic 287 34.14 Topic 263 10.47 Topic 288 0.34 CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 276 to 300) Topic 264 46.29 Topic 289 84.15 1 Topic 265 25.25 Topic 290 72.14 aplmopte Difference (average precision) Topic 266 43.89 Topic 291 24.86 0.5 Topic 267 51.54 Topic 292 36.34 Topic 268 44.93 Topic 293 80.15 Topic 269 8.76 Topic 294 77.67 0 Topic 270 22.42 Topic 295 46.53 Topic 271 54.78 Topic 296 39.36 Topic 272 25.88 Topic 297 57.97 −0.5 Topic 273 43.56 Topic 298 9.31 Topic 274 24.54 Topic 299 44.85 −1 Topic 275 43.27 Topic 300 1.45 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.326 miracle SR AH-Monolingual-PT Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Portuguese Retrieved 50,000 RunType= automatic Relevant 2,904 QueryType= TDN Relevant retrieved 2,519 Pooled= true CLEF 2005 AH−Monolingual−PT − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 82.17 SR 90% 10 68.83 20 60.45 80% 30 49.07 70% 40 41.65 50 36.57 Average Precision 60% 60 30.34 50% 70 24.13 80 18.60 40% 90 11.51 30% 100 5.66 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 36.98 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−PT − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 61.20 SR 90% 10 docs 54.80 15 docs 51.20 80% 20 docs 48.80 70% 30 docs 43.53 100 docs 28.18 60% R−Precision 200 docs 18.53 50% 500 docs 9.20 1000 docs 5.04 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 37.71 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 251 to 275) queries 1 SR Topic 251 40.05 Topic 276 31.54 Difference (average precision) Topic 252 30.80 Topic 277 8.77 0.5 Topic 253 39.50 Topic 278 37.73 Topic 254 50.14 Topic 279 20.15 Topic 255 39.89 Topic 280 7.02 0 Topic 256 92.28 Topic 281 65.57 Topic 257 23.47 Topic 282 20.50 −0.5 Topic 258 1.30 Topic 283 69.04 Topic 259 40.42 Topic 284 35.27 Topic 260 13.13 Topic 285 37.96 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 24.02 Topic 286 46.89 Topic Number Topic 262 16.40 Topic 287 35.25 Topic 263 16.63 Topic 288 18.33 CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 276 to 300) Topic 264 57.36 Topic 289 53.57 1 Topic 265 25.25 Topic 290 37.47 SR Difference (average precision) Topic 266 57.58 Topic 291 28.30 0.5 Topic 267 32.35 Topic 292 30.41 Topic 268 39.67 Topic 293 52.45 Topic 269 9.79 Topic 294 81.57 0 Topic 270 27.79 Topic 295 58.23 Topic 271 54.81 Topic 296 52.76 Topic 272 34.84 Topic 297 41.84 −0.5 Topic 273 52.83 Topic 298 35.92 Topic 274 16.89 Topic 299 54.14 −1 Topic 275 44.97 Topic 300 5.94 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.327 miracle ST AH-Monolingual-PT Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Portuguese Retrieved 50,000 RunType= automatic Relevant 2,904 QueryType= TD Relevant retrieved 2,444 Pooled= false CLEF 2005 AH−Monolingual−PT − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 82.32 ST 90% 10 65.24 20 52.85 80% 30 45.27 70% 40 38.81 50 33.35 Average Precision 60% 60 27.81 50% 70 22.41 80 16.56 40% 90 11.73 30% 100 5.36 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 34.56 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−PT − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 60.40 ST 90% 10 docs 53.80 15 docs 48.00 80% 20 docs 44.30 70% 30 docs 40.87 100 docs 25.76 60% R−Precision 200 docs 17.69 50% 500 docs 8.88 1000 docs 4.89 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 36.30 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 251 to 275) queries 1 ST Topic 251 51.28 Topic 276 31.60 Difference (average precision) Topic 252 22.11 Topic 277 9.72 0.5 Topic 253 29.42 Topic 278 31.58 Topic 254 35.24 Topic 279 11.23 Topic 255 24.55 Topic 280 12.48 0 Topic 256 97.22 Topic 281 45.19 Topic 257 17.02 Topic 282 18.57 −0.5 Topic 258 2.68 Topic 283 65.34 Topic 259 35.50 Topic 284 27.87 Topic 260 21.11 Topic 285 39.15 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 12.55 Topic 286 34.84 Topic Number Topic 262 9.05 Topic 287 27.23 Topic 263 14.70 Topic 288 11.87 CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 276 to 300) Topic 264 53.68 Topic 289 71.20 1 Topic 265 24.22 Topic 290 49.14 ST Difference (average precision) Topic 266 51.41 Topic 291 27.83 0.5 Topic 267 36.15 Topic 292 28.07 Topic 268 47.45 Topic 293 60.47 Topic 269 8.60 Topic 294 78.81 0 Topic 270 27.96 Topic 295 44.49 Topic 271 66.96 Topic 296 46.94 Topic 272 32.41 Topic 297 33.42 −0.5 Topic 273 39.21 Topic 298 26.02 Topic 274 33.56 Topic 299 55.07 −1 Topic 275 39.43 Topic 300 6.24 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.328 miracle aSRr1SR AH-Monolingual-PT Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Portuguese Retrieved 50,000 RunType= automatic Relevant 2,904 QueryType= TDN Relevant retrieved 1,949 Pooled= false CLEF 2005 AH−Monolingual−PT − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 72.17 aSRr1SR 90% 10 56.83 20 45.99 80% 30 39.34 70% 40 33.75 50 27.16 Average Precision 60% 60 21.32 50% 70 15.69 80 10.28 40% 90 6.20 30% 100 2.90 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 28.32 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−PT − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 51.60 aSRr1SR 90% 10 docs 48.40 15 docs 43.07 80% 20 docs 39.70 70% 30 docs 35.80 100 docs 21.24 60% R−Precision 200 docs 14.74 50% 500 docs 7.45 1000 docs 3.90 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 31.37 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 251 to 275) queries 1 aSRr1SR Topic 251 35.61 Topic 276 19.35 Difference (average precision) Topic 252 14.60 Topic 277 9.48 0.5 Topic 253 20.08 Topic 278 34.57 Topic 254 51.66 Topic 279 0.48 Topic 255 55.71 Topic 280 20.42 0 Topic 256 94.64 Topic 281 72.85 Topic 257 29.64 Topic 282 23.80 −0.5 Topic 258 0.00 Topic 283 63.84 Topic 259 12.94 Topic 284 19.87 Topic 260 6.35 Topic 285 23.59 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 6.65 Topic 286 17.46 Topic Number Topic 262 0.20 Topic 287 4.85 Topic 263 3.97 Topic 288 0.23 CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 276 to 300) Topic 264 63.15 Topic 289 47.86 1 Topic 265 26.64 Topic 290 62.87 aSRr1SR Difference (average precision) Topic 266 39.69 Topic 291 18.20 0.5 Topic 267 11.72 Topic 292 42.15 Topic 268 40.60 Topic 293 39.66 Topic 269 5.25 Topic 294 56.68 0 Topic 270 7.93 Topic 295 34.79 Topic 271 60.60 Topic 296 31.49 Topic 272 26.88 Topic 297 12.09 −0.5 Topic 273 36.29 Topic 298 6.29 Topic 274 0.26 Topic 299 41.79 −1 Topic 275 50.60 Topic 300 9.53 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.329 miracle xNP01SR1 AH-Monolingual-PT Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Portuguese Retrieved 50,000 RunType= automatic Relevant 2,904 QueryType= TDN Relevant retrieved 2,519 Pooled= false CLEF 2005 AH−Monolingual−PT − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 81.60 xNP01SR1 90% 10 67.15 20 58.14 80% 30 47.45 70% 40 41.14 50 36.21 Average Precision 60% 60 29.42 50% 70 22.90 80 17.95 40% 90 11.34 30% 100 5.61 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 36.28 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−PT − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 60.80 xNP01SR1 90% 10 docs 54.80 15 docs 50.93 80% 20 docs 48.30 70% 30 docs 43.40 100 docs 28.08 60% R−Precision 200 docs 18.47 50% 500 docs 9.17 1000 docs 5.04 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 37.08 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 251 to 275) queries 1 xNP01SR1 Topic 251 40.05 Topic 276 27.15 Difference (average precision) Topic 252 30.80 Topic 277 6.85 0.5 Topic 253 39.00 Topic 278 37.73 Topic 254 50.14 Topic 279 22.17 Topic 255 27.99 Topic 280 7.02 0 Topic 256 91.45 Topic 281 65.47 Topic 257 23.59 Topic 282 20.55 −0.5 Topic 258 1.30 Topic 283 68.84 Topic 259 42.02 Topic 284 35.27 Topic 260 13.13 Topic 285 37.96 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 21.67 Topic 286 47.83 Topic Number Topic 262 16.63 Topic 287 35.25 Topic 263 16.63 Topic 288 18.43 CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 276 to 300) Topic 264 57.36 Topic 289 53.57 1 Topic 265 25.25 Topic 290 37.47 xNP01SR1 Difference (average precision) Topic 266 57.61 Topic 291 28.47 0.5 Topic 267 32.68 Topic 292 28.91 Topic 268 26.66 Topic 293 52.45 Topic 269 9.82 Topic 294 81.57 0 Topic 270 31.18 Topic 295 58.24 Topic 271 51.96 Topic 296 50.85 Topic 272 29.04 Topic 297 43.21 −0.5 Topic 273 52.21 Topic 298 35.92 Topic 274 19.40 Topic 299 54.02 −1 Topic 275 44.98 Topic 300 6.04 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.330 tlr tlrTDpt3 AH-Monolingual-PT Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Portuguese Retrieved 50,000 RunType= automatic Relevant 2,904 QueryType= TD Relevant retrieved 2,437 Pooled= false CLEF 2005 AH−Monolingual−PT − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 79.01 tlrTDpt3 90% 10 62.79 20 53.32 80% 30 45.28 70% 40 39.72 50 34.74 Average Precision 60% 60 29.19 50% 70 24.24 80 18.32 40% 90 12.61 30% 100 7.63 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 35.01 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−PT − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 56.40 tlrTDpt3 90% 10 docs 51.40 15 docs 47.20 80% 20 docs 44.30 70% 30 docs 40.73 100 docs 25.18 60% R−Precision 200 docs 16.88 50% 500 docs 8.71 1000 docs 4.87 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 37.34 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 251 to 275) queries 1 tlrTDpt3 Topic 251 51.11 Topic 276 20.69 Difference (average precision) Topic 252 21.36 Topic 277 12.14 0.5 Topic 253 18.05 Topic 278 33.21 Topic 254 31.25 Topic 279 50.90 Topic 255 39.46 Topic 280 6.92 0 Topic 256 98.81 Topic 281 51.18 Topic 257 17.75 Topic 282 19.88 −0.5 Topic 258 45.00 Topic 283 71.63 Topic 259 38.52 Topic 284 36.81 Topic 260 9.79 Topic 285 44.86 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 17.60 Topic 286 58.98 Topic Number Topic 262 8.08 Topic 287 20.12 Topic 263 11.80 Topic 288 9.94 CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 276 to 300) Topic 264 46.74 Topic 289 68.45 1 Topic 265 28.30 Topic 290 43.55 tlrTDpt3 Difference (average precision) Topic 266 44.88 Topic 291 24.98 0.5 Topic 267 41.88 Topic 292 12.75 Topic 268 53.31 Topic 293 46.77 Topic 269 5.13 Topic 294 69.34 0 Topic 270 28.97 Topic 295 40.78 Topic 271 59.09 Topic 296 49.49 Topic 272 28.05 Topic 297 44.19 −0.5 Topic 273 35.07 Topic 298 43.26 Topic 274 22.78 Topic 299 42.84 −1 Topic 275 22.26 Topic 300 1.85 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.331 tlr tlrTDptRF2 AH-Monolingual-PT Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Portuguese Retrieved 50,000 RunType= automatic Relevant 2,904 QueryType= TD Relevant retrieved 2,544 Pooled= false CLEF 2005 AH−Monolingual−PT − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 73.05 tlrTDptRF2 90% 10 62.13 20 56.25 80% 30 49.62 70% 40 43.60 50 38.75 Average Precision 60% 60 33.16 50% 70 26.92 80 22.56 40% 90 14.69 30% 100 8.61 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 37.42 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−PT − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 56.00 tlrTDptRF2 90% 10 docs 51.80 15 docs 47.20 80% 20 docs 45.10 70% 30 docs 40.60 100 docs 26.54 60% R−Precision 200 docs 18.07 50% 500 docs 9.27 1000 docs 5.09 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 39.04 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 251 to 275) queries 1 tlrTDptRF2 Topic 251 56.66 Topic 276 30.09 Difference (average precision) Topic 252 20.43 Topic 277 13.03 0.5 Topic 253 29.52 Topic 278 36.97 Topic 254 54.17 Topic 279 59.80 Topic 255 44.83 Topic 280 6.85 0 Topic 256 96.63 Topic 281 50.90 Topic 257 22.91 Topic 282 21.75 −0.5 Topic 258 100.00 Topic 283 76.41 Topic 259 36.97 Topic 284 31.93 Topic 260 11.75 Topic 285 47.94 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 12.12 Topic 286 57.93 Topic Number Topic 262 6.79 Topic 287 13.81 Topic 263 9.98 Topic 288 1.82 CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 276 to 300) Topic 264 65.98 Topic 289 54.84 1 Topic 265 32.83 Topic 290 15.01 tlrTDptRF2 Difference (average precision) Topic 266 47.80 Topic 291 25.78 0.5 Topic 267 40.52 Topic 292 13.44 Topic 268 49.57 Topic 293 56.05 Topic 269 5.06 Topic 294 65.36 0 Topic 270 36.36 Topic 295 52.41 Topic 271 53.47 Topic 296 51.11 Topic 272 37.53 Topic 297 35.20 −0.5 Topic 273 40.80 Topic 298 44.00 Topic 274 4.42 Topic 299 52.00 −1 Topic 275 36.53 Topic 300 2.76 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.332 tlr tlrTDptRFS1 AH-Monolingual-PT Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Portuguese Retrieved 50,000 RunType= automatic Relevant 2,904 QueryType= TD Relevant retrieved 2,488 Pooled= true CLEF 2005 AH−Monolingual−PT − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 73.06 tlrTDptRFS1 90% 10 61.36 20 55.07 80% 30 48.10 70% 40 42.14 50 36.69 Average Precision 60% 60 30.63 50% 70 24.55 80 20.49 40% 90 13.47 30% 100 7.48 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 35.84 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−PT − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 56.00 tlrTDptRFS1 90% 10 docs 52.40 15 docs 47.73 80% 20 docs 45.30 70% 30 docs 40.40 100 docs 26.06 60% R−Precision 200 docs 17.54 50% 500 docs 8.98 1000 docs 4.98 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 38.05 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 251 to 275) queries 1 tlrTDptRFS1 Topic 251 56.66 Topic 276 30.09 Difference (average precision) Topic 252 20.43 Topic 277 12.14 0.5 Topic 253 29.52 Topic 278 36.97 Topic 254 31.25 Topic 279 59.80 Topic 255 44.83 Topic 280 6.85 0 Topic 256 96.63 Topic 281 51.18 Topic 257 17.75 Topic 282 21.75 −0.5 Topic 258 45.00 Topic 283 76.41 Topic 259 36.97 Topic 284 31.93 Topic 260 11.75 Topic 285 44.86 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 12.12 Topic 286 57.93 Topic Number Topic 262 8.08 Topic 287 13.81 Topic 263 9.98 Topic 288 1.82 CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 276 to 300) Topic 264 65.98 Topic 289 54.84 1 Topic 265 32.83 Topic 290 15.01 tlrTDptRFS1 Difference (average precision) Topic 266 47.80 Topic 291 25.78 0.5 Topic 267 40.52 Topic 292 13.44 Topic 268 49.57 Topic 293 56.05 Topic 269 5.06 Topic 294 65.36 0 Topic 270 36.36 Topic 295 40.78 Topic 271 53.47 Topic 296 51.11 Topic 272 37.53 Topic 297 35.20 −0.5 Topic 273 40.80 Topic 298 44.00 Topic 274 22.78 Topic 299 52.00 −1 Topic 275 36.53 Topic 300 2.76 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.333 u.glasgow glapttdn AH-Monolingual-PT Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Portuguese Retrieved 50,000 RunType= automatic Relevant 2,904 QueryType= TDN Relevant retrieved 1,862 Pooled= true CLEF 2005 AH−Monolingual−PT − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 65.51 glapttdn 90% 10 49.37 20 36.02 80% 30 29.84 70% 40 24.80 50 20.66 Average Precision 60% 60 17.22 50% 70 13.58 80 8.76 40% 90 5.38 30% 100 2.18 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 23.16 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−PT − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 42.40 glapttdn 90% 10 docs 38.80 15 docs 34.40 80% 20 docs 32.80 70% 30 docs 29.20 100 docs 17.72 60% R−Precision 200 docs 12.28 50% 500 docs 6.36 1000 docs 3.72 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 24.86 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 251 to 275) queries 1 glapttdn Topic 251 37.37 Topic 276 0.04 Difference (average precision) Topic 252 6.66 Topic 277 0.00 0.5 Topic 253 13.60 Topic 278 29.08 Topic 254 45.49 Topic 279 0.07 Topic 255 19.26 Topic 280 4.38 0 Topic 256 89.54 Topic 281 57.80 Topic 257 0.72 Topic 282 12.63 −0.5 Topic 258 0.00 Topic 283 65.44 Topic 259 37.95 Topic 284 6.85 Topic 260 6.92 Topic 285 34.20 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 6.67 Topic 286 0.69 Topic Number Topic 262 1.99 Topic 287 0.40 Topic 263 2.90 Topic 288 3.17 CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 276 to 300) Topic 264 47.30 Topic 289 66.92 1 Topic 265 19.40 Topic 290 0.00 glapttdn Difference (average precision) Topic 266 51.65 Topic 291 24.74 0.5 Topic 267 25.15 Topic 292 11.88 Topic 268 33.06 Topic 293 38.10 Topic 269 2.77 Topic 294 7.76 0 Topic 270 22.51 Topic 295 47.86 Topic 271 11.47 Topic 296 53.16 Topic 272 22.08 Topic 297 13.94 −0.5 Topic 273 39.66 Topic 298 35.33 Topic 274 19.57 Topic 299 45.41 −1 Topic 275 33.63 Topic 300 0.58 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.334 u.glasgow glapttdnqe AH-Monolingual-PT Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Portuguese Retrieved 50,000 RunType= automatic Relevant 2,904 QueryType= TDN Relevant retrieved 2,020 Pooled= false CLEF 2005 AH−Monolingual−PT − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 55.85 glapttdnqe 90% 10 49.04 20 41.75 80% 30 36.92 70% 40 32.16 50 26.60 Average Precision 60% 60 22.70 50% 70 19.26 80 14.04 40% 90 8.77 30% 100 4.09 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 27.50 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−PT − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 44.00 glapttdnqe 90% 10 docs 43.60 15 docs 40.40 80% 20 docs 36.70 70% 30 docs 32.33 100 docs 20.02 60% R−Precision 200 docs 13.62 50% 500 docs 7.08 1000 docs 4.04 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 27.13 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 251 to 275) queries 1 glapttdnqe Topic 251 56.53 Topic 276 0.03 Difference (average precision) Topic 252 64.14 Topic 277 0.00 0.5 Topic 253 30.43 Topic 278 44.91 Topic 254 62.06 Topic 279 0.08 Topic 255 9.90 Topic 280 1.71 0 Topic 256 93.45 Topic 281 60.83 Topic 257 0.77 Topic 282 21.04 −0.5 Topic 258 0.00 Topic 283 73.57 Topic 259 53.31 Topic 284 10.10 Topic 260 10.18 Topic 285 39.36 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 4.06 Topic 286 0.15 Topic Number Topic 262 1.07 Topic 287 0.31 Topic 263 4.89 Topic 288 2.26 CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 276 to 300) Topic 264 62.34 Topic 289 61.93 1 Topic 265 21.36 Topic 290 0.00 glapttdnqe Difference (average precision) Topic 266 52.46 Topic 291 24.37 0.5 Topic 267 18.93 Topic 292 7.31 Topic 268 31.15 Topic 293 46.34 Topic 269 2.90 Topic 294 3.34 0 Topic 270 22.55 Topic 295 52.79 Topic 271 2.79 Topic 296 60.48 Topic 272 22.78 Topic 297 37.21 −0.5 Topic 273 33.20 Topic 298 57.96 Topic 274 4.13 Topic 299 58.10 −1 Topic 275 44.85 Topic 300 0.35 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.335 u.glasgow glapttdqe AH-Monolingual-PT Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Portuguese Retrieved 50,000 RunType= automatic Relevant 2,904 QueryType= TD Relevant retrieved 2,087 Pooled= false CLEF 2005 AH−Monolingual−PT − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 56.82 glapttdqe 90% 10 46.38 20 40.93 80% 30 36.91 70% 40 32.51 50 27.20 Average Precision 60% 60 22.52 50% 70 19.49 80 14.44 40% 90 9.68 30% 100 4.09 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 27.38 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−PT − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 44.00 glapttdqe 90% 10 docs 41.60 15 docs 38.40 80% 20 docs 37.00 70% 30 docs 32.93 100 docs 20.60 60% R−Precision 200 docs 14.20 50% 500 docs 7.34 1000 docs 4.17 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 28.03 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 251 to 275) queries 1 glapttdqe Topic 251 59.41 Topic 276 0.01 Difference (average precision) Topic 252 23.13 Topic 277 0.00 0.5 Topic 253 28.80 Topic 278 49.25 Topic 254 66.92 Topic 279 0.08 Topic 255 7.18 Topic 280 0.74 0 Topic 256 94.98 Topic 281 61.38 Topic 257 28.55 Topic 282 21.44 −0.5 Topic 258 0.00 Topic 283 73.69 Topic 259 40.87 Topic 284 16.99 Topic 260 9.15 Topic 285 37.57 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 4.75 Topic 286 0.45 Topic Number Topic 262 0.41 Topic 287 0.28 Topic 263 3.76 Topic 288 2.49 CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 276 to 300) Topic 264 61.56 Topic 289 67.61 1 Topic 265 23.71 Topic 290 0.00 glapttdqe Difference (average precision) Topic 266 52.86 Topic 291 24.82 0.5 Topic 267 20.06 Topic 292 11.48 Topic 268 33.48 Topic 293 52.04 Topic 269 2.78 Topic 294 6.24 0 Topic 270 24.15 Topic 295 58.28 Topic 271 7.68 Topic 296 59.95 Topic 272 21.51 Topic 297 10.40 −0.5 Topic 273 38.22 Topic 298 57.62 Topic 274 2.81 Topic 299 59.05 −1 Topic 275 39.91 Topic 300 0.54 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.336 unine UniNEpt1 AH-Monolingual-PT Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Portuguese Retrieved 50,000 RunType= automatic Relevant 2,904 QueryType= TD Relevant retrieved 2,474 Pooled= true CLEF 2005 AH−Monolingual−PT − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 77.57 UniNEpt1 90% 10 67.44 20 60.29 80% 30 51.51 70% 40 45.10 50 38.35 Average Precision 60% 60 31.92 50% 70 24.62 80 19.05 40% 90 12.44 30% 100 6.39 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 38.25 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−PT − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 60.00 UniNEpt1 90% 10 docs 55.00 15 docs 52.80 80% 20 docs 49.30 70% 30 docs 44.00 100 docs 27.50 60% R−Precision 200 docs 18.06 50% 500 docs 8.97 1000 docs 4.95 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 38.57 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 251 to 275) queries 1 UniNEpt1 Topic 251 54.53 Topic 276 29.93 Difference (average precision) Topic 252 31.18 Topic 277 12.24 0.5 Topic 253 29.11 Topic 278 50.24 Topic 254 63.59 Topic 279 52.74 Topic 255 44.73 Topic 280 2.12 0 Topic 256 95.65 Topic 281 64.62 Topic 257 26.26 Topic 282 29.61 −0.5 Topic 258 3.08 Topic 283 75.44 Topic 259 35.49 Topic 284 20.21 Topic 260 17.07 Topic 285 39.81 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 23.45 Topic 286 53.42 Topic Number Topic 262 16.88 Topic 287 3.76 Topic 263 9.45 Topic 288 1.91 CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 276 to 300) Topic 264 71.12 Topic 289 57.50 1 Topic 265 20.80 Topic 290 54.08 UniNEpt1 Difference (average precision) Topic 266 50.03 Topic 291 30.07 0.5 Topic 267 22.81 Topic 292 38.65 Topic 268 56.28 Topic 293 67.33 Topic 269 11.44 Topic 294 77.27 0 Topic 270 23.21 Topic 295 49.81 Topic 271 69.68 Topic 296 42.81 Topic 272 25.19 Topic 297 41.28 −0.5 Topic 273 56.23 Topic 298 38.72 Topic 274 17.77 Topic 299 53.81 −1 Topic 275 47.30 Topic 300 2.60 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.337 unine UniNEpt2 AH-Monolingual-PT Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Portuguese Retrieved 50,000 RunType= automatic Relevant 2,904 QueryType= TD Relevant retrieved 2,474 Pooled= false CLEF 2005 AH−Monolingual−PT − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 81.57 UniNEpt2 90% 10 68.26 20 60.61 80% 30 53.09 70% 40 45.39 50 39.15 Average Precision 60% 60 32.29 50% 70 24.81 80 19.35 40% 90 12.96 30% 100 5.82 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 38.75 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−PT − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 60.40 UniNEpt2 90% 10 docs 57.60 15 docs 53.47 80% 20 docs 49.80 70% 30 docs 45.47 100 docs 27.80 60% R−Precision 200 docs 17.79 50% 500 docs 8.90 1000 docs 4.95 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 39.17 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 251 to 275) queries 1 UniNEpt2 Topic 251 52.06 Topic 276 32.09 Difference (average precision) Topic 252 42.74 Topic 277 9.73 0.5 Topic 253 26.55 Topic 278 44.02 Topic 254 67.14 Topic 279 45.82 Topic 255 48.55 Topic 280 6.11 0 Topic 256 95.65 Topic 281 70.71 Topic 257 26.94 Topic 282 29.66 −0.5 Topic 258 4.75 Topic 283 72.00 Topic 259 32.59 Topic 284 21.54 Topic 260 14.42 Topic 285 43.44 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 22.23 Topic 286 53.27 Topic Number Topic 262 10.58 Topic 287 3.22 Topic 263 9.97 Topic 288 3.86 CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 276 to 300) Topic 264 71.52 Topic 289 60.30 1 Topic 265 20.38 Topic 290 66.05 UniNEpt2 Difference (average precision) Topic 266 50.04 Topic 291 30.10 0.5 Topic 267 26.68 Topic 292 35.16 Topic 268 38.85 Topic 293 63.95 Topic 269 14.27 Topic 294 80.65 0 Topic 270 24.53 Topic 295 43.07 Topic 271 65.39 Topic 296 44.55 Topic 272 27.58 Topic 297 35.02 −0.5 Topic 273 56.70 Topic 298 53.85 Topic 274 27.27 Topic 299 56.29 −1 Topic 275 51.68 Topic 300 3.75 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.338 unine UniNEpt3 AH-Monolingual-PT Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Portuguese Retrieved 50,000 RunType= automatic Relevant 2,904 QueryType= TD Relevant retrieved 2,485 Pooled= false CLEF 2005 AH−Monolingual−PT − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 77.29 UniNEpt3 90% 10 65.75 20 56.83 80% 30 49.54 70% 40 41.82 50 36.45 Average Precision 60% 60 30.73 50% 70 24.61 80 18.50 40% 90 10.70 30% 100 5.22 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 36.65 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−PT − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 58.40 UniNEpt3 90% 10 docs 56.40 15 docs 52.13 80% 20 docs 48.40 70% 30 docs 42.73 100 docs 26.28 60% R−Precision 200 docs 17.26 50% 500 docs 8.80 1000 docs 4.97 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 37.72 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 251 to 275) queries 1 UniNEpt3 Topic 251 52.60 Topic 276 25.70 Difference (average precision) Topic 252 45.43 Topic 277 11.91 0.5 Topic 253 30.16 Topic 278 50.25 Topic 254 61.27 Topic 279 49.15 Topic 255 68.06 Topic 280 22.63 0 Topic 256 94.64 Topic 281 58.37 Topic 257 23.61 Topic 282 28.29 −0.5 Topic 258 0.13 Topic 283 78.93 Topic 259 32.17 Topic 284 17.90 Topic 260 11.96 Topic 285 42.84 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 14.16 Topic 286 44.27 Topic Number Topic 262 9.14 Topic 287 2.58 Topic 263 2.90 Topic 288 0.12 CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 276 to 300) Topic 264 68.21 Topic 289 66.86 1 Topic 265 27.60 Topic 290 39.17 UniNEpt3 Difference (average precision) Topic 266 41.64 Topic 291 33.94 0.5 Topic 267 20.48 Topic 292 41.76 Topic 268 38.89 Topic 293 56.93 Topic 269 14.39 Topic 294 55.43 0 Topic 270 17.28 Topic 295 62.00 Topic 271 53.60 Topic 296 53.43 Topic 272 25.23 Topic 297 29.29 −0.5 Topic 273 56.44 Topic 298 47.37 Topic 274 5.26 Topic 299 47.35 −1 Topic 275 46.52 Topic 300 4.01 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.339 xldb XLDBTumba01 AH-Monolingual-PT Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Portuguese Retrieved 12,595 RunType= manual Relevant 2,904 QueryType= TDN Relevant retrieved 1,675 Pooled= true CLEF 2005 AH−Monolingual−PT − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 79.13 XLDBTumba01 90% 10 63.66 20 53.61 80% 30 44.78 70% 40 33.45 50 28.61 Average Precision 60% 60 17.05 50% 70 11.97 80 7.85 40% 90 1.92 30% 100 0.40 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 29.00 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−PT − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 55.60 XLDBTumba01 90% 10 docs 51.20 15 docs 48.00 80% 20 docs 44.40 70% 30 docs 40.53 100 docs 22.26 60% R−Precision 200 docs 13.68 50% 500 docs 6.52 1000 docs 3.35 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 34.35 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 251 to 275) queries 1 XLDBTumba01 Topic 251 41.86 Topic 276 15.52 Difference (average precision) Topic 252 3.50 Topic 277 2.50 0.5 Topic 253 33.80 Topic 278 10.53 Topic 254 6.97 Topic 279 54.22 Topic 255 40.96 Topic 280 22.10 0 Topic 256 61.88 Topic 281 46.94 Topic 257 25.85 Topic 282 17.17 −0.5 Topic 258 50.00 Topic 283 65.75 Topic 259 43.53 Topic 284 49.22 Topic 260 1.87 Topic 285 21.18 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 3.40 Topic 286 55.80 Topic Number Topic 262 0.00 Topic 287 13.79 Topic 263 24.66 Topic 288 2.51 CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 276 to 300) Topic 264 46.69 Topic 289 66.07 1 Topic 265 8.68 Topic 290 36.00 XLDBTumba01 Difference (average precision) Topic 266 25.47 Topic 291 25.69 0.5 Topic 267 15.90 Topic 292 18.43 Topic 268 18.57 Topic 293 49.53 Topic 269 17.76 Topic 294 28.65 0 Topic 270 24.38 Topic 295 69.23 Topic 271 21.60 Topic 296 71.37 Topic 272 18.33 Topic 297 37.97 −0.5 Topic 273 28.50 Topic 298 30.69 Topic 274 20.83 Topic 299 36.44 −1 Topic 275 14.08 Topic 300 3.74 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.340 xldb XLDBTumba02 AH-Monolingual-PT Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Portuguese Retrieved 5,546 RunType= automatic Relevant 2,904 QueryType= TDN Relevant retrieved 986 Pooled= false CLEF 2005 AH−Monolingual−PT − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 74.50 XLDBTumba02 90% 10 47.18 20 32.63 80% 30 25.21 70% 40 19.13 50 16.93 Average Precision 60% 60 11.78 50% 70 8.63 80 3.26 40% 90 1.63 30% 100 0.68 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 19.71 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−PT − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 51.20 XLDBTumba02 90% 10 docs 45.60 15 docs 39.60 80% 20 docs 34.00 70% 30 docs 27.93 100 docs 13.50 60% R−Precision 200 docs 8.34 50% 500 docs 3.91 1000 docs 1.97 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 23.15 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 251 to 275) queries 1 XLDBTumba02 Topic 251 19.82 Topic 276 16.38 Difference (average precision) Topic 252 11.36 Topic 277 0.00 0.5 Topic 253 25.08 Topic 278 41.43 Topic 254 6.35 Topic 279 53.52 Topic 255 51.67 Topic 280 20.96 0 Topic 256 75.00 Topic 281 31.59 Topic 257 6.34 Topic 282 5.36 −0.5 Topic 258 8.33 Topic 283 46.73 Topic 259 41.20 Topic 284 26.21 Topic 260 0.00 Topic 285 11.41 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 12.94 Topic 286 42.88 Topic Number Topic 262 2.79 Topic 287 6.20 Topic 263 1.33 Topic 288 0.54 CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 276 to 300) Topic 264 27.96 Topic 289 67.33 1 Topic 265 8.66 Topic 290 0.76 XLDBTumba02 Difference (average precision) Topic 266 5.64 Topic 291 4.82 0.5 Topic 267 34.10 Topic 292 13.42 Topic 268 53.91 Topic 293 19.56 Topic 269 5.98 Topic 294 28.83 0 Topic 270 19.43 Topic 295 47.70 Topic 271 9.17 Topic 296 1.70 Topic 272 7.51 Topic 297 4.88 −0.5 Topic 273 9.23 Topic 298 21.82 Topic 274 16.67 Topic 299 5.54 −1 Topic 275 4.17 Topic 300 1.27 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.341 xldb XLDBTumba05 AH-Monolingual-PT Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Portuguese Retrieved 12,595 RunType= manual Relevant 2,904 QueryType= TDN Relevant retrieved 1,666 Pooled= true CLEF 2005 AH−Monolingual−PT − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 73.23 XLDBTumba05 90% 10 53.56 20 42.48 80% 30 35.80 70% 40 27.26 50 23.52 Average Precision 60% 60 14.29 50% 70 10.61 80 7.82 40% 90 1.79 30% 100 0.31 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 24.00 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−PT − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 48.80 XLDBTumba05 90% 10 docs 43.40 15 docs 40.13 80% 20 docs 37.80 70% 30 docs 34.33 100 docs 21.04 60% R−Precision 200 docs 13.23 50% 500 docs 6.47 1000 docs 3.33 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 30.58 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 251 to 275) queries 1 XLDBTumba05 Topic 251 29.28 Topic 276 15.79 Difference (average precision) Topic 252 1.71 Topic 277 1.67 0.5 Topic 253 28.37 Topic 278 6.14 Topic 254 8.19 Topic 279 41.64 Topic 255 29.58 Topic 280 17.49 0 Topic 256 58.21 Topic 281 47.89 Topic 257 16.70 Topic 282 17.94 −0.5 Topic 258 25.00 Topic 283 58.86 Topic 259 40.01 Topic 284 44.40 Topic 260 1.65 Topic 285 23.38 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 4.22 Topic 286 51.96 Topic Number Topic 262 0.00 Topic 287 11.25 Topic 263 15.37 Topic 288 2.45 CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 276 to 300) Topic 264 46.77 Topic 289 43.02 1 Topic 265 11.76 Topic 290 20.26 XLDBTumba05 Difference (average precision) Topic 266 24.40 Topic 291 23.01 0.5 Topic 267 15.63 Topic 292 12.58 Topic 268 22.26 Topic 293 31.74 Topic 269 14.36 Topic 294 15.42 0 Topic 270 21.17 Topic 295 61.14 Topic 271 19.05 Topic 296 57.79 Topic 272 26.38 Topic 297 20.40 −0.5 Topic 273 21.61 Topic 298 31.20 Topic 274 20.83 Topic 299 26.07 −1 Topic 275 10.57 Topic 300 3.59 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.342 xldb XLDBTumba06 AH-Monolingual-PT Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Portuguese Retrieved 5,546 RunType= automatic Relevant 2,904 QueryType= TDN Relevant retrieved 985 Pooled= false CLEF 2005 AH−Monolingual−PT − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 73.33 XLDBTumba06 90% 10 44.17 20 29.94 80% 30 22.06 70% 40 17.77 50 15.16 Average Precision 60% 60 10.76 50% 70 7.93 80 2.94 40% 90 1.36 30% 100 0.63 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 18.08 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−PT − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 48.00 XLDBTumba06 90% 10 docs 40.60 15 docs 35.60 80% 20 docs 31.50 70% 30 docs 25.33 100 docs 12.90 60% R−Precision 200 docs 8.05 50% 500 docs 3.85 1000 docs 1.97 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 22.51 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 251 to 275) queries 1 XLDBTumba06 Topic 251 16.62 Topic 276 15.68 Difference (average precision) Topic 252 10.11 Topic 277 0.00 0.5 Topic 253 16.81 Topic 278 43.94 Topic 254 6.06 Topic 279 48.33 Topic 255 61.11 Topic 280 20.57 0 Topic 256 75.00 Topic 281 37.74 Topic 257 5.77 Topic 282 5.01 −0.5 Topic 258 8.33 Topic 283 30.91 Topic 259 45.48 Topic 284 24.09 Topic 260 0.00 Topic 285 9.32 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 14.64 Topic 286 42.37 Topic Number Topic 262 6.60 Topic 287 5.14 Topic 263 2.00 Topic 288 0.83 CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 276 to 300) Topic 264 27.44 Topic 289 57.97 1 Topic 265 7.18 Topic 290 0.76 XLDBTumba06 Difference (average precision) Topic 266 4.65 Topic 291 5.53 0.5 Topic 267 18.41 Topic 292 13.49 Topic 268 39.12 Topic 293 16.61 Topic 269 5.31 Topic 294 21.33 0 Topic 270 16.49 Topic 295 40.08 Topic 271 8.54 Topic 296 2.04 Topic 272 8.90 Topic 297 4.88 −0.5 Topic 273 7.76 Topic 298 19.09 Topic 274 16.67 Topic 299 4.54 −1 Topic 275 3.80 Topic 300 0.74 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.343 xldb XLDBTumba09 AH-Monolingual-PT Overall statistics for 50 queries : General info: Total number of documents over all queries Track= Ad Hoc Monolingual Portuguese Retrieved 6,521 RunType= automatic Relevant 2,904 QueryType= TD Relevant retrieved 989 Pooled= false CLEF 2005 AH−Monolingual−PT − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 74.12 XLDBTumba09 90% 10 48.54 20 31.36 80% 30 24.37 70% 40 18.47 50 16.89 Average Precision 60% 60 11.96 50% 70 8.68 80 3.13 40% 90 1.64 30% 100 0.65 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 19.40 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 AH−Monolingual−PT − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 49.20 XLDBTumba09 90% 10 docs 45.00 15 docs 39.20 80% 20 docs 33.40 70% 30 docs 27.53 100 docs 13.42 60% R−Precision 200 docs 8.27 50% 500 docs 3.92 1000 docs 1.98 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 22.91 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 251 to 275) queries 1 XLDBTumba09 Topic 251 19.63 Topic 276 17.48 Difference (average precision) Topic 252 10.99 Topic 277 0.00 0.5 Topic 253 24.01 Topic 278 41.48 Topic 254 6.22 Topic 279 55.11 Topic 255 45.63 Topic 280 26.93 0 Topic 256 75.00 Topic 281 25.83 Topic 257 5.35 Topic 282 5.36 −0.5 Topic 258 7.14 Topic 283 46.33 Topic 259 34.61 Topic 284 27.14 Topic 260 0.00 Topic 285 10.83 −1 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 Topic 261 10.94 Topic 286 43.09 Topic Number Topic 262 0.13 Topic 287 6.39 Topic 263 1.31 Topic 288 0.50 CLEF 2005 AH−Monolingual−PT − Comparison to median by topic (topics 276 to 300) Topic 264 28.16 Topic 289 66.71 1 Topic 265 8.77 Topic 290 0.76 XLDBTumba09 Difference (average precision) Topic 266 5.64 Topic 291 4.82 0.5 Topic 267 36.08 Topic 292 21.50 Topic 268 47.50 Topic 293 19.85 Topic 269 4.42 Topic 294 28.76 0 Topic 270 20.03 Topic 295 47.34 Topic 271 9.50 Topic 296 1.70 Topic 272 7.54 Topic 297 4.88 −0.5 Topic 273 9.56 Topic 298 21.42 Topic 274 16.67 Topic 299 5.49 −1 Topic 275 4.17 Topic 300 1.30 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 Topic Number A.344 berkeley BERK1MUDEALL01 DS-Multi Overall statistics for 25 queries : General info: Total number of documents over all queries Track= Domain Specific Multilingual German Retrieved 25,000 RunType= automatic Relevant 5,618 QueryType= TD Relevant retrieved 660 Pooled= false CLEF 2005 DS−Multi − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 34.86 BERK1MUDEALL01 90% 10 9.14 20 5.07 80% 30 2.54 70% 40 1.20 50 0.91 Average Precision 60% 60 0.49 50% 70 0.28 80 0.00 40% 90 0.00 30% 100 0.00 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 2.94 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 DS−Multi − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 18.40 BERK1MUDEALL01 90% 10 docs 20.00 15 docs 18.13 80% 20 docs 17.40 70% 30 docs 15.33 100 docs 9.92 60% R−Precision 200 docs 6.96 50% 500 docs 3.92 1000 docs 2.64 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 6.86 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 DS−Multi − Comparison to median by topic (topics 126 to 138) queries 1 BERK1MUDEALL01 Topic 126 6.78 Topic 139 1.61 Difference (average precision) Topic 127 2.29 Topic 140 0.14 0.5 Topic 128 1.24 Topic 141 0.12 Topic 129 0.01 Topic 142 0.64 Topic 130 1.07 Topic 143 0.21 0 Topic 131 0.19 Topic 144 16.03 Topic 132 1.23 Topic 145 2.04 −0.5 Topic 133 0.04 Topic 146 20.99 Topic 134 8.57 Topic 147 0.13 Topic 135 0.23 Topic 148 1.82 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic 136 0.03 Topic 149 1.39 Topic Number Topic 137 0.38 Topic 150 1.06 Topic 138 5.37 CLEF 2005 DS−Multi − Comparison to median by topic (topics 139 to 150) 1 BERK1MUDEALL01 Difference (average precision) 0.5 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number A.345 berkeley BERK1MUENALL01 DS-Multi Overall statistics for 25 queries : General info: Total number of documents over all queries Track= Domain Specific Multilingual English Retrieved 25,000 RunType= automatic Relevant 5,618 QueryType= TD Relevant retrieved 1,041 Pooled= false CLEF 2005 DS−Multi − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 42.84 BERK1MUENALL01 90% 10 11.17 20 6.29 80% 30 4.54 70% 40 1.60 50 1.36 Average Precision 60% 60 0.93 50% 70 0.44 80 0.00 40% 90 0.00 30% 100 0.00 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 3.46 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 DS−Multi − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 24.80 BERK1MUENALL01 90% 10 docs 20.80 15 docs 18.67 80% 20 docs 17.00 70% 30 docs 14.67 100 docs 9.68 60% R−Precision 200 docs 7.10 50% 500 docs 5.19 1000 docs 4.16 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 7.89 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 DS−Multi − Comparison to median by topic (topics 126 to 138) queries 1 BERK1MUENALL01 Topic 126 13.05 Topic 139 0.35 Difference (average precision) Topic 127 1.71 Topic 140 0.45 0.5 Topic 128 6.46 Topic 141 1.82 Topic 129 0.00 Topic 142 0.14 Topic 130 1.03 Topic 143 0.09 0 Topic 131 2.09 Topic 144 16.62 Topic 132 3.55 Topic 145 5.25 −0.5 Topic 133 0.56 Topic 146 13.63 Topic 134 9.78 Topic 147 0.29 Topic 135 0.15 Topic 148 0.57 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic 136 0.10 Topic 149 0.75 Topic Number Topic 137 1.32 Topic 150 3.62 Topic 138 3.02 CLEF 2005 DS−Multi − Comparison to median by topic (topics 139 to 150) 1 BERK1MUENALL01 Difference (average precision) 0.5 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number A.346 berkeley BERK1MURUALL01 DS-Multi Overall statistics for 25 queries : General info: Total number of documents over all queries Track= Domain Specific Multilingual Russian Retrieved 25,000 RunType= automatic Relevant 5,618 QueryType= TD Relevant retrieved 1,116 Pooled= false CLEF 2005 DS−Multi − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 45.73 BERK1MURUALL01 90% 10 16.47 20 10.85 80% 30 6.87 70% 40 4.57 50 2.41 Average Precision 60% 60 1.46 50% 70 0.59 80 0.00 40% 90 0.00 30% 100 0.00 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 5.32 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 DS−Multi − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 28.80 BERK1MURUALL01 90% 10 docs 24.40 15 docs 21.33 80% 20 docs 20.20 70% 30 docs 18.13 100 docs 14.12 60% R−Precision 200 docs 11.02 50% 500 docs 6.71 1000 docs 4.46 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 12.12 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 DS−Multi − Comparison to median by topic (topics 126 to 138) queries 1 BERK1MURUALL01 Topic 126 1.31 Topic 139 1.32 Difference (average precision) Topic 127 3.87 Topic 140 1.66 0.5 Topic 128 3.34 Topic 141 5.12 Topic 129 0.01 Topic 142 5.00 Topic 130 2.33 Topic 143 9.19 0 Topic 131 0.78 Topic 144 21.49 Topic 132 21.26 Topic 145 11.33 −0.5 Topic 133 0.53 Topic 146 30.28 Topic 134 3.58 Topic 147 0.80 Topic 135 0.56 Topic 148 1.05 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic 136 0.20 Topic 149 0.46 Topic Number Topic 137 1.30 Topic 150 0.26 Topic 138 5.98 CLEF 2005 DS−Multi − Comparison to median by topic (topics 139 to 150) 1 BERK1MURUALL01 Difference (average precision) 0.5 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number A.347 berkeley BERK1BLENDE01 DS-Bilingual-X2DE Overall statistics for 25 queries : General info: Total number of documents over all queries Track= Domain Specific Bilingual English to German Retrieved 25,000 RunType= automatic Relevant 2,682 QueryType= TD Relevant retrieved 1,128 Pooled= true CLEF 2005 DS−Bilingual−X2DE − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 49.50 BERK1BLENDE01 90% 10 33.15 20 27.65 80% 30 20.31 70% 40 13.38 50 11.27 Average Precision 60% 60 8.55 50% 70 6.15 80 4.64 40% 90 2.31 30% 100 0.00 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 14.77 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 DS−Bilingual−X2DE − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 35.20 BERK1BLENDE01 90% 10 docs 32.00 15 docs 30.13 80% 20 docs 27.00 70% 30 docs 24.53 100 docs 16.32 60% R−Precision 200 docs 11.94 50% 500 docs 7.14 1000 docs 4.51 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 18.67 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 DS−Bilingual−X2DE − Comparison to median by topic (topics 126 to 138) queries 1 BERK1BLENDE01 Topic 126 7.66 Topic 139 0.40 Difference (average precision) Topic 127 17.66 Topic 140 0.90 0.5 Topic 128 2.69 Topic 141 0.02 Topic 129 0.00 Topic 142 2.45 Topic 130 0.79 Topic 143 20.11 0 Topic 131 21.65 Topic 144 11.38 Topic 132 84.13 Topic 145 40.53 −0.5 Topic 133 5.72 Topic 146 31.99 Topic 134 27.05 Topic 147 0.12 Topic 135 0.01 Topic 148 7.98 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic 136 0.01 Topic 149 30.75 Topic Number Topic 137 47.51 Topic 150 7.56 Topic 138 0.10 CLEF 2005 DS−Bilingual−X2DE − Comparison to median by topic (topics 139 to 150) 1 BERK1BLENDE01 Difference (average precision) 0.5 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number A.348 berkeley BERK1BLRUDE01 DS-Bilingual-X2DE Overall statistics for 25 queries : General info: Total number of documents over all queries Track= Domain Specific Bilingual Russian to German Retrieved 25,000 RunType= automatic Relevant 2,682 QueryType= TD Relevant retrieved 1,097 Pooled= true CLEF 2005 DS−Bilingual−X2DE − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 57.82 BERK1BLRUDE01 90% 10 36.71 20 27.95 80% 30 21.80 70% 40 18.10 50 15.42 Average Precision 60% 60 12.22 50% 70 8.29 80 5.12 40% 90 2.37 30% 100 0.10 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 16.87 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 DS−Bilingual−X2DE − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 36.80 BERK1BLRUDE01 90% 10 docs 34.40 15 docs 32.27 80% 20 docs 31.40 70% 30 docs 28.67 100 docs 18.72 60% R−Precision 200 docs 13.12 50% 500 docs 7.49 1000 docs 4.39 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 19.73 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 DS−Bilingual−X2DE − Comparison to median by topic (topics 126 to 138) queries 1 BERK1BLRUDE01 Topic 126 17.09 Topic 139 26.42 Difference (average precision) Topic 127 3.33 Topic 140 0.18 0.5 Topic 128 0.06 Topic 141 0.00 Topic 129 0.00 Topic 142 28.08 Topic 130 15.74 Topic 143 12.51 0 Topic 131 26.80 Topic 144 9.51 Topic 132 84.81 Topic 145 58.14 −0.5 Topic 133 10.36 Topic 146 54.50 Topic 134 31.25 Topic 147 0.31 Topic 135 0.16 Topic 148 8.80 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic 136 0.75 Topic 149 0.31 Topic Number Topic 137 28.91 Topic 150 1.10 Topic 138 2.69 CLEF 2005 DS−Bilingual−X2DE − Comparison to median by topic (topics 139 to 150) 1 BERK1BLRUDE01 Difference (average precision) 0.5 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number A.349 berkeley-2 BK2GBLEG1 DS-Bilingual-X2DE Overall statistics for 25 queries : General info: Total number of documents over all queries Track= Domain Specific Bilingual English to German Retrieved 25,000 RunType= automatic Relevant 2,682 QueryType= TD Relevant retrieved 2,238 Pooled= true CLEF 2005 DS−Bilingual−X2DE − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 85.19 BK2GBLEG1 90% 10 76.95 20 65.89 80% 30 55.40 70% 40 48.16 50 41.73 Average Precision 60% 60 34.67 50% 70 26.82 80 20.48 40% 90 12.06 30% 100 2.14 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 42.01 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 DS−Bilingual−X2DE − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 68.80 BK2GBLEG1 90% 10 docs 67.60 15 docs 63.73 80% 20 docs 62.20 70% 30 docs 58.67 100 docs 41.72 60% R−Precision 200 docs 29.00 50% 500 docs 15.57 1000 docs 8.95 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 41.92 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 DS−Bilingual−X2DE − Comparison to median by topic (topics 126 to 138) queries 1 BK2GBLEG1 Topic 126 23.92 Topic 139 35.71 Difference (average precision) Topic 127 59.40 Topic 140 40.12 0.5 Topic 128 65.92 Topic 141 78.44 Topic 129 40.14 Topic 142 26.81 Topic 130 73.77 Topic 143 31.58 0 Topic 131 55.04 Topic 144 24.20 Topic 132 91.29 Topic 145 55.85 −0.5 Topic 133 12.39 Topic 146 62.19 Topic 134 41.36 Topic 147 55.44 Topic 135 0.30 Topic 148 21.01 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic 136 13.60 Topic 149 27.19 Topic Number Topic 137 54.83 Topic 150 57.99 Topic 138 1.83 CLEF 2005 DS−Bilingual−X2DE − Comparison to median by topic (topics 139 to 150) 1 BK2GBLEG1 Difference (average precision) 0.5 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number A.350 berkeley-2 BK2GBLEG2 DS-Bilingual-X2DE Overall statistics for 25 queries : General info: Total number of documents over all queries Track= Domain Specific Bilingual English to German Retrieved 25,000 RunType= automatic Relevant 2,682 QueryType= TD Relevant retrieved 2,192 Pooled= true CLEF 2005 DS−Bilingual−X2DE − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 82.22 BK2GBLEG2 90% 10 67.72 20 60.16 80% 30 50.49 70% 40 45.25 50 40.40 Average Precision 60% 60 32.08 50% 70 24.78 80 17.20 40% 90 9.49 30% 100 1.24 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 38.09 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 DS−Bilingual−X2DE − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 64.80 BK2GBLEG2 90% 10 docs 61.20 15 docs 57.87 80% 20 docs 56.40 70% 30 docs 53.73 100 docs 39.08 60% R−Precision 200 docs 27.84 50% 500 docs 15.07 1000 docs 8.77 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 38.44 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 DS−Bilingual−X2DE − Comparison to median by topic (topics 126 to 138) queries 1 BK2GBLEG2 Topic 126 35.45 Topic 139 29.83 Difference (average precision) Topic 127 59.90 Topic 140 40.97 0.5 Topic 128 66.96 Topic 141 78.18 Topic 129 44.57 Topic 142 47.14 Topic 130 33.98 Topic 143 22.10 0 Topic 131 7.76 Topic 144 16.80 Topic 132 90.09 Topic 145 59.98 −0.5 Topic 133 8.15 Topic 146 60.56 Topic 134 42.12 Topic 147 39.19 Topic 135 3.99 Topic 148 19.18 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic 136 7.83 Topic 149 27.58 Topic Number Topic 137 47.92 Topic 150 58.76 Topic 138 3.25 CLEF 2005 DS−Bilingual−X2DE − Comparison to median by topic (topics 139 to 150) 1 BK2GBLEG2 Difference (average precision) 0.5 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number A.351 berkeley-2 BK2GBLEG3 DS-Bilingual-X2DE Overall statistics for 25 queries : General info: Total number of documents over all queries Track= Domain Specific Bilingual English to German Retrieved 25,000 RunType= automatic Relevant 2,682 QueryType= TD Relevant retrieved 2,089 Pooled= true CLEF 2005 DS−Bilingual−X2DE − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 85.12 BK2GBLEG3 90% 10 65.52 20 56.87 80% 30 45.21 70% 40 39.26 50 34.71 Average Precision 60% 60 28.81 50% 70 21.67 80 16.62 40% 90 6.86 30% 100 0.86 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 35.11 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 DS−Bilingual−X2DE − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 64.80 BK2GBLEG3 90% 10 docs 62.40 15 docs 59.20 80% 20 docs 55.80 70% 30 docs 50.80 100 docs 36.32 60% R−Precision 200 docs 25.36 50% 500 docs 14.22 1000 docs 8.36 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 35.80 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 DS−Bilingual−X2DE − Comparison to median by topic (topics 126 to 138) queries 1 BK2GBLEG3 Topic 126 28.53 Topic 139 44.17 Difference (average precision) Topic 127 56.37 Topic 140 56.75 0.5 Topic 128 62.63 Topic 141 26.97 Topic 129 20.94 Topic 142 58.67 Topic 130 46.06 Topic 143 22.85 0 Topic 131 6.01 Topic 144 12.36 Topic 132 87.98 Topic 145 52.11 −0.5 Topic 133 2.01 Topic 146 64.53 Topic 134 45.15 Topic 147 40.63 Topic 135 5.28 Topic 148 46.66 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic 136 3.96 Topic 149 4.76 Topic Number Topic 137 25.30 Topic 150 54.65 Topic 138 2.33 CLEF 2005 DS−Bilingual−X2DE − Comparison to median by topic (topics 139 to 150) 1 BK2GBLEG3 Difference (average precision) 0.5 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number A.352 berkeley-2 BK2GBLEG4 DS-Bilingual-X2DE Overall statistics for 25 queries : General info: Total number of documents over all queries Track= Domain Specific Bilingual English to German Retrieved 25,000 RunType= automatic Relevant 2,682 QueryType= TD Relevant retrieved 2,192 Pooled= true CLEF 2005 DS−Bilingual−X2DE − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 82.22 BK2GBLEG4 90% 10 67.72 20 60.16 80% 30 50.49 70% 40 45.25 50 40.40 Average Precision 60% 60 32.08 50% 70 24.78 80 17.20 40% 90 9.49 30% 100 1.24 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 38.09 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 DS−Bilingual−X2DE − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 64.80 BK2GBLEG4 90% 10 docs 61.20 15 docs 57.87 80% 20 docs 56.40 70% 30 docs 53.73 100 docs 39.08 60% R−Precision 200 docs 27.84 50% 500 docs 15.07 1000 docs 8.77 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 38.44 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 DS−Bilingual−X2DE − Comparison to median by topic (topics 126 to 138) queries 1 BK2GBLEG4 Topic 126 35.45 Topic 139 29.83 Difference (average precision) Topic 127 59.90 Topic 140 40.97 0.5 Topic 128 66.96 Topic 141 78.18 Topic 129 44.57 Topic 142 47.14 Topic 130 33.98 Topic 143 22.10 0 Topic 131 7.76 Topic 144 16.80 Topic 132 90.09 Topic 145 59.98 −0.5 Topic 133 8.15 Topic 146 60.56 Topic 134 42.12 Topic 147 39.19 Topic 135 3.99 Topic 148 19.18 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic 136 7.83 Topic 149 27.58 Topic Number Topic 137 47.92 Topic 150 58.76 Topic 138 3.25 CLEF 2005 DS−Bilingual−X2DE − Comparison to median by topic (topics 139 to 150) 1 BK2GBLEG4 Difference (average precision) 0.5 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number A.353 hagen FUHegfyyn DS-Bilingual-X2DE Overall statistics for 25 queries : General info: Total number of documents over all queries Track= Domain Specific Bilingual English to German Retrieved 25,000 RunType= automatic Relevant 2,682 QueryType= TD Relevant retrieved 1,518 Pooled= true CLEF 2005 DS−Bilingual−X2DE − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 78.17 FUHegfyyn 90% 10 52.61 20 38.13 80% 30 30.93 70% 40 25.45 50 21.25 Average Precision 60% 60 16.18 50% 70 11.74 80 8.47 40% 90 4.74 30% 100 0.00 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 23.92 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 DS−Bilingual−X2DE − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 56.00 FUHegfyyn 90% 10 docs 53.60 15 docs 48.27 80% 20 docs 45.40 70% 30 docs 40.80 100 docs 26.88 60% R−Precision 200 docs 18.04 50% 500 docs 9.98 1000 docs 6.07 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 26.32 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 DS−Bilingual−X2DE − Comparison to median by topic (topics 126 to 138) queries 1 FUHegfyyn Topic 126 20.35 Topic 139 5.44 Difference (average precision) Topic 127 62.47 Topic 140 18.02 0.5 Topic 128 1.36 Topic 141 80.17 Topic 129 0.16 Topic 142 25.77 Topic 130 16.22 Topic 143 7.48 0 Topic 131 21.77 Topic 144 42.06 Topic 132 87.65 Topic 145 47.04 −0.5 Topic 133 6.69 Topic 146 48.74 Topic 134 3.49 Topic 147 22.73 Topic 135 0.58 Topic 148 6.75 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic 136 0.14 Topic 149 22.49 Topic Number Topic 137 4.90 Topic 150 44.67 Topic 138 0.74 CLEF 2005 DS−Bilingual−X2DE − Comparison to median by topic (topics 139 to 150) 1 FUHegfyyn Difference (average precision) 0.5 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number A.354 hagen FUHegpyyd DS-Bilingual-X2DE Overall statistics for 25 queries : General info: Total number of documents over all queries Track= Domain Specific Bilingual English to German Retrieved 25,000 RunType= automatic Relevant 2,682 QueryType= TD Relevant retrieved 1,567 Pooled= true CLEF 2005 DS−Bilingual−X2DE − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 81.20 FUHegpyyd 90% 10 53.89 20 40.11 80% 30 31.35 70% 40 24.12 50 19.91 Average Precision 60% 60 15.51 50% 70 10.72 80 7.38 40% 90 4.58 30% 100 0.00 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 23.99 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 DS−Bilingual−X2DE − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 60.00 FUHegpyyd 90% 10 docs 52.00 15 docs 46.67 80% 20 docs 43.20 70% 30 docs 40.80 100 docs 27.48 60% R−Precision 200 docs 18.62 50% 500 docs 10.33 1000 docs 6.27 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 27.14 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 DS−Bilingual−X2DE − Comparison to median by topic (topics 126 to 138) queries 1 FUHegpyyd Topic 126 18.87 Topic 139 27.14 Difference (average precision) Topic 127 62.47 Topic 140 10.92 0.5 Topic 128 1.43 Topic 141 68.93 Topic 129 10.39 Topic 142 15.60 Topic 130 16.79 Topic 143 32.83 0 Topic 131 8.43 Topic 144 41.97 Topic 132 86.87 Topic 145 53.42 −0.5 Topic 133 5.22 Topic 146 25.70 Topic 134 8.80 Topic 147 14.49 Topic 135 0.45 Topic 148 12.53 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic 136 2.61 Topic 149 22.77 Topic Number Topic 137 5.02 Topic 150 44.78 Topic 138 1.42 CLEF 2005 DS−Bilingual−X2DE − Comparison to median by topic (topics 139 to 150) 1 FUHegpyyd Difference (average precision) 0.5 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number A.355 hagen FUHegpyyn DS-Bilingual-X2DE Overall statistics for 25 queries : General info: Total number of documents over all queries Track= Domain Specific Bilingual English to German Retrieved 25,000 RunType= automatic Relevant 2,682 QueryType= TD Relevant retrieved 1,567 Pooled= true CLEF 2005 DS−Bilingual−X2DE − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 81.20 FUHegpyyn 90% 10 53.89 20 40.11 80% 30 31.35 70% 40 24.12 50 19.91 Average Precision 60% 60 15.51 50% 70 10.72 80 7.38 40% 90 4.58 30% 100 0.00 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 23.99 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 DS−Bilingual−X2DE − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 60.00 FUHegpyyn 90% 10 docs 52.00 15 docs 46.67 80% 20 docs 43.20 70% 30 docs 40.80 100 docs 27.48 60% R−Precision 200 docs 18.62 50% 500 docs 10.33 1000 docs 6.27 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 27.14 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 DS−Bilingual−X2DE − Comparison to median by topic (topics 126 to 138) queries 1 FUHegpyyn Topic 126 18.87 Topic 139 27.14 Difference (average precision) Topic 127 62.47 Topic 140 10.92 0.5 Topic 128 1.43 Topic 141 68.93 Topic 129 10.39 Topic 142 15.60 Topic 130 16.79 Topic 143 32.83 0 Topic 131 8.43 Topic 144 41.97 Topic 132 86.87 Topic 145 53.42 −0.5 Topic 133 5.22 Topic 146 25.70 Topic 134 8.80 Topic 147 14.49 Topic 135 0.45 Topic 148 12.53 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic 136 2.61 Topic 149 22.77 Topic Number Topic 137 5.02 Topic 150 44.78 Topic 138 1.42 CLEF 2005 DS−Bilingual−X2DE − Comparison to median by topic (topics 139 to 150) 1 FUHegpyyn Difference (average precision) 0.5 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number A.356 hagen FUHegsyyn DS-Bilingual-X2DE Overall statistics for 25 queries : General info: Total number of documents over all queries Track= Domain Specific Bilingual English to German Retrieved 25,000 RunType= automatic Relevant 2,682 QueryType= TD Relevant retrieved 1,584 Pooled= true CLEF 2005 DS−Bilingual−X2DE − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 66.61 FUHegsyyn 90% 10 48.03 20 39.31 80% 30 30.90 70% 40 25.13 50 19.55 Average Precision 60% 60 15.54 50% 70 9.91 80 7.49 40% 90 4.85 30% 100 0.15 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 22.61 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 DS−Bilingual−X2DE − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 51.20 FUHegsyyn 90% 10 docs 48.80 15 docs 45.33 80% 20 docs 42.00 70% 30 docs 38.13 100 docs 26.60 60% R−Precision 200 docs 18.72 50% 500 docs 10.53 1000 docs 6.34 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 26.53 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 DS−Bilingual−X2DE − Comparison to median by topic (topics 126 to 138) queries 1 FUHegsyyn Topic 126 24.61 Topic 139 1.74 Difference (average precision) Topic 127 62.47 Topic 140 12.97 0.5 Topic 128 46.79 Topic 141 48.37 Topic 129 0.04 Topic 142 0.34 Topic 130 47.45 Topic 143 22.34 0 Topic 131 8.43 Topic 144 30.31 Topic 132 87.12 Topic 145 11.07 −0.5 Topic 133 5.22 Topic 146 58.09 Topic 134 17.79 Topic 147 14.70 Topic 135 0.06 Topic 148 4.90 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic 136 2.48 Topic 149 6.94 Topic Number Topic 137 5.52 Topic 150 43.62 Topic 138 1.79 CLEF 2005 DS−Bilingual−X2DE − Comparison to median by topic (topics 139 to 150) 1 FUHegsyyn Difference (average precision) 0.5 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number A.357 hagen FUHegwyyn DS-Bilingual-X2DE Overall statistics for 25 queries : General info: Total number of documents over all queries Track= Domain Specific Bilingual English to German Retrieved 25,000 RunType= automatic Relevant 2,682 QueryType= TD Relevant retrieved 1,580 Pooled= true CLEF 2005 DS−Bilingual−X2DE − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 65.41 FUHegwyyn 90% 10 47.29 20 39.16 80% 30 30.90 70% 40 25.13 50 19.55 Average Precision 60% 60 15.54 50% 70 9.91 80 7.49 40% 90 4.85 30% 100 0.15 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 22.48 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 DS−Bilingual−X2DE − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 49.60 FUHegwyyn 90% 10 docs 47.60 15 docs 44.27 80% 20 docs 41.40 70% 30 docs 38.13 100 docs 26.60 60% R−Precision 200 docs 18.72 50% 500 docs 10.50 1000 docs 6.32 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 26.57 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 DS−Bilingual−X2DE − Comparison to median by topic (topics 126 to 138) queries 1 FUHegwyyn Topic 126 24.61 Topic 139 1.74 Difference (average precision) Topic 127 62.47 Topic 140 12.97 0.5 Topic 128 46.79 Topic 141 48.37 Topic 129 0.04 Topic 142 0.34 Topic 130 47.45 Topic 143 22.34 0 Topic 131 5.23 Topic 144 30.31 Topic 132 87.12 Topic 145 11.07 −0.5 Topic 133 5.22 Topic 146 58.09 Topic 134 17.79 Topic 147 14.70 Topic 135 0.06 Topic 148 4.90 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic 136 2.48 Topic 149 6.94 Topic Number Topic 137 5.52 Topic 150 43.62 Topic 138 1.79 CLEF 2005 DS−Bilingual−X2DE − Comparison to median by topic (topics 139 to 150) 1 FUHegwyyn Difference (average precision) 0.5 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number A.358 hildesheim UHIGIRT3 DS-Bilingual-X2DE Overall statistics for 25 queries : General info: Total number of documents over all queries Track= Domain Specific Bilingual English to German Retrieved 24,848 RunType= automatic Relevant 2,682 QueryType= TD Relevant retrieved 1,159 Pooled= true CLEF 2005 DS−Bilingual−X2DE − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 62.16 UHIGIRT3 90% 10 39.22 20 33.31 80% 30 26.20 70% 40 21.05 50 15.39 Average Precision 60% 60 11.31 50% 70 8.44 80 0.00 40% 90 0.00 30% 100 0.00 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 17.79 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 DS−Bilingual−X2DE − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 43.20 UHIGIRT3 90% 10 docs 41.20 15 docs 39.47 80% 20 docs 38.00 70% 30 docs 36.13 100 docs 23.12 60% R−Precision 200 docs 14.58 50% 500 docs 7.64 1000 docs 4.64 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 21.35 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 DS−Bilingual−X2DE − Comparison to median by topic (topics 126 to 138) queries 1 UHIGIRT3 Topic 126 27.31 Topic 139 7.49 Difference (average precision) Topic 127 31.02 Topic 140 1.53 0.5 Topic 128 0.22 Topic 141 72.77 Topic 129 0.60 Topic 142 7.72 Topic 130 7.59 Topic 143 13.33 0 Topic 131 0.69 Topic 144 4.18 Topic 132 67.52 Topic 145 34.58 −0.5 Topic 133 4.37 Topic 146 45.95 Topic 134 3.45 Topic 147 46.16 Topic 135 0.05 Topic 148 0.97 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic 136 1.89 Topic 149 15.73 Topic Number Topic 137 36.34 Topic 150 13.39 Topic 138 0.00 CLEF 2005 DS−Bilingual−X2DE − Comparison to median by topic (topics 139 to 150) 1 UHIGIRT3 Difference (average precision) 0.5 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number A.359 u.glasgow glaendetdn DS-Bilingual-X2DE Overall statistics for 25 queries : General info: Total number of documents over all queries Track= Domain Specific Bilingual English to German Retrieved 25,000 RunType= automatic Relevant 2,682 QueryType= TDN Relevant retrieved 1,000 Pooled= true CLEF 2005 DS−Bilingual−X2DE − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 49.89 glaendetdn 90% 10 24.62 20 16.59 80% 30 12.91 70% 40 10.38 50 7.89 Average Precision 60% 60 6.59 50% 70 5.43 80 3.51 40% 90 2.96 30% 100 0.00 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 11.16 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 DS−Bilingual−X2DE − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 36.80 glaendetdn 90% 10 docs 28.00 15 docs 26.93 80% 20 docs 24.60 70% 30 docs 21.87 100 docs 15.04 60% R−Precision 200 docs 11.04 50% 500 docs 6.19 1000 docs 4.00 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 14.28 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 DS−Bilingual−X2DE − Comparison to median by topic (topics 126 to 138) queries 1 glaendetdn Topic 126 20.90 Topic 139 2.29 Difference (average precision) Topic 127 2.00 Topic 140 0.63 0.5 Topic 128 0.48 Topic 141 2.26 Topic 129 0.23 Topic 142 8.86 Topic 130 19.48 Topic 143 6.97 0 Topic 131 13.90 Topic 144 3.25 Topic 132 86.72 Topic 145 12.28 −0.5 Topic 133 0.01 Topic 146 14.01 Topic 134 0.11 Topic 147 4.36 Topic 135 0.00 Topic 148 2.49 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic 136 0.07 Topic 149 17.81 Topic Number Topic 137 51.62 Topic 150 8.20 Topic 138 0.00 CLEF 2005 DS−Bilingual−X2DE − Comparison to median by topic (topics 139 to 150) 1 glaendetdn Difference (average precision) 0.5 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number A.360 u.glasgow glaendetdnqe DS-Bilingual-X2DE Overall statistics for 25 queries : General info: Total number of documents over all queries Track= Domain Specific Bilingual English to German Retrieved 25,000 RunType= automatic Relevant 2,682 QueryType= TDN Relevant retrieved 1,272 Pooled= true CLEF 2005 DS−Bilingual−X2DE − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 47.39 glaendetdnqe 90% 10 36.02 20 31.98 80% 30 27.30 70% 40 24.14 50 19.77 Average Precision 60% 60 15.48 50% 70 12.34 80 7.14 40% 90 3.66 30% 100 0.00 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 19.46 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 DS−Bilingual−X2DE − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 36.80 glaendetdnqe 90% 10 docs 34.40 15 docs 33.87 80% 20 docs 33.20 70% 30 docs 31.47 100 docs 23.28 60% R−Precision 200 docs 15.96 50% 500 docs 8.38 1000 docs 5.09 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 22.43 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 DS−Bilingual−X2DE − Comparison to median by topic (topics 126 to 138) queries 1 glaendetdnqe Topic 126 28.74 Topic 139 1.09 Difference (average precision) Topic 127 1.76 Topic 140 0.04 0.5 Topic 128 0.53 Topic 141 10.39 Topic 129 0.22 Topic 142 20.32 Topic 130 59.54 Topic 143 15.44 0 Topic 131 40.96 Topic 144 4.87 Topic 132 86.57 Topic 145 63.44 −0.5 Topic 133 0.00 Topic 146 12.20 Topic 134 0.06 Topic 147 44.15 Topic 135 0.00 Topic 148 3.82 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic 136 0.04 Topic 149 12.00 Topic Number Topic 137 65.75 Topic 150 14.66 Topic 138 0.00 CLEF 2005 DS−Bilingual−X2DE − Comparison to median by topic (topics 139 to 150) 1 glaendetdnqe Difference (average precision) 0.5 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number A.361 u.glasgow glaendetdqe DS-Bilingual-X2DE Overall statistics for 25 queries : General info: Total number of documents over all queries Track= Domain Specific Bilingual English to German Retrieved 25,000 RunType= automatic Relevant 2,682 QueryType= TD Relevant retrieved 1,272 Pooled= true CLEF 2005 DS−Bilingual−X2DE − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 47.39 glaendetdqe 90% 10 36.02 20 31.98 80% 30 27.30 70% 40 24.14 50 19.77 Average Precision 60% 60 15.48 50% 70 12.34 80 7.14 40% 90 3.66 30% 100 0.00 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 19.46 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 DS−Bilingual−X2DE − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 36.80 glaendetdqe 90% 10 docs 34.40 15 docs 33.87 80% 20 docs 33.20 70% 30 docs 31.47 100 docs 23.28 60% R−Precision 200 docs 15.96 50% 500 docs 8.38 1000 docs 5.09 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 22.43 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 DS−Bilingual−X2DE − Comparison to median by topic (topics 126 to 138) queries 1 glaendetdqe Topic 126 28.74 Topic 139 1.09 Difference (average precision) Topic 127 1.76 Topic 140 0.04 0.5 Topic 128 0.53 Topic 141 10.39 Topic 129 0.22 Topic 142 20.32 Topic 130 59.54 Topic 143 15.44 0 Topic 131 40.96 Topic 144 4.87 Topic 132 86.57 Topic 145 63.44 −0.5 Topic 133 0.00 Topic 146 12.20 Topic 134 0.06 Topic 147 44.15 Topic 135 0.00 Topic 148 3.82 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic 136 0.04 Topic 149 12.00 Topic Number Topic 137 65.75 Topic 150 14.66 Topic 138 0.00 CLEF 2005 DS−Bilingual−X2DE − Comparison to median by topic (topics 139 to 150) 1 glaendetdqe Difference (average precision) 0.5 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number A.362 berkeley BERK1BLDEEN01 DS-Bilingual-X2EN Overall statistics for 25 queries : General info: Total number of documents over all queries Track= Domain Specific Bilingual German to English Retrieved 25,000 RunType= automatic Relevant 2,105 QueryType= TD Relevant retrieved 1,275 Pooled= true CLEF 2005 DS−Bilingual−X2EN − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 72.65 BERK1BLDEEN01 90% 10 52.57 20 38.86 80% 30 32.59 70% 40 24.08 50 20.18 Average Precision 60% 60 17.02 50% 70 13.22 80 9.78 40% 90 5.47 30% 100 0.00 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 23.98 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 DS−Bilingual−X2EN − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 53.60 BERK1BLDEEN01 90% 10 docs 46.80 15 docs 45.07 80% 20 docs 41.20 70% 30 docs 36.53 100 docs 23.20 60% R−Precision 200 docs 15.78 50% 500 docs 8.50 1000 docs 5.10 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 27.57 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 DS−Bilingual−X2EN − Comparison to median by topic (topics 126 to 138) queries 1 BERK1BLDEEN01 Topic 126 32.29 Topic 139 11.76 Difference (average precision) Topic 127 5.73 Topic 140 1.34 0.5 Topic 128 20.16 Topic 141 0.00 Topic 129 0.93 Topic 142 47.13 Topic 130 33.30 Topic 143 33.30 0 Topic 131 20.59 Topic 144 34.77 Topic 132 85.23 Topic 145 39.88 −0.5 Topic 133 13.20 Topic 146 76.24 Topic 134 22.73 Topic 147 2.04 Topic 135 10.16 Topic 148 7.21 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic 136 2.93 Topic 149 1.31 Topic Number Topic 137 37.27 Topic 150 35.56 Topic 138 24.50 CLEF 2005 DS−Bilingual−X2EN − Comparison to median by topic (topics 139 to 150) 1 BERK1BLDEEN01 Difference (average precision) 0.5 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number A.363 berkeley BERK1BLRUEN01 DS-Bilingual-X2EN Overall statistics for 25 queries : General info: Total number of documents over all queries Track= Domain Specific Bilingual Russian to English Retrieved 25,000 RunType= automatic Relevant 2,105 QueryType= TD Relevant retrieved 1,280 Pooled= true CLEF 2005 DS−Bilingual−X2EN − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 69.56 BERK1BLRUEN01 90% 10 51.82 20 38.79 80% 30 29.63 70% 40 24.09 50 21.15 Average Precision 60% 60 16.54 50% 70 12.43 80 8.76 40% 90 4.89 30% 100 0.28 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 23.58 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 DS−Bilingual−X2EN − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 55.20 BERK1BLRUEN01 90% 10 docs 48.00 15 docs 45.33 80% 20 docs 41.00 70% 30 docs 37.07 100 docs 23.60 60% R−Precision 200 docs 16.16 50% 500 docs 8.66 1000 docs 5.12 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 29.24 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 DS−Bilingual−X2EN − Comparison to median by topic (topics 126 to 138) queries 1 BERK1BLRUEN01 Topic 126 18.90 Topic 139 17.28 Difference (average precision) Topic 127 15.23 Topic 140 26.54 0.5 Topic 128 30.62 Topic 141 25.96 Topic 129 0.19 Topic 142 28.72 Topic 130 18.47 Topic 143 23.25 0 Topic 131 15.43 Topic 144 29.19 Topic 132 82.93 Topic 145 43.41 −0.5 Topic 133 1.72 Topic 146 87.25 Topic 134 23.75 Topic 147 19.07 Topic 135 8.16 Topic 148 4.44 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic 136 3.35 Topic 149 5.68 Topic Number Topic 137 16.49 Topic 150 0.79 Topic 138 42.78 CLEF 2005 DS−Bilingual−X2EN − Comparison to median by topic (topics 139 to 150) 1 BERK1BLRUEN01 Difference (average precision) 0.5 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number A.364 berkeley-2 BK2GBLGE1 DS-Bilingual-X2EN Overall statistics for 25 queries : General info: Total number of documents over all queries Track= Domain Specific Bilingual German to English Retrieved 25,000 RunType= automatic Relevant 2,105 QueryType= TD Relevant retrieved 1,856 Pooled= true CLEF 2005 DS−Bilingual−X2EN − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 95.72 BK2GBLGE1 90% 10 80.04 20 66.48 80% 30 58.31 70% 40 51.18 50 45.12 Average Precision 60% 60 38.50 50% 70 31.53 80 24.08 40% 90 15.36 30% 100 2.56 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 45.14 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 DS−Bilingual−X2EN − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 76.00 BK2GBLGE1 90% 10 docs 69.60 15 docs 66.40 80% 20 docs 63.40 70% 30 docs 58.40 100 docs 39.76 60% R−Precision 200 docs 26.96 50% 500 docs 13.54 1000 docs 7.42 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 46.15 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 DS−Bilingual−X2EN − Comparison to median by topic (topics 126 to 138) queries 1 BK2GBLGE1 Topic 126 39.82 Topic 139 28.70 Difference (average precision) Topic 127 56.40 Topic 140 60.42 0.5 Topic 128 68.97 Topic 141 83.09 Topic 129 22.75 Topic 142 43.39 Topic 130 51.35 Topic 143 37.53 0 Topic 131 53.36 Topic 144 42.14 Topic 132 90.99 Topic 145 59.40 −0.5 Topic 133 12.82 Topic 146 83.83 Topic 134 26.74 Topic 147 46.42 Topic 135 12.04 Topic 148 27.52 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic 136 48.92 Topic 149 11.67 Topic Number Topic 137 24.39 Topic 150 64.53 Topic 138 31.38 CLEF 2005 DS−Bilingual−X2EN − Comparison to median by topic (topics 139 to 150) 1 BK2GBLGE1 Difference (average precision) 0.5 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number A.365 berkeley-2 BK2GBLGE2 DS-Bilingual-X2EN Overall statistics for 25 queries : General info: Total number of documents over all queries Track= Domain Specific Bilingual German to English Retrieved 25,000 RunType= automatic Relevant 2,105 QueryType= TD Relevant retrieved 1,879 Pooled= true CLEF 2005 DS−Bilingual−X2EN − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 92.30 BK2GBLGE2 90% 10 85.65 20 72.14 80% 30 60.23 70% 40 53.66 50 46.91 Average Precision 60% 60 40.37 50% 70 34.15 80 26.77 40% 90 12.54 30% 100 2.39 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 47.43 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 DS−Bilingual−X2EN − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 78.40 BK2GBLGE2 90% 10 docs 75.20 15 docs 70.13 80% 20 docs 67.00 70% 30 docs 61.07 100 docs 40.96 60% R−Precision 200 docs 27.56 50% 500 docs 13.77 1000 docs 7.52 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 46.82 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 DS−Bilingual−X2EN − Comparison to median by topic (topics 126 to 138) queries 1 BK2GBLGE2 Topic 126 54.93 Topic 139 41.39 Difference (average precision) Topic 127 65.91 Topic 140 53.78 0.5 Topic 128 69.56 Topic 141 86.12 Topic 129 23.58 Topic 142 51.69 Topic 130 47.42 Topic 143 28.58 0 Topic 131 52.10 Topic 144 50.86 Topic 132 91.81 Topic 145 60.12 −0.5 Topic 133 3.66 Topic 146 85.35 Topic 134 28.66 Topic 147 49.51 Topic 135 10.17 Topic 148 31.16 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic 136 43.27 Topic 149 33.42 Topic Number Topic 137 27.51 Topic 150 63.35 Topic 138 31.75 CLEF 2005 DS−Bilingual−X2EN − Comparison to median by topic (topics 139 to 150) 1 BK2GBLGE2 Difference (average precision) 0.5 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number A.366 berkeley-2 BK2GBLGE3 DS-Bilingual-X2EN Overall statistics for 25 queries : General info: Total number of documents over all queries Track= Domain Specific Bilingual German to English Retrieved 25,000 RunType= automatic Relevant 2,105 QueryType= TD Relevant retrieved 1,758 Pooled= true CLEF 2005 DS−Bilingual−X2EN − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 92.21 BK2GBLGE3 90% 10 77.97 20 64.76 80% 30 55.35 70% 40 46.02 50 38.67 Average Precision 60% 60 31.73 50% 70 24.16 80 18.02 40% 90 8.78 30% 100 0.69 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 40.34 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 DS−Bilingual−X2EN − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 74.40 BK2GBLGE3 90% 10 docs 66.80 15 docs 65.07 80% 20 docs 62.40 70% 30 docs 57.60 100 docs 35.92 60% R−Precision 200 docs 23.82 50% 500 docs 12.33 1000 docs 7.03 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 40.19 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 DS−Bilingual−X2EN − Comparison to median by topic (topics 126 to 138) queries 1 BK2GBLGE3 Topic 126 26.24 Topic 139 40.49 Difference (average precision) Topic 127 62.85 Topic 140 65.18 0.5 Topic 128 71.12 Topic 141 90.72 Topic 129 27.66 Topic 142 47.60 Topic 130 40.37 Topic 143 28.26 0 Topic 131 49.70 Topic 144 47.91 Topic 132 57.82 Topic 145 54.78 −0.5 Topic 133 11.94 Topic 146 68.16 Topic 134 18.86 Topic 147 31.68 Topic 135 0.91 Topic 148 5.38 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic 136 34.85 Topic 149 53.29 Topic Number Topic 137 7.84 Topic 150 44.68 Topic 138 20.13 CLEF 2005 DS−Bilingual−X2EN − Comparison to median by topic (topics 139 to 150) 1 BK2GBLGE3 Difference (average precision) 0.5 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number A.367 msu-nivc cirGIRTru2en DS-Bilingual-X2EN Overall statistics for 25 queries : General info: Total number of documents over all queries Track= Domain Specific Bilingual Russian to English Retrieved 24,299 RunType= automatic Relevant 2,105 QueryType= TDN Relevant retrieved 1,141 Pooled= true CLEF 2005 DS−Bilingual−X2EN − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 58.31 cirGIRTru2en 90% 10 46.19 20 39.97 80% 30 32.61 70% 40 29.42 50 27.04 Average Precision 60% 60 22.82 50% 70 18.62 80 7.53 40% 90 2.58 30% 100 0.00 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 24.03 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 DS−Bilingual−X2EN − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 39.20 cirGIRTru2en 90% 10 docs 37.60 15 docs 37.60 80% 20 docs 37.40 70% 30 docs 33.60 100 docs 20.88 60% R−Precision 200 docs 14.58 50% 500 docs 7.39 1000 docs 4.56 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 27.37 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 DS−Bilingual−X2EN − Comparison to median by topic (topics 126 to 138) queries 1 cirGIRTru2en Topic 126 5.03 Topic 139 8.89 Difference (average precision) Topic 127 30.53 Topic 140 9.08 0.5 Topic 128 0.13 Topic 141 16.65 Topic 129 0.64 Topic 142 66.62 Topic 130 31.39 Topic 143 32.07 0 Topic 131 0.04 Topic 144 33.20 Topic 132 18.14 Topic 145 7.26 −0.5 Topic 133 35.41 Topic 146 75.00 Topic 134 7.17 Topic 147 49.47 Topic 135 0.68 Topic 148 45.89 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic 136 26.09 Topic 149 69.91 Topic Number Topic 137 0.22 Topic 150 4.67 Topic 138 26.68 CLEF 2005 DS−Bilingual−X2EN − Comparison to median by topic (topics 139 to 150) 1 cirGIRTru2en Difference (average precision) 0.5 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number A.368 u.glasgow gladeentdn DS-Bilingual-X2EN Overall statistics for 25 queries : General info: Total number of documents over all queries Track= Domain Specific Bilingual German to English Retrieved 25,000 RunType= automatic Relevant 2,105 QueryType= TDN Relevant retrieved 1,460 Pooled= true CLEF 2005 DS−Bilingual−X2EN − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 79.32 gladeentdn 90% 10 61.33 20 53.51 80% 30 40.52 70% 40 33.41 50 27.63 Average Precision 60% 60 22.09 50% 70 17.09 80 13.42 40% 90 7.37 30% 100 0.44 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 30.63 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 DS−Bilingual−X2EN − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 61.60 gladeentdn 90% 10 docs 56.40 15 docs 53.87 80% 20 docs 48.20 70% 30 docs 44.53 100 docs 27.96 60% R−Precision 200 docs 19.40 50% 500 docs 10.30 1000 docs 5.84 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 34.17 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 DS−Bilingual−X2EN − Comparison to median by topic (topics 126 to 138) queries 1 gladeentdn Topic 126 25.74 Topic 139 10.79 Difference (average precision) Topic 127 58.68 Topic 140 43.87 0.5 Topic 128 0.96 Topic 141 58.18 Topic 129 0.28 Topic 142 37.89 Topic 130 49.06 Topic 143 36.33 0 Topic 131 5.75 Topic 144 50.47 Topic 132 84.02 Topic 145 20.01 −0.5 Topic 133 4.54 Topic 146 62.86 Topic 134 36.53 Topic 147 32.74 Topic 135 9.64 Topic 148 16.26 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic 136 48.87 Topic 149 6.66 Topic Number Topic 137 17.11 Topic 150 34.23 Topic 138 14.27 CLEF 2005 DS−Bilingual−X2EN − Comparison to median by topic (topics 139 to 150) 1 gladeentdn Difference (average precision) 0.5 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number A.369 u.glasgow gladeentdnqe DS-Bilingual-X2EN Overall statistics for 25 queries : General info: Total number of documents over all queries Track= Domain Specific Bilingual German to English Retrieved 25,000 RunType= automatic Relevant 2,105 QueryType= TDN Relevant retrieved 1,615 Pooled= true CLEF 2005 DS−Bilingual−X2EN − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 81.24 gladeentdnqe 90% 10 65.73 20 58.90 80% 30 49.04 70% 40 41.11 50 36.22 Average Precision 60% 60 32.01 50% 70 28.14 80 22.66 40% 90 15.39 30% 100 0.77 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 38.37 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 DS−Bilingual−X2EN − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 65.60 gladeentdnqe 90% 10 docs 62.00 15 docs 58.13 80% 20 docs 55.60 70% 30 docs 50.53 100 docs 32.48 60% R−Precision 200 docs 22.04 50% 500 docs 11.41 1000 docs 6.46 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 40.28 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 DS−Bilingual−X2EN − Comparison to median by topic (topics 126 to 138) queries 1 gladeentdnqe Topic 126 31.59 Topic 139 12.82 Difference (average precision) Topic 127 62.81 Topic 140 52.86 0.5 Topic 128 0.84 Topic 141 78.35 Topic 129 0.20 Topic 142 39.07 Topic 130 59.30 Topic 143 40.43 0 Topic 131 7.87 Topic 144 67.65 Topic 132 90.09 Topic 145 44.31 −0.5 Topic 133 2.45 Topic 146 92.69 Topic 134 45.26 Topic 147 44.83 Topic 135 8.83 Topic 148 19.92 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic 136 46.50 Topic 149 6.95 Topic Number Topic 137 21.93 Topic 150 53.44 Topic 138 28.31 CLEF 2005 DS−Bilingual−X2EN − Comparison to median by topic (topics 139 to 150) 1 gladeentdnqe Difference (average precision) 0.5 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number A.370 u.glasgow gladeentdqe DS-Bilingual-X2EN Overall statistics for 25 queries : General info: Total number of documents over all queries Track= Domain Specific Bilingual German to English Retrieved 25,000 RunType= automatic Relevant 2,105 QueryType= TD Relevant retrieved 1,614 Pooled= true CLEF 2005 DS−Bilingual−X2EN − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 81.23 gladeentdqe 90% 10 65.88 20 58.83 80% 30 48.86 70% 40 41.02 50 36.11 Average Precision 60% 60 31.97 50% 70 28.13 80 22.62 40% 90 15.29 30% 100 0.77 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 38.30 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 DS−Bilingual−X2EN − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 64.80 gladeentdqe 90% 10 docs 61.60 15 docs 58.13 80% 20 docs 55.60 70% 30 docs 50.67 100 docs 32.52 60% R−Precision 200 docs 22.04 50% 500 docs 11.40 1000 docs 6.46 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 40.26 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 DS−Bilingual−X2EN − Comparison to median by topic (topics 126 to 138) queries 1 gladeentdqe Topic 126 31.58 Topic 139 12.75 Difference (average precision) Topic 127 61.83 Topic 140 52.78 0.5 Topic 128 0.83 Topic 141 78.34 Topic 129 0.20 Topic 142 38.90 Topic 130 59.23 Topic 143 40.51 0 Topic 131 7.83 Topic 144 67.63 Topic 132 90.08 Topic 145 44.41 −0.5 Topic 133 2.45 Topic 146 92.70 Topic 134 45.19 Topic 147 44.84 Topic 135 8.52 Topic 148 19.87 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic 136 46.43 Topic 149 6.96 Topic Number Topic 137 21.93 Topic 150 53.37 Topic 138 28.31 CLEF 2005 DS−Bilingual−X2EN − Comparison to median by topic (topics 139 to 150) 1 gladeentdqe Difference (average precision) 0.5 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number A.371 u.glasgow glaruentdn DS-Bilingual-X2EN Overall statistics for 25 queries : General info: Total number of documents over all queries Track= Domain Specific Bilingual Russian to English Retrieved 25,000 RunType= automatic Relevant 2,105 QueryType= TDN Relevant retrieved 1,476 Pooled= true CLEF 2005 DS−Bilingual−X2EN − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 82.97 glaruentdn 90% 10 64.17 20 54.13 80% 30 41.28 70% 40 32.72 50 27.07 Average Precision 60% 60 22.92 50% 70 19.64 80 14.76 40% 90 7.48 30% 100 0.13 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 31.49 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 DS−Bilingual−X2EN − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 64.00 glaruentdn 90% 10 docs 59.20 15 docs 55.47 80% 20 docs 52.00 70% 30 docs 45.87 100 docs 29.00 60% R−Precision 200 docs 20.26 50% 500 docs 10.54 1000 docs 5.90 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 34.39 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 DS−Bilingual−X2EN − Comparison to median by topic (topics 126 to 138) queries 1 glaruentdn Topic 126 29.29 Topic 139 8.21 Difference (average precision) Topic 127 47.81 Topic 140 42.01 0.5 Topic 128 70.02 Topic 141 31.99 Topic 129 2.29 Topic 142 16.36 Topic 130 37.42 Topic 143 30.39 0 Topic 131 29.81 Topic 144 59.17 Topic 132 89.21 Topic 145 23.95 −0.5 Topic 133 15.51 Topic 146 82.95 Topic 134 23.57 Topic 147 32.50 Topic 135 6.79 Topic 148 7.90 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic 136 54.32 Topic 149 8.25 Topic Number Topic 137 19.85 Topic 150 1.63 Topic 138 16.03 CLEF 2005 DS−Bilingual−X2EN − Comparison to median by topic (topics 139 to 150) 1 glaruentdn Difference (average precision) 0.5 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number A.372 u.glasgow glaruentdnqe DS-Bilingual-X2EN Overall statistics for 25 queries : General info: Total number of documents over all queries Track= Domain Specific Bilingual Russian to English Retrieved 25,000 RunType= automatic Relevant 2,105 QueryType= TDN Relevant retrieved 1,663 Pooled= true CLEF 2005 DS−Bilingual−X2EN − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 80.70 glaruentdnqe 90% 10 65.89 20 57.59 80% 30 48.70 70% 40 43.42 50 38.26 Average Precision 60% 60 34.04 50% 70 28.50 80 23.00 40% 90 13.91 30% 100 0.82 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 38.48 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 DS−Bilingual−X2EN − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 63.20 glaruentdnqe 90% 10 docs 60.00 15 docs 55.47 80% 20 docs 53.80 70% 30 docs 50.67 100 docs 34.56 60% R−Precision 200 docs 23.54 50% 500 docs 11.91 1000 docs 6.65 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 40.84 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 DS−Bilingual−X2EN − Comparison to median by topic (topics 126 to 138) queries 1 glaruentdnqe Topic 126 29.18 Topic 139 12.35 Difference (average precision) Topic 127 57.20 Topic 140 51.92 0.5 Topic 128 75.85 Topic 141 63.10 Topic 129 1.67 Topic 142 17.48 Topic 130 35.52 Topic 143 41.41 0 Topic 131 69.15 Topic 144 65.69 Topic 132 90.87 Topic 145 38.17 −0.5 Topic 133 10.46 Topic 146 90.79 Topic 134 31.14 Topic 147 43.94 Topic 135 4.81 Topic 148 8.61 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic 136 57.60 Topic 149 11.39 Topic Number Topic 137 23.62 Topic 150 1.25 Topic 138 28.83 CLEF 2005 DS−Bilingual−X2EN − Comparison to median by topic (topics 139 to 150) 1 glaruentdnqe Difference (average precision) 0.5 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number A.373 u.glasgow glaruentdqe DS-Bilingual-X2EN Overall statistics for 25 queries : General info: Total number of documents over all queries Track= Domain Specific Bilingual Russian to English Retrieved 25,000 RunType= automatic Relevant 2,105 QueryType= TD Relevant retrieved 1,662 Pooled= true CLEF 2005 DS−Bilingual−X2EN − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 80.90 glaruentdqe 90% 10 65.80 20 57.58 80% 30 48.60 70% 40 43.46 50 38.25 Average Precision 60% 60 33.99 50% 70 28.46 80 22.94 40% 90 13.84 30% 100 0.81 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 38.46 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 DS−Bilingual−X2EN − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 63.20 glaruentdqe 90% 10 docs 60.00 15 docs 55.73 80% 20 docs 53.40 70% 30 docs 50.67 100 docs 34.56 60% R−Precision 200 docs 23.52 50% 500 docs 11.92 1000 docs 6.65 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 40.81 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 DS−Bilingual−X2EN − Comparison to median by topic (topics 126 to 138) queries 1 glaruentdqe Topic 126 29.09 Topic 139 12.28 Difference (average precision) Topic 127 57.19 Topic 140 51.89 0.5 Topic 128 75.70 Topic 141 63.11 Topic 129 1.67 Topic 142 17.44 Topic 130 35.75 Topic 143 41.39 0 Topic 131 69.01 Topic 144 65.63 Topic 132 90.85 Topic 145 38.23 −0.5 Topic 133 10.45 Topic 146 90.75 Topic 134 31.05 Topic 147 43.94 Topic 135 4.81 Topic 148 8.57 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic 136 57.57 Topic 149 11.42 Topic Number Topic 137 23.62 Topic 150 1.25 Topic 138 28.79 CLEF 2005 DS−Bilingual−X2EN − Comparison to median by topic (topics 139 to 150) 1 glaruentdqe Difference (average precision) 0.5 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number A.374 u.glasgow glaruentdqeD DS-Bilingual-X2EN Overall statistics for 25 queries : General info: Total number of documents over all queries Track= Domain Specific Bilingual Russian to English Retrieved 25,000 RunType= automatic Relevant 2,105 QueryType= TD Relevant retrieved 1,682 Pooled= true CLEF 2005 DS−Bilingual−X2EN − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 80.97 glaruentdqeD 90% 10 66.34 20 56.69 80% 30 48.85 70% 40 43.56 50 39.98 Average Precision 60% 60 34.87 50% 70 29.77 80 23.17 40% 90 15.62 30% 100 0.80 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 38.99 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 DS−Bilingual−X2EN − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 62.40 glaruentdqeD 90% 10 docs 58.80 15 docs 55.20 80% 20 docs 52.60 70% 30 docs 50.67 100 docs 34.76 60% R−Precision 200 docs 23.80 50% 500 docs 12.06 1000 docs 6.73 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 41.56 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 DS−Bilingual−X2EN − Comparison to median by topic (topics 126 to 138) queries 1 glaruentdqeD Topic 126 30.47 Topic 139 9.25 Difference (average precision) Topic 127 55.27 Topic 140 49.13 0.5 Topic 128 75.75 Topic 141 69.23 Topic 129 2.06 Topic 142 15.46 Topic 130 31.61 Topic 143 41.66 0 Topic 131 71.22 Topic 144 63.49 Topic 132 90.48 Topic 145 40.07 −0.5 Topic 133 11.76 Topic 146 91.71 Topic 134 32.03 Topic 147 43.86 Topic 135 3.86 Topic 148 9.05 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic 136 56.41 Topic 149 9.86 Topic Number Topic 137 22.06 Topic 150 3.28 Topic 138 45.66 CLEF 2005 DS−Bilingual−X2EN − Comparison to median by topic (topics 139 to 150) 1 glaruentdqeD Difference (average precision) 0.5 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number A.375 berkeley BERK1BLDERU01 DS-Bilingual-X2RU Overall statistics for 25 queries : General info: Total number of documents over all queries Track= Domain Specific Bilingual German to Russian Retrieved 24,726 RunType= automatic Relevant 831 QueryType= TD Relevant retrieved 586 Pooled= true CLEF 2005 DS−Bilingual−X2RU − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 49.48 BERK1BLDERU01 90% 10 38.06 20 30.93 80% 30 21.80 70% 40 19.41 50 16.98 Average Precision 60% 60 10.78 50% 70 7.98 80 5.58 40% 90 4.13 30% 100 3.08 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 17.17 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 DS−Bilingual−X2RU − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 25.60 BERK1BLDERU01 90% 10 docs 22.80 15 docs 21.07 80% 20 docs 19.60 70% 30 docs 17.87 100 docs 11.68 60% R−Precision 200 docs 7.74 50% 500 docs 4.09 1000 docs 2.34 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 18.64 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 DS−Bilingual−X2RU − Comparison to median by topic (topics 126 to 138) queries 1 BERK1BLDERU01 Topic 126 41.19 Topic 139 22.41 Difference (average precision) Topic 127 61.74 Topic 140 2.56 0.5 Topic 128 23.74 Topic 141 20.40 Topic 129 0.00 Topic 142 13.39 Topic 130 5.97 Topic 143 83.33 0 Topic 131 9.76 Topic 144 1.07 Topic 132 30.40 Topic 145 59.83 −0.5 Topic 133 10.71 Topic 146 0.00 Topic 134 1.28 Topic 147 0.00 Topic 135 8.01 Topic 148 6.39 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic 136 2.03 Topic 149 1.36 Topic Number Topic 137 11.14 Topic 150 1.56 Topic 138 10.95 CLEF 2005 DS−Bilingual−X2RU − Comparison to median by topic (topics 139 to 150) 1 BERK1BLDERU01 Difference (average precision) 0.5 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number A.376 berkeley BERK1BLENRU01 DS-Bilingual-X2RU Overall statistics for 25 queries : General info: Total number of documents over all queries Track= Domain Specific Bilingual English to Russian Retrieved 25,000 RunType= automatic Relevant 831 QueryType= TD Relevant retrieved 498 Pooled= true CLEF 2005 DS−Bilingual−X2RU − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 49.51 BERK1BLENRU01 90% 10 32.25 20 23.50 80% 30 18.89 70% 40 15.33 50 12.95 Average Precision 60% 60 8.33 50% 70 5.64 80 3.58 40% 90 1.91 30% 100 1.27 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 13.64 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 DS−Bilingual−X2RU − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 21.60 BERK1BLENRU01 90% 10 docs 19.60 15 docs 17.87 80% 20 docs 16.60 70% 30 docs 15.47 100 docs 10.52 60% R−Precision 200 docs 6.70 50% 500 docs 3.45 1000 docs 1.99 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 15.46 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 DS−Bilingual−X2RU − Comparison to median by topic (topics 126 to 138) queries 1 BERK1BLENRU01 Topic 126 15.52 Topic 139 20.28 Difference (average precision) Topic 127 68.72 Topic 140 3.58 0.5 Topic 128 19.03 Topic 141 20.86 Topic 129 0.00 Topic 142 0.50 Topic 130 0.48 Topic 143 64.29 0 Topic 131 0.72 Topic 144 2.70 Topic 132 12.50 Topic 145 56.70 −0.5 Topic 133 10.43 Topic 146 0.00 Topic 134 0.72 Topic 147 0.16 Topic 135 8.45 Topic 148 15.11 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic 136 2.20 Topic 149 5.55 Topic Number Topic 137 8.45 Topic 150 1.78 Topic 138 2.25 CLEF 2005 DS−Bilingual−X2RU − Comparison to median by topic (topics 139 to 150) 1 BERK1BLENRU01 Difference (average precision) 0.5 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number A.377 berkeley-2 BK2GBLGR1 DS-Bilingual-X2RU Overall statistics for 25 queries : General info: Total number of documents over all queries Track= Domain Specific Bilingual German to Russian Retrieved 25,000 RunType= automatic Relevant 831 QueryType= TD Relevant retrieved 629 Pooled= true CLEF 2005 DS−Bilingual−X2RU − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 57.41 BK2GBLGR1 90% 10 39.08 20 32.92 80% 30 28.22 70% 40 26.08 50 23.94 Average Precision 60% 60 20.84 50% 70 19.19 80 12.74 40% 90 7.89 30% 100 5.24 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 23.31 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 DS−Bilingual−X2RU − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 36.00 BK2GBLGR1 90% 10 docs 31.20 15 docs 27.73 80% 20 docs 24.60 70% 30 docs 21.20 100 docs 15.12 60% R−Precision 200 docs 10.02 50% 500 docs 4.74 1000 docs 2.52 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 25.01 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 DS−Bilingual−X2RU − Comparison to median by topic (topics 126 to 138) queries 1 BK2GBLGR1 Topic 126 51.82 Topic 139 51.45 Difference (average precision) Topic 127 75.59 Topic 140 2.71 0.5 Topic 128 37.93 Topic 141 13.44 Topic 129 0.11 Topic 142 28.86 Topic 130 0.61 Topic 143 100.00 0 Topic 131 29.76 Topic 144 1.37 Topic 132 10.00 Topic 145 68.21 −0.5 Topic 133 46.43 Topic 146 0.00 Topic 134 6.07 Topic 147 0.00 Topic 135 2.57 Topic 148 5.51 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic 136 10.02 Topic 149 2.57 Topic Number Topic 137 19.10 Topic 150 1.02 Topic 138 17.70 CLEF 2005 DS−Bilingual−X2RU − Comparison to median by topic (topics 139 to 150) 1 BK2GBLGR1 Difference (average precision) 0.5 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number A.378 berkeley-2 BK2GBLER1 DS-Bilingual-X2RU Overall statistics for 25 queries : General info: Total number of documents over all queries Track= Domain Specific Bilingual English to Russian Retrieved 25,000 RunType= automatic Relevant 831 QueryType= TD Relevant retrieved 567 Pooled= true CLEF 2005 DS−Bilingual−X2RU − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 55.81 BK2GBLER1 90% 10 39.88 20 27.90 80% 30 22.85 70% 40 20.90 50 19.59 Average Precision 60% 60 13.03 50% 70 10.28 80 8.24 40% 90 4.33 30% 100 0.84 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 18.10 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 DS−Bilingual−X2RU − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 28.00 BK2GBLER1 90% 10 docs 25.20 15 docs 22.67 80% 20 docs 20.60 70% 30 docs 19.07 100 docs 13.28 60% R−Precision 200 docs 8.46 50% 500 docs 4.19 1000 docs 2.27 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 19.79 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 DS−Bilingual−X2RU − Comparison to median by topic (topics 126 to 138) queries 1 BK2GBLER1 Topic 126 42.10 Topic 139 22.94 Difference (average precision) Topic 127 86.91 Topic 140 2.55 0.5 Topic 128 25.94 Topic 141 19.33 Topic 129 0.21 Topic 142 1.36 Topic 130 0.25 Topic 143 0.94 0 Topic 131 52.94 Topic 144 0.65 Topic 132 12.50 Topic 145 59.49 −0.5 Topic 133 39.15 Topic 146 0.00 Topic 134 9.13 Topic 147 0.11 Topic 135 18.76 Topic 148 16.18 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic 136 11.09 Topic 149 8.80 Topic Number Topic 137 15.55 Topic 150 1.39 Topic 138 4.32 CLEF 2005 DS−Bilingual−X2RU − Comparison to median by topic (topics 139 to 150) 1 BK2GBLER1 Difference (average precision) 0.5 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number A.379 msu-nivc cirRSSCen2ru DS-Bilingual-X2RU Overall statistics for 24 queries : General info: Total number of documents over all queries Track= Domain Specific Bilingual English to Russian Retrieved 8,696 RunType= automatic Relevant 829 QueryType= TDN Relevant retrieved 90 Pooled= true CLEF 2005 DS−Bilingual−X2RU − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 19.53 cirRSSCen2ru 90% 10 9.92 20 1.15 80% 30 0.77 70% 40 0.17 50 0.17 Average Precision 60% 60 0.00 50% 70 0.00 80 0.00 40% 90 0.00 30% 100 0.00 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 2.16 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 DS−Bilingual−X2RU − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 13.60 cirRSSCen2ru 90% 10 docs 13.60 15 docs 12.80 80% 20 docs 10.60 70% 30 docs 8.93 100 docs 3.24 60% R−Precision 200 docs 1.66 50% 500 docs 0.72 1000 docs 0.36 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 3.43 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 DS−Bilingual−X2RU − Comparison to median by topic (topics 126 to 138) queries 1 cirRSSCen2ru Topic 126 0.26 Topic 139 7.76 Difference (average precision) Topic 127 11.62 Topic 140 2.89 0.5 Topic 128 0.02 Topic 141 0.00 Topic 129 0.00 Topic 142 6.78 Topic 130 5.35 Topic 143 0.00 0 Topic 131 0.00 Topic 144 1.89 Topic 132 0.00 Topic 145 14.75 −0.5 Topic 133 0.00 Topic 146 0.00 Topic 134 2.00 Topic 147 0.00 Topic 135 0.55 Topic 148 0.00 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic 136 0.22 Topic 149 0.00 Topic Number Topic 137 0.00 Topic 150 0.00 Topic 138 0.00 CLEF 2005 DS−Bilingual−X2RU − Comparison to median by topic (topics 139 to 150) 1 cirRSSCen2ru Difference (average precision) 0.5 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number A.380 berkeley BERK1MLEN01 DS-Monolingual-EN Overall statistics for 25 queries : General info: Total number of documents over all queries Track= Domain Specific Monolingual English Retrieved 25,000 RunType= automatic Relevant 2,105 QueryType= TD Relevant retrieved 1,711 Pooled= true CLEF 2005 DS−Monolingual−EN − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 78.99 BERK1MLEN01 90% 10 61.23 20 52.34 80% 30 44.99 70% 40 36.30 50 31.21 Average Precision 60% 60 26.06 50% 70 20.91 80 15.08 40% 90 8.76 30% 100 0.43 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 32.91 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 DS−Monolingual−EN − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 62.40 BERK1MLEN01 90% 10 docs 58.40 15 docs 55.20 80% 20 docs 51.40 70% 30 docs 47.33 100 docs 32.52 60% R−Precision 200 docs 22.28 50% 500 docs 11.87 1000 docs 6.84 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 36.46 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 DS−Monolingual−EN − Comparison to median by topic (topics 126 to 138) queries 1 BERK1MLEN01 Topic 126 43.75 Topic 139 19.80 Difference (average precision) Topic 127 37.93 Topic 140 37.17 0.5 Topic 128 64.74 Topic 141 49.78 Topic 129 0.13 Topic 142 29.80 Topic 130 52.93 Topic 143 26.25 0 Topic 131 23.32 Topic 144 8.98 Topic 132 85.23 Topic 145 47.08 −0.5 Topic 133 3.67 Topic 146 87.75 Topic 134 36.98 Topic 147 35.68 Topic 135 7.03 Topic 148 8.42 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic 136 33.69 Topic 149 1.47 Topic Number Topic 137 20.92 Topic 150 45.05 Topic 138 15.29 CLEF 2005 DS−Monolingual−EN − Comparison to median by topic (topics 139 to 150) 1 BERK1MLEN01 Difference (average precision) 0.5 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number A.381 berkeley-2 BK2GMLEE1 DS-Monolingual-EN Overall statistics for 25 queries : General info: Total number of documents over all queries Track= Domain Specific Monolingual English Retrieved 25,000 RunType= automatic Relevant 2,105 QueryType= TD Relevant retrieved 1,885 Pooled= true CLEF 2005 DS−Monolingual−EN − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 91.85 BK2GMLEE1 90% 10 76.53 20 63.34 80% 30 56.38 70% 40 51.61 50 45.42 Average Precision 60% 60 40.17 50% 70 33.09 80 26.72 40% 90 16.92 30% 100 4.46 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 45.31 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 DS−Monolingual−EN − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 77.60 BK2GMLEE1 90% 10 docs 68.40 15 docs 63.47 80% 20 docs 61.60 70% 30 docs 56.80 100 docs 41.28 60% R−Precision 200 docs 28.10 50% 500 docs 13.98 1000 docs 7.54 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 43.95 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 DS−Monolingual−EN − Comparison to median by topic (topics 126 to 138) queries 1 BK2GMLEE1 Topic 126 41.73 Topic 139 41.25 Difference (average precision) Topic 127 57.43 Topic 140 61.07 0.5 Topic 128 66.92 Topic 141 81.10 Topic 129 2.59 Topic 142 30.01 Topic 130 64.51 Topic 143 40.70 0 Topic 131 61.50 Topic 144 36.01 Topic 132 88.87 Topic 145 60.87 −0.5 Topic 133 3.13 Topic 146 77.34 Topic 134 25.02 Topic 147 75.29 Topic 135 15.38 Topic 148 18.62 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic 136 54.33 Topic 149 15.50 Topic Number Topic 137 16.60 Topic 150 68.28 Topic 138 28.66 CLEF 2005 DS−Monolingual−EN − Comparison to median by topic (topics 139 to 150) 1 BK2GMLEE1 Difference (average precision) 0.5 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number A.382 berkeley-2 BK2GMLEE2 DS-Monolingual-EN Overall statistics for 25 queries : General info: Total number of documents over all queries Track= Domain Specific Monolingual English Retrieved 25,000 RunType= automatic Relevant 2,105 QueryType= TD Relevant retrieved 1,728 Pooled= true CLEF 2005 DS−Monolingual−EN − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 89.78 BK2GMLEE2 90% 10 71.11 20 62.97 80% 30 54.43 70% 40 48.45 50 41.05 Average Precision 60% 60 34.77 50% 70 28.09 80 22.05 40% 90 9.51 30% 100 2.72 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 41.49 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 DS−Monolingual−EN − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 72.80 BK2GMLEE2 90% 10 docs 68.40 15 docs 64.80 80% 20 docs 62.80 70% 30 docs 57.60 100 docs 37.64 60% R−Precision 200 docs 24.40 50% 500 docs 12.28 1000 docs 6.91 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 41.70 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 DS−Monolingual−EN − Comparison to median by topic (topics 126 to 138) queries 1 BK2GMLEE2 Topic 126 48.01 Topic 139 52.73 Difference (average precision) Topic 127 39.61 Topic 140 66.41 0.5 Topic 128 66.44 Topic 141 61.53 Topic 129 4.89 Topic 142 65.26 Topic 130 57.02 Topic 143 32.80 0 Topic 131 21.95 Topic 144 36.09 Topic 132 86.82 Topic 145 56.70 −0.5 Topic 133 0.98 Topic 146 82.87 Topic 134 32.19 Topic 147 51.65 Topic 135 29.85 Topic 148 15.00 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic 136 49.24 Topic 149 7.81 Topic Number Topic 137 6.63 Topic 150 58.61 Topic 138 6.05 CLEF 2005 DS−Monolingual−EN − Comparison to median by topic (topics 139 to 150) 1 BK2GMLEE2 Difference (average precision) 0.5 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number A.383 berkeley-2 BK2GMLEE3 DS-Monolingual-EN Overall statistics for 25 queries : General info: Total number of documents over all queries Track= Domain Specific Monolingual English Retrieved 25,000 RunType= automatic Relevant 2,105 QueryType= TD Relevant retrieved 1,847 Pooled= true CLEF 2005 DS−Monolingual−EN − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 89.71 BK2GMLEE3 90% 10 79.37 20 70.73 80% 30 62.30 70% 40 53.79 50 48.09 Average Precision 60% 60 41.15 50% 70 32.38 80 26.54 40% 90 16.15 30% 100 2.93 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 46.97 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 DS−Monolingual−EN − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 75.20 BK2GMLEE3 90% 10 docs 71.60 15 docs 68.27 80% 20 docs 66.00 70% 30 docs 60.53 100 docs 40.84 60% R−Precision 200 docs 26.66 50% 500 docs 13.38 1000 docs 7.39 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 46.33 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 DS−Monolingual−EN − Comparison to median by topic (topics 126 to 138) queries 1 BK2GMLEE3 Topic 126 46.90 Topic 139 56.83 Difference (average precision) Topic 127 38.96 Topic 140 68.20 0.5 Topic 128 73.46 Topic 141 77.94 Topic 129 8.14 Topic 142 64.72 Topic 130 57.04 Topic 143 25.55 0 Topic 131 59.05 Topic 144 38.69 Topic 132 84.02 Topic 145 59.59 −0.5 Topic 133 0.57 Topic 146 83.99 Topic 134 28.42 Topic 147 76.03 Topic 135 48.13 Topic 148 20.47 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic 136 58.58 Topic 149 15.92 Topic Number Topic 137 8.63 Topic 150 47.58 Topic 138 26.79 CLEF 2005 DS−Monolingual−EN − Comparison to median by topic (topics 139 to 150) 1 BK2GMLEE3 Difference (average precision) 0.5 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number A.384 irit CWNSE_T DS-Monolingual-EN Overall statistics for 24 queries : General info: Total number of documents over all queries Track= Domain Specific Monolingual English Retrieved 22,781 RunType= automatic Relevant 1,956 QueryType= T Relevant retrieved 1,234 Pooled= true CLEF 2005 DS−Monolingual−EN − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 81.10 CWNSET 90% 10 62.58 20 51.28 80% 30 41.92 70% 40 33.06 50 28.03 Average Precision 60% 60 25.16 50% 70 21.50 80 16.84 40% 90 10.46 30% 100 2.33 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 32.51 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 DS−Monolingual−EN − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 64.00 CWNSET 90% 10 docs 60.80 15 docs 57.87 80% 20 docs 55.20 70% 30 docs 50.00 100 docs 28.56 60% R−Precision 200 docs 17.80 50% 500 docs 8.44 1000 docs 4.94 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 32.60 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 DS−Monolingual−EN − Comparison to median by topic (topics 126 to 138) queries 1 CWNSET Topic 126 0.43 Topic 139 16.87 Difference (average precision) Topic 127 25.64 Topic 140 54.40 0.5 Topic 128 68.90 Topic 141 86.29 Topic 129 7.77 Topic 142 75.44 Topic 130 47.10 Topic 143 20.02 0 Topic 131 41.04 Topic 144 54.82 Topic 132 0.00 Topic 145 34.12 −0.5 Topic 133 1.99 Topic 146 74.75 Topic 134 9.99 Topic 147 63.10 Topic 135 16.32 Topic 148 9.61 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic 136 58.48 Topic 149 5.91 Topic Number Topic 137 22.79 Topic 150 11.91 Topic 138 5.16 CLEF 2005 DS−Monolingual−EN − Comparison to median by topic (topics 139 to 150) 1 CWNSE T Difference (average precision) 0.5 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number A.385 irit CWNSE_TD DS-Monolingual-EN Overall statistics for 24 queries : General info: Total number of documents over all queries Track= Domain Specific Monolingual English Retrieved 24,000 RunType= automatic Relevant 1,956 QueryType= TD Relevant retrieved 1,458 Pooled= true CLEF 2005 DS−Monolingual−EN − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 76.89 CWNSETD 90% 10 57.04 20 51.41 80% 30 43.63 70% 40 36.00 50 30.28 Average Precision 60% 60 25.58 50% 70 22.76 80 18.11 40% 90 7.83 30% 100 0.37 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 32.35 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 DS−Monolingual−EN − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 57.60 CWNSETD 90% 10 docs 52.00 15 docs 49.87 80% 20 docs 48.60 70% 30 docs 46.13 100 docs 29.80 60% R−Precision 200 docs 20.18 50% 500 docs 10.38 1000 docs 5.83 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 34.03 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 DS−Monolingual−EN − Comparison to median by topic (topics 126 to 138) queries 1 CWNSETD Topic 126 36.09 Topic 139 15.15 Difference (average precision) Topic 127 34.66 Topic 140 44.59 0.5 Topic 128 72.64 Topic 141 85.96 Topic 129 5.62 Topic 142 6.42 Topic 130 47.32 Topic 143 19.39 0 Topic 131 38.59 Topic 144 50.99 Topic 132 0.00 Topic 145 61.79 −0.5 Topic 133 7.98 Topic 146 82.88 Topic 134 44.46 Topic 147 60.58 Topic 135 11.81 Topic 148 3.49 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic 136 12.06 Topic 149 5.20 Topic Number Topic 137 21.91 Topic 150 34.83 Topic 138 4.44 CLEF 2005 DS−Monolingual−EN − Comparison to median by topic (topics 139 to 150) 1 CWNSE D T Difference (average precision) 0.5 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number A.386 irit CWN_T DS-Monolingual-EN Overall statistics for 24 queries : General info: Total number of documents over all queries Track= Domain Specific Monolingual English Retrieved 22,726 RunType= automatic Relevant 1,956 QueryType= T Relevant retrieved 1,276 Pooled= true CLEF 2005 DS−Monolingual−EN − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 81.48 CWNT 90% 10 64.65 20 53.40 80% 30 45.20 70% 40 33.71 50 29.43 Average Precision 60% 60 26.94 50% 70 22.21 80 18.71 40% 90 13.87 30% 100 0.34 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 34.11 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 DS−Monolingual−EN − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 66.40 CWNT 90% 10 docs 62.00 15 docs 59.73 80% 20 docs 57.60 70% 30 docs 52.13 100 docs 28.92 60% R−Precision 200 docs 18.32 50% 500 docs 8.79 1000 docs 5.10 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 35.06 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 DS−Monolingual−EN − Comparison to median by topic (topics 126 to 138) queries 1 CWNT Topic 126 0.43 Topic 139 45.53 Difference (average precision) Topic 127 25.64 Topic 140 54.40 0.5 Topic 128 68.90 Topic 141 85.41 Topic 129 4.29 Topic 142 75.44 Topic 130 47.10 Topic 143 20.02 0 Topic 131 33.08 Topic 144 46.97 Topic 132 0.00 Topic 145 38.51 −0.5 Topic 133 1.99 Topic 146 88.67 Topic 134 7.83 Topic 147 68.42 Topic 135 16.64 Topic 148 9.61 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic 136 69.62 Topic 149 4.30 Topic Number Topic 137 22.79 Topic 150 11.91 Topic 138 5.18 CLEF 2005 DS−Monolingual−EN − Comparison to median by topic (topics 139 to 150) 1 CWN T Difference (average precision) 0.5 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number A.387 irit CWN_TD DS-Monolingual-EN Overall statistics for 24 queries : General info: Total number of documents over all queries Track= Domain Specific Monolingual English Retrieved 24,000 RunType= automatic Relevant 1,956 QueryType= TD Relevant retrieved 1,486 Pooled= true CLEF 2005 DS−Monolingual−EN − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 74.63 CWNTD 90% 10 57.06 20 51.07 80% 30 43.42 70% 40 34.98 50 29.55 Average Precision 60% 60 24.95 50% 70 21.95 80 18.03 40% 90 11.58 30% 100 0.52 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 32.23 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 DS−Monolingual−EN − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 55.20 CWNTD 90% 10 docs 53.60 15 docs 52.80 80% 20 docs 50.40 70% 30 docs 47.73 100 docs 29.76 60% R−Precision 200 docs 20.68 50% 500 docs 10.58 1000 docs 5.94 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 33.53 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 DS−Monolingual−EN − Comparison to median by topic (topics 126 to 138) queries 1 CWNTD Topic 126 44.47 Topic 139 15.19 Difference (average precision) Topic 127 40.59 Topic 140 41.75 0.5 Topic 128 72.64 Topic 141 85.89 Topic 129 1.02 Topic 142 6.42 Topic 130 52.33 Topic 143 19.39 0 Topic 131 33.77 Topic 144 21.86 Topic 132 0.00 Topic 145 61.90 −0.5 Topic 133 2.58 Topic 146 88.89 Topic 134 32.15 Topic 147 57.72 Topic 135 3.94 Topic 148 3.66 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic 136 55.94 Topic 149 5.46 Topic Number Topic 137 21.52 Topic 150 32.57 Topic 138 4.01 CLEF 2005 DS−Monolingual−EN − Comparison to median by topic (topics 139 to 150) 1 CWN D T Difference (average precision) 0.5 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number A.388 irit C_T DS-Monolingual-EN Overall statistics for 24 queries : General info: Total number of documents over all queries Track= Domain Specific Monolingual English Retrieved 22,715 RunType= automatic Relevant 1,956 QueryType= T Relevant retrieved 1,231 Pooled= true CLEF 2005 DS−Monolingual−EN − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 87.17 CT 90% 10 65.98 20 54.36 80% 30 43.78 70% 40 32.11 50 29.40 Average Precision 60% 60 27.02 50% 70 21.87 80 17.79 40% 90 12.44 30% 100 0.29 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 34.11 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 DS−Monolingual−EN − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 69.60 CT 90% 10 docs 64.80 15 docs 61.33 80% 20 docs 57.60 70% 30 docs 52.93 100 docs 28.52 60% R−Precision 200 docs 18.24 50% 500 docs 8.82 1000 docs 4.92 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 36.19 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 DS−Monolingual−EN − Comparison to median by topic (topics 126 to 138) queries 1 CT Topic 126 11.32 Topic 139 46.24 Difference (average precision) Topic 127 14.17 Topic 140 57.21 0.5 Topic 128 69.28 Topic 141 69.99 Topic 129 3.44 Topic 142 79.79 Topic 130 45.71 Topic 143 41.28 0 Topic 131 33.12 Topic 144 46.87 Topic 132 0.00 Topic 145 29.01 −0.5 Topic 133 1.55 Topic 146 88.67 Topic 134 7.50 Topic 147 68.47 Topic 135 19.04 Topic 148 9.05 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic 136 69.99 Topic 149 3.08 Topic Number Topic 137 22.94 Topic 150 10.66 Topic 138 4.35 CLEF 2005 DS−Monolingual−EN − Comparison to median by topic (topics 139 to 150) 1 C T Difference (average precision) 0.5 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number A.389 msu-nivc cirGIRTen2en DS-Monolingual-EN Overall statistics for 25 queries : General info: Total number of documents over all queries Track= Domain Specific Monolingual English Retrieved 24,136 RunType= automatic Relevant 2,105 QueryType= TDN Relevant retrieved 1,076 Pooled= true CLEF 2005 DS−Monolingual−EN − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 68.14 cirGIRTen2en 90% 10 49.46 20 43.43 80% 30 37.36 70% 40 34.94 50 31.69 Average Precision 60% 60 29.25 50% 70 26.82 80 15.34 40% 90 2.52 30% 100 0.00 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 29.03 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 DS−Monolingual−EN − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 49.60 cirGIRTen2en 90% 10 docs 47.20 15 docs 44.53 80% 20 docs 44.40 70% 30 docs 39.33 100 docs 24.76 60% R−Precision 200 docs 15.62 50% 500 docs 7.73 1000 docs 4.30 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 33.49 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 DS−Monolingual−EN − Comparison to median by topic (topics 126 to 138) queries 1 cirGIRTen2en Topic 126 4.08 Topic 139 11.55 Difference (average precision) Topic 127 41.37 Topic 140 59.86 0.5 Topic 128 0.16 Topic 141 84.12 Topic 129 0.17 Topic 142 65.22 Topic 130 37.38 Topic 143 32.07 0 Topic 131 2.20 Topic 144 33.83 Topic 132 76.68 Topic 145 3.96 −0.5 Topic 133 25.19 Topic 146 75.00 Topic 134 4.28 Topic 147 42.95 Topic 135 9.86 Topic 148 9.78 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic 136 20.55 Topic 149 69.91 Topic Number Topic 137 0.22 Topic 150 2.72 Topic 138 12.56 CLEF 2005 DS−Monolingual−EN − Comparison to median by topic (topics 139 to 150) 1 cirGIRTen2en Difference (average precision) 0.5 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number A.390 u.glasgow glaentd DS-Monolingual-EN Overall statistics for 25 queries : General info: Total number of documents over all queries Track= Domain Specific Monolingual English Retrieved 25,000 RunType= automatic Relevant 2,105 QueryType= TD Relevant retrieved 1,668 Pooled= true CLEF 2005 DS−Monolingual−EN − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 86.37 glaentd 90% 10 68.96 20 56.04 80% 30 42.30 70% 40 37.32 50 31.86 Average Precision 60% 60 27.12 50% 70 22.02 80 18.12 40% 90 11.90 30% 100 1.31 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 34.84 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 DS−Monolingual−EN − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 68.80 glaentd 90% 10 docs 61.20 15 docs 55.47 80% 20 docs 52.80 70% 30 docs 48.53 100 docs 32.76 60% R−Precision 200 docs 22.98 50% 500 docs 11.95 1000 docs 6.67 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 36.98 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 DS−Monolingual−EN − Comparison to median by topic (topics 126 to 138) queries 1 glaentd Topic 126 30.33 Topic 139 9.60 Difference (average precision) Topic 127 49.27 Topic 140 50.91 0.5 Topic 128 72.59 Topic 141 40.93 Topic 129 0.43 Topic 142 30.04 Topic 130 64.40 Topic 143 35.75 0 Topic 131 20.81 Topic 144 31.41 Topic 132 85.47 Topic 145 34.46 −0.5 Topic 133 12.13 Topic 146 69.34 Topic 134 35.34 Topic 147 53.49 Topic 135 11.32 Topic 148 9.87 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic 136 55.58 Topic 149 4.81 Topic Number Topic 137 16.98 Topic 150 33.93 Topic 138 11.78 CLEF 2005 DS−Monolingual−EN − Comparison to median by topic (topics 139 to 150) 1 glaentd Difference (average precision) 0.5 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number A.391 u.glasgow glaentdnqe DS-Monolingual-EN Overall statistics for 25 queries : General info: Total number of documents over all queries Track= Domain Specific Monolingual English Retrieved 25,000 RunType= automatic Relevant 2,105 QueryType= TDN Relevant retrieved 1,840 Pooled= true CLEF 2005 DS−Monolingual−EN − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 89.58 glaentdnqe 90% 10 71.20 20 61.68 80% 30 53.64 70% 40 46.43 50 40.64 Average Precision 60% 60 35.28 50% 70 30.31 80 24.30 40% 90 15.61 30% 100 2.88 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 41.71 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 DS−Monolingual−EN − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 69.60 glaentdnqe 90% 10 docs 63.20 15 docs 60.00 80% 20 docs 57.40 70% 30 docs 53.07 100 docs 37.40 60% R−Precision 200 docs 25.94 50% 500 docs 13.30 1000 docs 7.36 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 42.11 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 DS−Monolingual−EN − Comparison to median by topic (topics 126 to 138) queries 1 glaentdnqe Topic 126 23.13 Topic 139 18.13 Difference (average precision) Topic 127 52.29 Topic 140 55.89 0.5 Topic 128 81.44 Topic 141 68.76 Topic 129 0.66 Topic 142 28.33 Topic 130 62.27 Topic 143 36.89 0 Topic 131 60.14 Topic 144 31.40 Topic 132 91.44 Topic 145 50.67 −0.5 Topic 133 11.76 Topic 146 90.08 Topic 134 45.61 Topic 147 55.61 Topic 135 6.67 Topic 148 11.93 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic 136 49.54 Topic 149 4.48 Topic Number Topic 137 23.96 Topic 150 54.77 Topic 138 26.93 CLEF 2005 DS−Monolingual−EN − Comparison to median by topic (topics 139 to 150) 1 glaentdnqe Difference (average precision) 0.5 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number A.392 unine UniNEgen1 DS-Monolingual-EN Overall statistics for 25 queries : General info: Total number of documents over all queries Track= Domain Specific Monolingual English Retrieved 25,000 RunType= automatic Relevant 2,105 QueryType= TD Relevant retrieved 1,958 Pooled= true CLEF 2005 DS−Monolingual−EN − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 87.96 UniNEgen1 90% 10 76.87 20 70.29 80% 30 64.52 70% 40 58.85 50 52.64 Average Precision 60% 60 46.66 50% 70 40.82 80 31.94 40% 90 24.83 30% 100 5.28 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 50.65 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 DS−Monolingual−EN − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 76.00 UniNEgen1 90% 10 docs 69.60 15 docs 68.00 80% 20 docs 65.20 70% 30 docs 62.00 100 docs 43.44 60% R−Precision 200 docs 28.72 50% 500 docs 14.27 1000 docs 7.83 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 49.15 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 DS−Monolingual−EN − Comparison to median by topic (topics 126 to 138) queries 1 UniNEgen1 Topic 126 47.24 Topic 139 34.79 Difference (average precision) Topic 127 50.01 Topic 140 48.86 0.5 Topic 128 77.92 Topic 141 82.42 Topic 129 0.56 Topic 142 60.35 Topic 130 62.22 Topic 143 39.89 0 Topic 131 72.37 Topic 144 56.25 Topic 132 93.40 Topic 145 62.34 −0.5 Topic 133 1.39 Topic 146 92.89 Topic 134 49.03 Topic 147 67.07 Topic 135 16.88 Topic 148 14.69 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic 136 55.32 Topic 149 4.86 Topic Number Topic 137 74.42 Topic 150 71.08 Topic 138 30.03 CLEF 2005 DS−Monolingual−EN − Comparison to median by topic (topics 139 to 150) 1 UniNEgen1 Difference (average precision) 0.5 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number A.393 unine UniNEgen2 DS-Monolingual-EN Overall statistics for 25 queries : General info: Total number of documents over all queries Track= Domain Specific Monolingual English Retrieved 25,000 RunType= automatic Relevant 2,105 QueryType= TD Relevant retrieved 1,955 Pooled= true CLEF 2005 DS−Monolingual−EN − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 86.93 UniNEgen2 90% 10 76.02 20 69.90 80% 30 64.76 70% 40 57.82 50 51.89 Average Precision 60% 60 46.69 50% 70 41.25 80 32.54 40% 90 24.33 30% 100 6.69 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 50.43 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 DS−Monolingual−EN − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 75.20 UniNEgen2 90% 10 docs 70.40 15 docs 67.73 80% 20 docs 65.40 70% 30 docs 61.87 100 docs 42.88 60% R−Precision 200 docs 28.86 50% 500 docs 14.39 1000 docs 7.82 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 48.77 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 DS−Monolingual−EN − Comparison to median by topic (topics 126 to 138) queries 1 UniNEgen2 Topic 126 47.29 Topic 139 34.15 Difference (average precision) Topic 127 49.81 Topic 140 49.42 0.5 Topic 128 76.96 Topic 141 77.96 Topic 129 0.55 Topic 142 62.05 Topic 130 66.75 Topic 143 39.86 0 Topic 131 76.00 Topic 144 52.24 Topic 132 93.12 Topic 145 63.20 −0.5 Topic 133 0.36 Topic 146 92.71 Topic 134 48.95 Topic 147 64.74 Topic 135 21.28 Topic 148 13.96 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic 136 48.89 Topic 149 5.13 Topic Number Topic 137 73.92 Topic 150 69.45 Topic 138 32.01 CLEF 2005 DS−Monolingual−EN − Comparison to median by topic (topics 139 to 150) 1 UniNEgen2 Difference (average precision) 0.5 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number A.394 unine UniNEgen3 DS-Monolingual-EN Overall statistics for 25 queries : General info: Total number of documents over all queries Track= Domain Specific Monolingual English Retrieved 25,000 RunType= automatic Relevant 2,105 QueryType= TD Relevant retrieved 1,892 Pooled= true CLEF 2005 DS−Monolingual−EN − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 87.21 UniNEgen3 90% 10 71.63 20 61.47 80% 30 56.65 70% 40 52.04 50 45.90 Average Precision 60% 60 40.75 50% 70 33.39 80 26.27 40% 90 18.08 30% 100 4.53 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 44.19 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 DS−Monolingual−EN − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 72.00 UniNEgen3 90% 10 docs 63.60 15 docs 61.33 80% 20 docs 59.20 70% 30 docs 55.73 100 docs 38.84 60% R−Precision 200 docs 26.24 50% 500 docs 13.34 1000 docs 7.57 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 43.61 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 DS−Monolingual−EN − Comparison to median by topic (topics 126 to 138) queries 1 UniNEgen3 Topic 126 44.85 Topic 139 19.14 Difference (average precision) Topic 127 41.64 Topic 140 44.95 0.5 Topic 128 63.64 Topic 141 79.91 Topic 129 0.32 Topic 142 53.97 Topic 130 46.54 Topic 143 38.09 0 Topic 131 64.81 Topic 144 48.60 Topic 132 89.44 Topic 145 48.21 −0.5 Topic 133 4.08 Topic 146 89.94 Topic 134 32.31 Topic 147 60.35 Topic 135 11.25 Topic 148 14.74 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic 136 40.29 Topic 149 6.05 Topic Number Topic 137 70.83 Topic 150 59.62 Topic 138 31.26 CLEF 2005 DS−Monolingual−EN − Comparison to median by topic (topics 139 to 150) 1 UniNEgen3 Difference (average precision) 0.5 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number A.395 berkeley BERK1MLRU01 DS-Monolingual-RU Overall statistics for 25 queries : General info: Total number of documents over all queries Track= Domain Specific Monolingual Russian Retrieved 23,450 RunType= automatic Relevant 831 QueryType= TD Relevant retrieved 702 Pooled= true CLEF 2005 DS−Monolingual−RU − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 57.64 BERK1MLRU01 90% 10 47.18 20 35.28 80% 30 31.54 70% 40 28.07 50 24.37 Average Precision 60% 60 19.35 50% 70 15.41 80 12.40 40% 90 7.24 30% 100 4.54 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 24.09 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 DS−Monolingual−RU − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 35.20 BERK1MLRU01 90% 10 docs 33.60 15 docs 30.13 80% 20 docs 27.60 70% 30 docs 23.60 100 docs 15.32 60% R−Precision 200 docs 10.88 50% 500 docs 5.34 1000 docs 2.81 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 24.71 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 DS−Monolingual−RU − Comparison to median by topic (topics 126 to 138) queries 1 BERK1MLRU01 Topic 126 37.19 Topic 139 43.40 Difference (average precision) Topic 127 79.28 Topic 140 2.95 0.5 Topic 128 24.42 Topic 141 5.39 Topic 129 4.65 Topic 142 17.06 Topic 130 12.27 Topic 143 100.00 0 Topic 131 3.12 Topic 144 0.87 Topic 132 12.50 Topic 145 62.82 −0.5 Topic 133 17.91 Topic 146 3.03 Topic 134 8.25 Topic 147 0.00 Topic 135 38.78 Topic 148 18.92 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic 136 34.87 Topic 149 1.68 Topic Number Topic 137 20.22 Topic 150 0.00 Topic 138 52.69 CLEF 2005 DS−Monolingual−RU − Comparison to median by topic (topics 139 to 150) 1 BERK1MLRU01 Difference (average precision) 0.5 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number A.396 berkeley-2 BK2GMLRU1 DS-Monolingual-RU Overall statistics for 25 queries : General info: Total number of documents over all queries Track= Domain Specific Monolingual Russian Retrieved 25,000 RunType= automatic Relevant 831 QueryType= TD Relevant retrieved 726 Pooled= true CLEF 2005 DS−Monolingual−RU − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 67.76 BK2GMLRU1 90% 10 54.84 20 44.44 80% 30 35.30 70% 40 30.59 50 27.70 Average Precision 60% 60 24.91 50% 70 23.54 80 20.50 40% 90 16.20 30% 100 9.08 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 30.38 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 DS−Monolingual−RU − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 37.60 BK2GMLRU1 90% 10 docs 34.00 15 docs 30.13 80% 20 docs 28.60 70% 30 docs 24.80 100 docs 16.80 60% R−Precision 200 docs 11.34 50% 500 docs 5.51 1000 docs 2.90 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 29.42 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 DS−Monolingual−RU − Comparison to median by topic (topics 126 to 138) queries 1 BK2GMLRU1 Topic 126 54.37 Topic 139 39.66 Difference (average precision) Topic 127 90.36 Topic 140 2.92 0.5 Topic 128 27.83 Topic 141 5.39 Topic 129 5.96 Topic 142 37.31 Topic 130 8.01 Topic 143 100.00 0 Topic 131 100.00 Topic 144 0.56 Topic 132 12.50 Topic 145 53.35 −0.5 Topic 133 17.16 Topic 146 0.40 Topic 134 10.24 Topic 147 0.00 Topic 135 14.19 Topic 148 24.05 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic 136 58.50 Topic 149 20.66 Topic Number Topic 137 28.70 Topic 150 0.00 Topic 138 47.27 CLEF 2005 DS−Monolingual−RU − Comparison to median by topic (topics 139 to 150) 1 BK2GMLRU1 Difference (average precision) 0.5 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number A.397 berkeley-2 BK2GMLRU2 DS-Monolingual-RU Overall statistics for 25 queries : General info: Total number of documents over all queries Track= Domain Specific Monolingual Russian Retrieved 25,000 RunType= automatic Relevant 831 QueryType= TDN Relevant retrieved 730 Pooled= true CLEF 2005 DS−Monolingual−RU − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 58.11 BK2GMLRU2 90% 10 45.66 20 33.90 80% 30 30.06 70% 40 27.67 50 24.30 Average Precision 60% 60 18.37 50% 70 15.50 80 12.19 40% 90 8.42 30% 100 2.67 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 23.49 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 DS−Monolingual−RU − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 35.20 BK2GMLRU2 90% 10 docs 30.80 15 docs 27.73 80% 20 docs 26.00 70% 30 docs 23.87 100 docs 15.08 60% R−Precision 200 docs 10.66 50% 500 docs 5.30 1000 docs 2.92 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 24.41 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 DS−Monolingual−RU − Comparison to median by topic (topics 126 to 138) queries 1 BK2GMLRU2 Topic 126 20.83 Topic 139 42.23 Difference (average precision) Topic 127 87.89 Topic 140 3.42 0.5 Topic 128 19.73 Topic 141 28.47 Topic 129 0.95 Topic 142 24.39 Topic 130 2.60 Topic 143 45.00 0 Topic 131 50.89 Topic 144 0.91 Topic 132 3.12 Topic 145 20.58 −0.5 Topic 133 11.52 Topic 146 0.91 Topic 134 9.59 Topic 147 12.50 Topic 135 53.40 Topic 148 35.87 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic 136 43.24 Topic 149 17.34 Topic Number Topic 137 18.55 Topic 150 0.00 Topic 138 33.37 CLEF 2005 DS−Monolingual−RU − Comparison to median by topic (topics 139 to 150) 1 BK2GMLRU2 Difference (average precision) 0.5 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number A.398 msu-nivc cirRSSCru2ru DS-Monolingual-RU Overall statistics for 25 queries : General info: Total number of documents over all queries Track= Domain Specific Monolingual Russian Retrieved 8,688 RunType= automatic Relevant 831 QueryType= TDN Relevant retrieved 98 Pooled= true CLEF 2005 DS−Monolingual−RU − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 23.05 cirRSSCru2ru 90% 10 8.50 20 0.60 80% 30 0.60 70% 40 0.17 50 0.17 Average Precision 60% 60 0.00 50% 70 0.00 80 0.00 40% 90 0.00 30% 100 0.00 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 2.09 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 DS−Monolingual−RU − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 14.40 cirRSSCru2ru 90% 10 docs 13.60 15 docs 12.53 80% 20 docs 11.00 70% 30 docs 9.87 100 docs 3.44 60% R−Precision 200 docs 1.78 50% 500 docs 0.74 1000 docs 0.39 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 3.74 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 DS−Monolingual−RU − Comparison to median by topic (topics 126 to 138) queries 1 cirRSSCru2ru Topic 126 0.75 Topic 139 7.42 Difference (average precision) Topic 127 10.38 Topic 140 0.72 0.5 Topic 128 0.59 Topic 141 0.00 Topic 129 0.00 Topic 142 6.80 Topic 130 3.70 Topic 143 0.00 0 Topic 131 0.00 Topic 144 1.94 Topic 132 0.00 Topic 145 12.02 −0.5 Topic 133 0.00 Topic 146 0.00 Topic 134 0.67 Topic 147 0.00 Topic 135 0.01 Topic 148 0.00 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic 136 4.84 Topic 149 0.00 Topic Number Topic 137 0.00 Topic 150 0.00 Topic 138 2.41 CLEF 2005 DS−Monolingual−RU − Comparison to median by topic (topics 139 to 150) 1 cirRSSCru2ru Difference (average precision) 0.5 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number A.399 u.glasgow glarutdqe DS-Monolingual-RU Overall statistics for 25 queries : General info: Total number of documents over all queries Track= Domain Specific Monolingual Russian Retrieved 25,000 RunType= automatic Relevant 831 QueryType= TD Relevant retrieved 368 Pooled= true CLEF 2005 DS−Monolingual−RU − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 16.54 glarutdqe 90% 10 13.53 20 10.00 80% 30 8.91 70% 40 7.87 50 6.36 Average Precision 60% 60 3.11 50% 70 1.87 80 0.00 40% 90 0.00 30% 100 0.00 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 5.53 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 DS−Monolingual−RU − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 9.60 glarutdqe 90% 10 docs 9.20 15 docs 8.00 80% 20 docs 8.00 70% 30 docs 7.73 100 docs 7.04 60% R−Precision 200 docs 4.68 50% 500 docs 2.50 1000 docs 1.47 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 6.89 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 DS−Monolingual−RU − Comparison to median by topic (topics 126 to 138) queries 1 glarutdqe Topic 126 2.63 Topic 139 2.54 Difference (average precision) Topic 127 64.23 Topic 140 5.03 0.5 Topic 128 20.44 Topic 141 3.74 Topic 129 0.31 Topic 142 10.76 Topic 130 0.01 Topic 143 8.33 0 Topic 131 0.10 Topic 144 0.43 Topic 132 0.89 Topic 145 0.87 −0.5 Topic 133 0.16 Topic 146 0.00 Topic 134 0.18 Topic 147 0.00 Topic 135 12.92 Topic 148 0.45 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic 136 0.50 Topic 149 0.77 Topic Number Topic 137 0.43 Topic 150 0.00 Topic 138 2.60 CLEF 2005 DS−Monolingual−RU − Comparison to median by topic (topics 139 to 150) 1 glarutdqe Difference (average precision) 0.5 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number A.400 unine UniNEgru1 DS-Monolingual-RU Overall statistics for 25 queries : General info: Total number of documents over all queries Track= Domain Specific Monolingual Russian Retrieved 25,000 RunType= automatic Relevant 831 QueryType= TD Relevant retrieved 737 Pooled= true CLEF 2005 DS−Monolingual−RU − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 44.77 UniNEgru1 90% 10 41.90 20 38.77 80% 30 34.83 70% 40 30.85 50 28.26 Average Precision 60% 60 22.43 50% 70 17.73 80 13.24 40% 90 5.60 30% 100 0.71 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 24.91 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 DS−Monolingual−RU − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 36.80 UniNEgru1 90% 10 docs 33.20 15 docs 33.87 80% 20 docs 31.80 70% 30 docs 30.53 100 docs 19.08 60% R−Precision 200 docs 11.26 50% 500 docs 5.72 1000 docs 2.95 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 23.29 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 DS−Monolingual−RU − Comparison to median by topic (topics 126 to 138) queries 1 UniNEgru1 Topic 126 19.24 Topic 139 61.60 Difference (average precision) Topic 127 84.33 Topic 140 4.22 0.5 Topic 128 67.74 Topic 141 2.66 Topic 129 3.07 Topic 142 76.26 Topic 130 0.20 Topic 143 7.20 0 Topic 131 0.00 Topic 144 1.65 Topic 132 2.27 Topic 145 63.02 −0.5 Topic 133 1.01 Topic 146 4.35 Topic 134 38.25 Topic 147 0.00 Topic 135 15.08 Topic 148 37.87 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic 136 65.76 Topic 149 1.01 Topic Number Topic 137 14.02 Topic 150 0.00 Topic 138 52.03 CLEF 2005 DS−Monolingual−RU − Comparison to median by topic (topics 139 to 150) 1 UniNEgru1 Difference (average precision) 0.5 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number A.401 unine UniNEgru2 DS-Monolingual-RU Overall statistics for 25 queries : General info: Total number of documents over all queries Track= Domain Specific Monolingual Russian Retrieved 25,000 RunType= automatic Relevant 831 QueryType= TD Relevant retrieved 703 Pooled= true CLEF 2005 DS−Monolingual−RU − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 59.15 UniNEgru2 90% 10 50.56 20 41.29 80% 30 36.29 70% 40 31.79 50 27.28 Average Precision 60% 60 23.74 50% 70 19.36 80 14.82 40% 90 8.15 30% 100 4.54 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 27.74 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 DS−Monolingual−RU − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 40.80 UniNEgru2 90% 10 docs 36.40 15 docs 34.13 80% 20 docs 31.80 70% 30 docs 28.40 100 docs 19.48 60% R−Precision 200 docs 11.60 50% 500 docs 5.39 1000 docs 2.81 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 28.32 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 DS−Monolingual−RU − Comparison to median by topic (topics 126 to 138) queries 1 UniNEgru2 Topic 126 41.73 Topic 139 58.44 Difference (average precision) Topic 127 81.57 Topic 140 4.66 0.5 Topic 128 52.86 Topic 141 5.33 Topic 129 4.96 Topic 142 43.43 Topic 130 0.26 Topic 143 100.00 0 Topic 131 0.00 Topic 144 4.02 Topic 132 6.25 Topic 145 65.53 −0.5 Topic 133 11.11 Topic 146 3.23 Topic 134 15.80 Topic 147 0.10 Topic 135 27.68 Topic 148 25.79 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic 136 69.05 Topic 149 1.14 Topic Number Topic 137 17.38 Topic 150 0.00 Topic 138 53.13 CLEF 2005 DS−Monolingual−RU − Comparison to median by topic (topics 139 to 150) 1 UniNEgru2 Difference (average precision) 0.5 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number A.402 unine UniNEgru3 DS-Monolingual-RU Overall statistics for 25 queries : General info: Total number of documents over all queries Track= Domain Specific Monolingual Russian Retrieved 25,000 RunType= automatic Relevant 831 QueryType= TD Relevant retrieved 739 Pooled= true CLEF 2005 DS−Monolingual−RU − Interpolated Recall vs Average Precision Interploated Recall (%) Precision Averages (%) 100% 0 43.63 UniNEgru3 90% 10 41.48 20 37.22 80% 30 33.93 70% 40 30.59 50 27.55 Average Precision 60% 60 22.66 50% 70 18.64 80 13.12 40% 90 6.36 30% 100 0.64 Average precision (non-interpolated) for all 20% relevant documents (averaged over queries) 10% 24.77 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Interpolated Recall CLEF 2005 DS−Monolingual−RU − Retrieved documents vs Precision Docs Cutoff Levels Precision at DCL (%) 100% 5 docs 36.80 UniNEgru3 90% 10 docs 32.80 15 docs 31.73 80% 20 docs 30.60 70% 30 docs 30.00 100 docs 19.20 60% R−Precision 200 docs 11.18 50% 500 docs 5.61 1000 docs 2.96 40% R-Precision (precision after R document retrieved, where R = Relevant retrieved) 30% 22.99 20% 10% 0% 5 10 15 20 30 100 200 500 1000 Retrieved Documents (logarithmic scale) Precision averages (%) for individual CLEF 2005 DS−Monolingual−RU − Comparison to median by topic (topics 126 to 138) queries 1 UniNEgru3 Topic 126 14.95 Topic 139 61.39 Difference (average precision) Topic 127 86.68 Topic 140 3.94 0.5 Topic 128 70.85 Topic 141 1.35 Topic 129 2.51 Topic 142 76.98 Topic 130 0.21 Topic 143 5.99 0 Topic 131 0.00 Topic 144 0.75 Topic 132 1.47 Topic 145 63.57 −0.5 Topic 133 0.70 Topic 146 3.45 Topic 134 39.17 Topic 147 0.25 Topic 135 10.60 Topic 148 39.39 −1 126 127 128 129 130 131 132 133 134 135 136 137 138 Topic 136 65.10 Topic 149 1.07 Topic Number Topic 137 22.16 Topic 150 0.00 Topic 138 46.76 CLEF 2005 DS−Monolingual−RU − Comparison to median by topic (topics 139 to 150) 1 UniNEgru3 Difference (average precision) 0.5 0 −0.5 −1 139 140 141 142 143 144 145 146 147 148 149 150 Topic Number A.403