Institution Country Run Tag Task Top. Lang. Top. Fld. Run Type Judged? Université de Neuchâtel Switzerland UniNEBpt1 Bi-PT EN TD Auto Y Université de Neuchâtel Switzerland UniNEBpt2 Bi-PT EN TD Auto Y Université de Neuchâtel Switzerland UniNEBru1 Bi-RU EN TD Auto Université de Neuchâtel Switzerland UniNEBru2 Bi-RU EN TD Auto Université de Neuchâtel Switzerland UniNEfi1 Mono FI TD Auto Y Université de Neuchâtel Switzerland UniNEfi2 Mono FI TD Auto Y Université de Neuchâtel Switzerland UniNEfi3 Mono FI TDN Auto Université de Neuchâtel Switzerland UniNEfr1 Mono FR TD Auto Université de Neuchâtel Switzerland UniNEfr2 Mono FR TD Auto Université de Neuchâtel Switzerland UniNEfr3 Mono FR TDN Auto Y Université de Neuchâtel Switzerland UniNEmulti1 Multi EN TD Auto Y Université de Neuchâtel Switzerland UniNEmulti2 Multi EN TD Auto Y Université de Neuchâtel Switzerland UniNEmulti3 Multi EN TD Auto Y Université de Neuchâtel Switzerland UniNEmulti4 Multi EN TD Auto Université de Neuchâtel Switzerland UniNEmulti5 Multi EN TD Auto Université de Neuchâtel Switzerland UniNEpt1 Mono PT TD Auto Y Université de Neuchâtel Switzerland UniNEpt2 Mono PT TD Auto Y Université de Neuchâtel Switzerland UniNEpt3 Mono PT TD Auto Université de Neuchâtel Switzerland UniNEru1 Mono RU TD Auto Université de Neuchâtel Switzerland UniNEru2 Mono RU TD Auto Université de Neuchâtel Switzerland UniNEru3 Mono RU TDN Auto Y Thomson Legal USA tlrde2fr1 Bi-FR DE TD Auto Y Thomson Legal USA tlrde2fr2 Bi-FR DE TD Auto Thomson Legal USA tlrde2fr3 Bi-FR DE TD Auto Thomson Legal USA tlrde2fr4 Bi-FR DE TD Auto Thomson Legal USA tlrfi1 Mono FI TD Auto Y Thomson Legal USA tlrfi2 Mono FI TD Auto Thomson Legal USA tlrpt1 Mono PT TD Auto Y Thomson Legal USA tlrpt2 Mono PT TD Auto Thomson Legal USA tlrru1 Mono RU TD Auto Y Thomson Legal USA tlrru2 Mono RU TD Auto SICS Sweden stockholmAmEnA Bi-EN AM TD Manual Y SICS Sweden stockholmAmEnI Bi-EN AM TD Manual Y SICS Sweden SICSsvfrQF Bi-FR SV TD Auto Y CEA/LIC2M France lic2men1 Multi EN TD Auto Y CEA/LIC2M France lic2men2 Multi EN TDN Auto CEA/LIC2M France lic2mfr1 Multi FR TDN Auto Y Universidad de Evora Portugal alentejo1 Mono PT T Auto Y Universidad de Evora Portugal alentejo2 Mono PT T Auto Y ILTG Canada ltrcbifren1 Bi-EN FR TDN Auto Y ILTG Canada ltrcbifren2 Bi-EN FR TDN Auto Y ILTG Canada ltrcbifren3 Bi-EN FR TDN Auto Y ILTG Canada ltrcbifren4 Bi-EN FR TDN Auto Y ILTG Canada ltrcbifren5 Bi-EN FR TDN Auto Y ILTG Canada ltrcmonofr1 Mono FR TDN Auto ILTG Canada ltrcmonofr2 Mono FR TDN Auto ILTG Canada ltrcmonofr3 Mono FR TDN Auto Y ILTG Canada ltrcmonofr4 Mono FR TDN Auto U Jaen/SINAI Spain UJAMLRL Multi EN TD Auto U Jaen/SINAI Spain UJAMLRL2P Multi EN TD Auto Y U Jaen/SINAI Spain UJAMLRL3P Multi EN TD Auto Y U Jaen/SINAI Spain UJAMLRLRP Multi EN TD Auto U Jaen/SINAI Spain UJAMLRSV2 Multi EN TD Auto Y CLIPS France CLIPS04ENFI1 Bi-FI EN TDN Auto Y CLIPS France CLIPS04ENRU1 Bi-RU EN TDN Auto CLIPS France CLIPS04ENRU2 Bi-RU EN TDN Auto CLIPS France CLIPS04FRFI1 Bi-FI FR TDN Auto Y CLIPS France CLIPS04FRRU1 Bi-RU FR TDN Auto CLIPS France CLIPS04FRRU2 Bi-RU FR TDN Auto CLIPS France CLIPS04MNFI1 Mono FI TDN Auto Y CLIPS France CLIPS04MNFR1 Mono FR TDN Auto Y CLIPS France CLIPS04MNRU1 Mono RU TDN Auto Y Hummingbird Canada humFI04t Mono FI T Auto Y Hummingbird Canada humFI04td Mono FI TD Auto Y Hummingbird Canada humFI04tde Mono FI TD Auto Hummingbird Canada humFR04t Mono FR T Auto Y Hummingbird Canada humFR04td Mono FR TD Auto Hummingbird Canada humFR04tde Mono FR TD Auto Hummingbird Canada humPT04t Mono PT T Auto Y Hummingbird Canada humPT04td Mono PT TD Auto Y Hummingbird Canada humPT04tde Mono PT TD Auto Institution Country Run Tag Task Top. Lang. Top. Fld. Run Type Judged? Hummingbird Canada humRU04t Mono RU T Auto Y Hummingbird Canada humRU04td Mono RU TD Auto Hummingbird Canada humRU04tde Mono RU TD Auto U Oviedo Spain uoviESEN Bi-EN ES TD Auto Y U Oviedo Spain uoviRU Mono RU TD Auto Y U Amsterdam Netherlands UAmsC04AmEn4GiSb Bi-EN AM TD Auto Y U Amsterdam Netherlands UAmsC04AmEnAll Bi-EN AM TD Auto Y U Amsterdam Netherlands UAmsC04AmEnWrd Bi-EN AM TD Auto Y U Amsterdam Netherlands UAmsC04EnMu3Way Multi EN TD Auto Y U Amsterdam Netherlands UAmsC04EnMu4Gr Multi EN TD Auto Y U Amsterdam Netherlands UAmsC04EnMuAll Multi EN TD Auto Y U Amsterdam Netherlands UAmsC04EnMuAll2 Multi EN TD Auto U Amsterdam Netherlands UAmsC04EnMuWSLM Multi EN TD Auto U Amsterdam Netherlands UAmsC04EnPo4GiSb Bi-PT EN TD Auto Y U Amsterdam Netherlands UAmsC04EnPo4iSPC Bi-PT EN TD Auto Y U Amsterdam Netherlands UAmsC04EnPo4iSWL Bi-PT EN TD Auto U Amsterdam Netherlands UAmsC04EnPoAll Bi-PT EN TD Auto Y U Amsterdam Netherlands UAmsC04FiFi4GiSb Mono FI TD Auto Y U Amsterdam Netherlands UAmsC04FiFi4GiWd Mono FI TD Auto U Amsterdam Netherlands UAmsC04FiFiAll Mono FI TD Auto U Amsterdam Netherlands UAmsC04FrFr4GiSb Mono FR TD Auto Y U Amsterdam Netherlands UAmsC04FrFr4GiWd Mono FR TD Auto U Amsterdam Netherlands UAmsC04FrFrAll Mono FR TD Auto U Amsterdam Netherlands UAmsC04PoPo4GiSb Mono PT TD Auto Y U Amsterdam Netherlands UAmsC04PoPo4GiWd Mono PT TD Auto Y U Amsterdam Netherlands UAmsC04PoPoAll Mono PT TD Auto U Amsterdam Netherlands UAmsC04RuRu4GiSb Mono RU TD Auto Y U Amsterdam Netherlands UAmsC04RuRu4GiWd Mono RU TD Auto U Amsterdam Netherlands UAmsC04RuRuAll Mono RU TD Auto FU Hagen Germany FUHdm GIRT-DE DE TD Auto Y FU Hagen Germany FUHdrw GIRT-DE DE TD Auto Y FU Hagen Germany FUHds1 GIRT-DE DE TD Auto Y FU Hagen Germany FUHdw1 GIRT-DE DE TD Auto Y FU Hagen Germany FUHdw2 GIRT-DE DE TD Auto Y FU Hagen Germany FUHe1 GIRT-EN DE TD Auto Y FU Hagen Germany FUHe2 GIRT-EN DE TD Auto Y FU Hagen Germany FUHe3 GIRT-EN DE TD Auto Y FU Hagen Germany FUHe4 GIRT-EN DE TD Auto Y FU Hagen Germany FUHe5 GIRT-EN DE TD Auto Y Daedalus Spain de2frR2FWnormal Bi-FR DE TD Auto Daedalus Spain de2frR3FWnormal Bi-FR DE TD Auto Y Daedalus Spain de2frcomb1s101 Bi-FR DE TD Auto Daedalus Spain de2frcomb2s201 Bi-FR DE TD Auto Daedalus Spain frav7 Mono FR TD Auto Y Daedalus Spain frav8 Mono FR TD Auto Daedalus Spain frcomb1s201 Mono FR TD Auto Daedalus Spain frcomb2s201 Mono FR TD Auto Daedalus Spain nl2frR4FWnormal Bi-FR NL TD Auto Y Daedalus Spain nl2frR5FWnormal Bi-FR NL TD Auto Daedalus Spain nl2frav Bi-FR NL TD Auto Daedalus Spain nl2frcomb1s101 Bi-FR NL TD Auto Daedalus Spain ruR1FWnormal Mono RU TD Auto Y Daedalus Spain ruav7 Mono RU TD Auto Daedalus Spain ruav8 Mono RU TD Auto Y Daedalus Spain rucomb1s101 Mono RU TD Auto U Padua Italy IMSBDEFRN100 Bi-FR DE TD Auto U Padua Italy IMSBDEFRN50 Bi-FR DE TD Auto U Padua Italy IMSBDEFRP100 Bi-FR DE TD Auto U Padua Italy IMSBDEFRP50 Bi-FR DE TD Auto U Padua Italy IMSBDEFRUd651 Bi-FR DE TD Auto U Padua Italy IMSBDEFRUd655 Bi-FR DE TD Auto Y U Padua Italy IMSMFIN Mono FI TD Auto U Padua Italy IMSMFIP Mono FI TD Auto U Padua Italy IMSMFIPqe Mono FI TD Auto U Padua Italy IMSMFIUa65 Mono FI TD Auto Y U Padua Italy IMSMFIUd65 Mono FI TD Auto Y U Padua Italy IMSMFRN Mono FR TD Auto U Padua Italy IMSMFRP Mono FR TD Auto U Padua Italy IMSMFRPqe Mono FR TD Auto U Padua Italy IMSMFRUd65 Mono FR TD Auto Y U Padua Italy IMSMRUN Mono RU TD Auto Y Institution Country Run Tag Task Top. Lang. Top. Fld. Run Type Judged? U Padua Italy IMSMRUUd65 Mono RU TD Auto U Padua Italy IMSMRUUd65qe Mono RU TD Auto U Alicante Spain IRn-MR-Dexp Mono RU TD Auto Y U Alicante Spain IRn-MR-Pexp Mono RU TD Auto U Alicante Spain IRn-MR-nexp Mono RU TD Auto U Alicante Spain IRn-BEnR-Dexp Bi-RU EN TD Auto U Alicante Spain IRn-BEnR-nexp Bi-RU EN TD Auto U Alicante Spain IRn-BEsR-Dexp Bi-RU ES TD Auto U Alicante Spain IRn-BEsR-nexp Bi-RU ES TD Auto U Alicante Spain IRn-BEnPM-Pexp Bi-PT EN TD Auto Y U Alicante Spain IRn-BEnPF-Pexp Bi-PT EN TD Auto Y U Alicante Spain IRn-BEnPM-nexp Bi-PT EN TD Auto Y U Alicante Spain IRn-BEnPF-nexp Bi-PT EN TD Auto Y U Alicante Spain IRn-BEsPM-Pexp Bi-PT ES TD Auto U Alicante Spain IRn-BEsPM-nexp Bi-PT ES TD Auto U Alicante Spain IRn-MP-Pexp Mono PT TD Auto Y U Alicante Spain IRn-MP-Dexp Mono PT TD Auto Y U Alicante Spain IRn-MF-Dexp Mono FI TD Auto Y U Alicante Spain IRn-MF-Pexp Mono FI TD Auto U Alicante Spain IRn-MF-nexp Mono FI TD Auto U Alicante Spain IRn-MFr-Dexp Mono FR TD Auto Y U Alicante Spain IRn-MFr-Pexp Mono FR TD Auto U Alicante Spain IRn-MFr-nexp Mono FR TD Auto U Alicante Spain IRn-Mu-Pexp Multi EN TD Auto Y U Alicante Spain IRn-Mu-Dexp Multi EN TD Auto Y U Alicante Spain IRn-Mu-nexp Multi EN TD Auto U Alicante Spain IRn-MP-nexp Mono PT TD Auto Y NII Group Japan NiiDic03 Bi-FR DE TD Auto NII Group Japan NiiDic04 Bi-FR DE TD Auto NII Group Japan NiiDic05 Bi-FR DE TD Auto NII Group Japan NiiFF01 Mono FR TD Auto Y NII Group Japan NiiMt02 Bi-FR DE TD Auto Y U Hildesheim Germany UHIenru1 Bi-RU EN TD Auto U Hildesheim Germany UHIenru2 Bi-RU EN TD Auto U Hildesheim Germany UHIenru3 Bi-RU EN TD Auto U Hildesheim Germany UHIfi1 Mono FI TD Auto Y U Hildesheim Germany UHIfi2 Mono FI TD Auto Y U Hildesheim Germany UHImlt1 Multi EN TD Auto Y U Hildesheim Germany UHImlt2 Multi EN TD Auto Y U Hildesheim Germany UHIru1 Mono RU TD Auto Y U Hildesheim Germany UHIru2 Mono RU TD Auto U Hildesheim Germany UHIru3 Mono RU TD Auto FCUL Lisbon Portugal XLDBTumba01 Mono PT missing Manual Y FCUL Lisbon Portugal XLDBTumba02 Mono PT missing Manual Y FCUL Lisbon Portugal XLDBTumba04 Mono PT missing Manual FCUL Lisbon Portugal XLDBTumba05 Mono PT missing Manual IRIT France run1T GIRT-EN EN T Auto Y IRIT France run2TD GIRT-EN EN TD Auto Y IRIT France run3TDfc GIRT-EN EN TD Auto Y IRIT France run4TDWN GIRT-EN EN TD Auto Y IRIT France run4TWN GIRT-EN EN T Auto Y UC Berkeley USA BKGRBLEG1 GIRT-DE EN TD Auto Y UC Berkeley USA BKGRBLEG2 GIRT-DE EN TD Auto Y UC Berkeley USA BKGRBLEG3 GIRT-DE EN TD Auto Y UC Berkeley USA BKGRBLEG4 GIRT-DE EN TD Auto Y UC Berkeley USA BKGRBLEG5 GIRT-DE EN TD Auto Y UC Berkeley USA BKGRBLGE1 GIRT-EN DE TD Auto Y UC Berkeley USA BKGRBLGE2 GIRT-EN DE TD Auto Y UC Berkeley USA BKGRBLGE3 GIRT-EN DE TD Auto Y UC Berkeley USA BKGRBLGE4 GIRT-EN DE TD Auto Y UC Berkeley USA BKGRBLGE5 GIRT-EN DE TD Auto Y UC Berkeley USA BKGRMLEE1 GIRT-EN EN TD Auto Y UC Berkeley USA BKGRMLEE2 GIRT-EN EN TD Auto Y UC Berkeley USA BKGRMLGG0 GIRT-DE DE TD Auto Y UC Berkeley USA BKGRMLGG1 GIRT-DE DE TD Auto Y UC Berkeley USA BKGRMLGG2 GIRT-DE DE TD Auto Y UC Berkeley USA BKRUBLER1 Bi-RU EN TDN Auto UC Berkeley USA BKRUBLER2 Bi-RU EN TDN Auto UC Berkeley USA BKRUBLER3 Bi-RU EN TD Auto UC Berkeley USA BKRUBLER4 Bi-RU EN TDN Auto Y UC Berkeley USA BKRUBLJR1 Bi-RU JP TD Auto Institution Country Run Tag Task Top. Lang. Top. Fld. Run Type Judged? UC Berkeley USA BKRUBLJR2 Bi-RU JP TDN Auto UC Berkeley USA BKRUBLCR1 Bi-RU ZH TD Auto UC Berkeley USA BKRUBLCR2 Bi-RU ZH TDN Auto UC Berkeley USA BKRUMLRR1 Mono RU TD Auto UC Berkeley USA BKRUMLRR2 Mono RU TDN Auto Y Dublin City University Ireland exefinmono04a Mono FI TD Auto Y Dublin City University Ireland exefinmono04l Mono FI TD Auto Y Dublin City University Ireland exefinmono04q Mono FI TD Auto Y Dublin City University Ireland exefinmono04t Mono FI TD Auto Dublin City University Ireland exefrde04a Bi-FR DE TD Auto Dublin City University Ireland exefrde04q Bi-FR DE TD Auto Y Dublin City University Ireland exefrde04t Bi-FR DE TD Auto Dublin City University Ireland exefrmono04a Mono FR TD Auto Dublin City University Ireland exefrmono04q Mono FR TD Auto Y Dublin City University Ireland exefrmono04t Mono FR TD Auto Dublin City University Ireland exefrmonosys04a Mono FR TD Auto Dublin City University Ireland exefrnl04a Bi-FR NL TD Auto Dublin City University Ireland exefrnl04t Bi-FR NL TD Auto Dublin City University Ireland exemult1s Multi EN TD Auto Y Dublin City University Ireland exemult2s Multi EN TD Auto Y Dublin City University Ireland exemult3s Multi EN TD Auto Y Dublin City University Ireland exemult4s Multi EN TD Auto Dublin City University Ireland exemult5s Multi EN TD Auto Dublin City University Ireland exerussbi04a Bi-RU EN TD Auto Y Dublin City University Ireland exerussbi04l Bi-RU EN TD Auto Dublin City University Ireland exerussbi04q Bi-RU EN TD Auto Dublin City University Ireland exerussbi04t Bi-RU EN TD Auto Dublin City University Ireland exerussmono04a Mono RU TD Auto Y Dublin City University Ireland exerussmono04l Mono RU TD Auto Dublin City University Ireland exerussmono04q Mono RU TD Auto Dublin City University Ireland exerussmono04t1 Mono RU TD Auto Dublin City University Ireland exerussbi04amg Bi-RU EN TD Auto Ricoh Japan rdedetde04 GIRT-DE DE TD Auto Y Ricoh Japan rendetde04 GIRT-DE EN TD Auto Y SUNY Buffalo USA UBmonoEN01 Mono EN TD Auto Y SUNY Buffalo USA UBmonoFI01 Mono FI TD Auto Y SUNY Buffalo USA UBmonoFR01 Mono FR TD Auto Y SUNY Buffalo USA UBmonoRU01 Mono RU TD Auto Y SUNY Buffalo USA UBmult01 Multi EN TD Auto Y SUNY Buffalo USA UBmult02 Multi EN TD Auto Y SUNY Buffalo USA UBmulti03 Multi EN TD Auto JHU/APL USA aplbibgrub Bi-RU BG TD Auto Y JHU/APL USA aplbidefra Bi-FR DE TD Auto Y JHU/APL USA aplbienpta Bi-PT EN TD Auto Y JHU/APL USA aplbiesfia Bi-FI ES TD Auto Y JHU/APL USA aplbiespta Bi-PT ES TD Auto Y JHU/APL USA aplbiesptb Bi-PT ES TD Auto Y JHU/APL USA aplbifrfia Bi-FI FR TD Auto JHU/APL USA aplbinlfra Bi-FR NL TD Auto Y JHU/APL USA aplmofia Mono FI TD Auto Y JHU/APL USA aplmofib Mono FI TD Auto JHU/APL USA aplmofic Mono FI TD Auto JHU/APL USA aplmofra Mono FR TD Auto Y JHU/APL USA aplmofrb Mono FR TD Auto JHU/APL USA aplmofrc Mono FR TD Auto JHU/APL USA aplmopta Mono PT TD Auto Y JHU/APL USA aplmoptb Mono PT TD Auto Y JHU/APL USA aplmoptc Mono PT TD Auto JHU/APL USA aplmorua Mono RU TD Auto Y JHU/APL USA aplmorub Mono RU TD Auto JHU/APL USA aplmoruc Mono RU TD Auto U Chicago USA UCEMULT2 Multi EN T Auto Y U Chicago USA UCEMULTD1 Multi EN TD Auto Y U Chicago USA UCEMULdecT3 Multi EN T Auto U Chicago USA UCEMULlppT4 Multi EN T Auto U Chicago USA UCERBiT1 Bi-RU EN T Auto Y U Glasgow UK UOGLQ Mono FR TDN Auto U Glasgow UK UOGLQQE Mono FR TDN Auto Y U Glasgow UK UOGSQ Mono FR T Auto U Glasgow UK UOGSQQE Mono FR T Auto Multilingual; Recall−Precision Graph Top performing experiments by the best five groups; TD topic fields; Automatic 1.0 0.3427 U Amsterdam 0.3341 U Jaen/SINAI 0.8 0.3090 U Neuchâtel 0.2748 SUNY Buffalo 0.2745 Dublin City U 0.6 Precision 0.4 0.2 0.0 0.0 0.2 0.4 0.6 0.8 1.0 Recall Bilingual to EN; Recall−Precision Graph Top performing experiments by the best five groups; TD topic fields; Automatic 1.0   0.3470 U Amsterdam 0.0644 U Oviedo 0.8 0.6 Precision 0.4 0.2 0.0 0.0 0.2 0.4 0.6 0.8 1.0 Recall Bilingual to FI; Recall−Precision Graph Top performing experiments by the best five groups; TD topic fields; Automatic 1.0  0.2982 JHU/APL 0.8 0.6 Precision 0.4 0.2 0.0 0.0 0.2 0.4 0.6 0.8 1.0 Recall Bilingual to FR; Recall−Precision Graph Top performing experiments by the best five groups; TD topic fields; Automatic 1.0 0.3753 JHU/APL 0.3750 Thomson Legal 0.8 0.3505 Daedalus 0.3368 NII Group 0.3339 Dublin City U 0.6 Precision 0.4 0.2 0.0 0.0 0.2 0.4 0.6 0.8 1.0 Recall Bilingual to PT; Recall−Precision Graph Top performing experiments by the best five groups; TD topic fields; Automatic 1.0   0.4704 U Neuchâtel  0.4537 JHU/APL 0.8  0.4366 U Amsterdam 0.3243 U Alicante 0.6 Precision 0.4 0.2 0.0 0.0 0.2 0.4 0.6 0.8 1.0 Recall Bilingual to RU; Recall−Precision Graph Top performing experiments by the best five groups; TD topic fields; Automatic 1.0 0.3357 U Alicante 0.3291 UC Berkeley 0.8 0.3210 Dublin City U 0.3007 U Neuchâtel 0.1407 JHU/APL 0.6 Precision 0.4 0.2 0.0 0.0 0.2 0.4 0.6 0.8 1.0 Recall Monolingual EN; Recall−Precision Graph Top performing experiments by the best five groups; TD topic fields; Automatic 1.0  0.5167 SUNY Buffalo 0.8 0.6 Precision 0.4 0.2 0.0 0.0 0.2 0.4 0.6 0.8 1.0 Recall Monolingual FI; Recall−Precision Graph Top performing experiments by the best five groups; TD topic fields; Automatic 1.0 0.6367 Hummingbird 0.5562 Thomson Legal 0.8 0.5453 U Neuchâtel 0.5443 JHU/APL 0.5203 U Amsterdam 0.6 Precision 0.4 0.2 0.0 0.0 0.2 0.4 0.6 0.8 1.0 Recall Monolingual FR; Recall−Precision Graph Top performing experiments by the best five groups; TD topic fields; Automatic 1.0 0.4926 Hummingbird 0.4849 U Neuchâtel 0.8 0.4673 Daedalus 0.4629 SUNY Buffalo 0.4581 JHU/APL 0.6 Precision 0.4 0.2 0.0 0.0 0.2 0.4 0.6 0.8 1.0 Recall Monolingual PT; Recall−Precision Graph Top performing experiments by the best five groups; TD topic fields; Automatic 1.0 0.5188 U Neuchâtel 0.4750 Hummingbird 0.8 0.4691 JHU/APL 0.4469 Thomson Legal 0.4326 U Amsterdam 0.6 Precision 0.4 0.2 0.0 0.0 0.2 0.4 0.6 0.8 1.0 Recall Monolingual RU; Recall−Precision Graph Top performing experiments by the best five groups; TD topic fields; Automatic 1.0 0.4809 U Alicante 0.4431 Hummingbird 0.8 0.4412 U Amsterdam 0.4204 UC Berkeley 0.3790 Dublin City U 0.6 Precision 0.4 0.2 0.0 0.0 0.2 0.4 0.6 0.8 1.0 Recall GIRT to DE; Recall−Precision Graph Top performing experiments by the best five groups; TD topic fields; Automatic 1.0  0.4177 UC Berkeley  0.2482 FU Hagen  0.8 0.2381 Ricoh 0.6 Precision 0.4 0.2 0.0 0.0 0.2 0.4 0.6 0.8 1.0 Recall GIRT to EN; Recall−Precision Graph Top performing experiments by the best five groups; TD topic fields; Automatic 1.0  0.4053 UC Berkeley   0.3855 IRIT 0.8 0.0369 FU Hagen 0.6 Precision 0.4 0.2 0.0 0.0 0.2 0.4 0.6 0.8 1.0 Recall Dublin City University, Multilingual English, Auto, TD Run exemult1s Average precision Overall statistics Recall−Precision Values (individual queries): (for 50 queries): 1.0 Query 201: 0.0168 Total number of documents Query 202: 0.6188 over all queries Query 203: 0.2400 Retrieved: 50000 Query 204: 0.3655 Relevant: 1826 Query 205: 0.2451 Rel_ret: 1244 0.8 Query 206: 0.4209 Query 207: 0.1509 Interpolated Recall - Query 208: 0.3036 Precision Averages: Query 209: 0.0644 at 0.00 0.5587 Query 210: 0.1058 at 0.10 0.4829 0.6 Query 211: 0.8375 at 0.20 0.4151 Query 212: 0.1212 at 0.30 0.3570 Query 213: 0.5757 at 0.40 0.2961 Precision Query 214: 0.0001 at 0.50 0.2474 Query 215: 0.0314 at 0.60 0.2115 0.4 Query 216: 0.0030 at 0.70 0.1790 Query 217: 0.2025 at 0.80 0.1360 Query 218: 0.8338 at 0.90 0.0971 Query 219: 0.0063 at 1.00 0.0290 Query 220: 0.0344 0.2 Query 221: 0.4257 Avg. prec. (non-interpolated) Query 222: 0.0263 for all rel. documents Query 223: 0.0907 0.2626 Query 224: 0.8160 Precision: Query 225: 0.5328 At 5 docs: 0.3880 0.0 Query 226: 0.0054 At 10 docs: 0.3540 0.0 0.2 0.4 0.6 0.8 1.0 Query 227: 0.0094 At 15 docs: 0.3160 Query 228: 0.2341 At 20 docs: 0.3020 Recall Query 229: 0.3706 At 30 docs: 0.2580 Query 230: 0.6629 At 100 docs: 0.1572 Query 231: 0.1193 At 200 docs: 0.0987 Run exemult1s Query 232: 0.0179 At 500 docs: 0.0464 Comparison to median by topic Query 233: 0.4403 At 1000 docs: 0.0249 Query 234: 0.0183 +1.0 Query 235: 0.0045 R-Precision (prec. after R Query 236: 0.2464 (=num_rel) docs. retrieved): Query 237: 0.5349 Exact: 0.2747 Query 238: 0.3109 Query 239: 0.0474 Query 240: 0.8048 +0.5 Query 241: 0.0124 Query 242: 0.1766 Query 243: 0.2872 Query 244: 0.3472 Query 245: 0.6897 Query 246: 0.0858 Query 247: 0.2498 0.0 Query 248: 0.3241 Query 249: 0.0162 Query 250: 0.0425 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Dublin City University, Multilingual English, Auto, TD Run exemult2s Average precision Overall statistics Recall−Precision Values (individual queries): (for 50 queries): 1.0 Query 201: 0.0389 Total number of documents Query 202: 0.6315 over all queries Query 203: 0.0258 Retrieved: 50000 Query 204: 0.2331 Relevant: 1826 Query 205: 0.2408 Rel_ret: 1119 0.8 Query 206: 0.5065 Query 207: 0.0915 Interpolated Recall - Query 208: 0.2007 Precision Averages: Query 209: 0.0644 at 0.00 0.5510 Query 210: 0.1035 at 0.10 0.4363 0.6 Query 211: 0.7854 at 0.20 0.3703 Query 212: 0.1190 at 0.30 0.3252 Query 213: 0.5328 at 0.40 0.2659 Precision Query 214: 0.0002 at 0.50 0.2439 Query 215: 0.0227 at 0.60 0.2217 0.4 Query 216: 0.0246 at 0.70 0.1866 Query 217: 0.1477 at 0.80 0.1453 Query 218: 0.6926 at 0.90 0.1023 Query 219: 0.0037 at 1.00 0.0438 Query 220: 0.0005 0.2 Query 221: 0.6059 Avg. prec. (non-interpolated) Query 222: 0.0263 for all rel. documents Query 223: 0.0867 0.2479 Query 224: 0.8039 Precision: Query 225: 0.5447 At 5 docs: 0.3600 0.0 Query 226: 0.0069 At 10 docs: 0.3300 0.0 0.2 0.4 0.6 0.8 1.0 Query 227: 0.0094 At 15 docs: 0.3107 Query 228: 0.0008 At 20 docs: 0.2920 Recall Query 229: 0.0132 At 30 docs: 0.2540 Query 230: 0.5924 At 100 docs: 0.1478 Query 231: 0.1155 At 200 docs: 0.0894 Run exemult2s Query 232: 0.0159 At 500 docs: 0.0413 Comparison to median by topic Query 233: 0.3669 At 1000 docs: 0.0224 Query 234: 0.1750 +1.0 Query 235: 0.0045 R-Precision (prec. after R Query 236: 0.7253 (=num_rel) docs. retrieved): Query 237: 0.5624 Exact: 0.2786 Query 238: 0.3764 Query 239: 0.0221 Query 240: 0.8510 +0.5 Query 241: 0.0136 Query 242: 0.1002 Query 243: 0.2701 Query 244: 0.3430 Query 245: 0.5299 Query 246: 0.1103 Query 247: 0.2793 0.0 Query 248: 0.3674 Query 249: 0.0088 Query 250: 0.0000 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Dublin City University, Multilingual English, Auto, TD Run exemult3s Average precision Overall statistics Recall−Precision Values (individual queries): (for 50 queries): 1.0 Query 201: 0.0397 Total number of documents Query 202: 0.6374 over all queries Query 203: 0.0656 Retrieved: 50000 Query 204: 0.6372 Relevant: 1826 Query 205: 0.2313 Rel_ret: 1232 0.8 Query 206: 0.4287 Query 207: 0.1551 Interpolated Recall - Query 208: 0.2473 Precision Averages: Query 209: 0.1066 at 0.00 0.6192 Query 210: 0.1024 at 0.10 0.4659 0.6 Query 211: 0.7800 at 0.20 0.4110 Query 212: 0.0759 at 0.30 0.3579 Query 213: 0.5223 at 0.40 0.2868 Precision Query 214: 0.0009 at 0.50 0.2677 Query 215: 0.0227 at 0.60 0.2363 0.4 Query 216: 0.0326 at 0.70 0.2075 Query 217: 0.1477 at 0.80 0.1602 Query 218: 0.6035 at 0.90 0.1190 Query 219: 0.0038 at 1.00 0.0459 Query 220: 0.0006 0.2 Query 221: 0.6569 Avg. prec. (non-interpolated) Query 222: 0.0178 for all rel. documents Query 223: 0.0885 0.2715 Query 224: 0.7901 Precision: Query 225: 0.5449 At 5 docs: 0.3720 0.0 Query 226: 0.0068 At 10 docs: 0.3500 0.0 0.2 0.4 0.6 0.8 1.0 Query 227: 0.0094 At 15 docs: 0.3280 Query 228: 0.0475 At 20 docs: 0.3160 Recall Query 229: 0.0388 At 30 docs: 0.2667 Query 230: 0.5496 At 100 docs: 0.1542 Query 231: 0.2023 At 200 docs: 0.0967 Run exemult3s Query 232: 0.0445 At 500 docs: 0.0460 Comparison to median by topic Query 233: 0.4629 At 1000 docs: 0.0246 Query 234: 0.2281 +1.0 Query 235: 0.0016 R-Precision (prec. after R Query 236: 0.7983 (=num_rel) docs. retrieved): Query 237: 0.5536 Exact: 0.2846 Query 238: 0.4027 Query 239: 0.0398 Query 240: 0.8643 +0.5 Query 241: 0.0152 Query 242: 0.1056 Query 243: 0.2418 Query 244: 0.3476 Query 245: 0.7625 Query 246: 0.0998 Query 247: 0.4108 0.0 Query 248: 0.3828 Query 249: 0.0188 Query 250: 0.0000 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Dublin City University, Multilingual English, Auto, TD Run exemult4s Average precision Overall statistics Recall−Precision Values (individual queries): (for 50 queries): 1.0 Query 201: 0.0397 Total number of documents Query 202: 0.6388 over all queries Query 203: 0.0671 Retrieved: 50000 Query 204: 0.5573 Relevant: 1826 Query 205: 0.2668 Rel_ret: 1244 0.8 Query 206: 0.3837 Query 207: 0.0033 Interpolated Recall - Query 208: 0.2699 Precision Averages: Query 209: 0.1136 at 0.00 0.6117 Query 210: 0.1037 at 0.10 0.4712 0.6 Query 211: 0.7851 at 0.20 0.3996 Query 212: 0.1154 at 0.30 0.3500 Query 213: 0.5111 at 0.40 0.2946 Precision Query 214: 0.0016 at 0.50 0.2730 Query 215: 0.0202 at 0.60 0.2378 0.4 Query 216: 0.0479 at 0.70 0.2049 Query 217: 0.1104 at 0.80 0.1586 Query 218: 0.6587 at 0.90 0.1157 Query 219: 0.0063 at 1.00 0.0442 Query 220: 0.0003 0.2 Query 221: 0.6777 Avg. prec. (non-interpolated) Query 222: 0.0372 for all rel. documents Query 223: 0.0845 0.2725 Query 224: 0.7686 Precision: Query 225: 0.5465 At 5 docs: 0.3800 0.0 Query 226: 0.0081 At 10 docs: 0.3520 0.0 0.2 0.4 0.6 0.8 1.0 Query 227: 0.0094 At 15 docs: 0.3267 Query 228: 0.0916 At 20 docs: 0.3060 Recall Query 229: 0.0342 At 30 docs: 0.2633 Query 230: 0.5432 At 100 docs: 0.1546 Query 231: 0.1234 At 200 docs: 0.0973 Run exemult4s Query 232: 0.0311 At 500 docs: 0.0457 Comparison to median by topic Query 233: 0.4552 At 1000 docs: 0.0249 Query 234: 0.2431 +1.0 Query 235: 0.0013 R-Precision (prec. after R Query 236: 0.7808 (=num_rel) docs. retrieved): Query 237: 0.6123 Exact: 0.2937 Query 238: 0.3304 Query 239: 0.0485 Query 240: 0.8520 +0.5 Query 241: 0.0160 Query 242: 0.1787 Query 243: 0.2287 Query 244: 0.3536 Query 245: 0.7939 Query 246: 0.1436 Query 247: 0.4594 0.0 Query 248: 0.3915 Query 249: 0.0783 Query 250: 0.0000 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Dublin City University, Multilingual English, Auto, TD Run exemult5s Average precision Overall statistics Recall−Precision Values (individual queries): (for 50 queries): 1.0 Query 201: 0.0495 Total number of documents Query 202: 0.6620 over all queries Query 203: 0.0657 Retrieved: 50000 Query 204: 0.6505 Relevant: 1826 Query 205: 0.2406 Rel_ret: 1216 0.8 Query 206: 0.4997 Query 207: 0.1571 Interpolated Recall - Query 208: 0.2749 Precision Averages: Query 209: 0.1032 at 0.00 0.5964 Query 210: 0.1085 at 0.10 0.4770 0.6 Query 211: 0.7785 at 0.20 0.3993 Query 212: 0.0717 at 0.30 0.3567 Query 213: 0.5326 at 0.40 0.2915 Precision Query 214: 0.0006 at 0.50 0.2732 Query 215: 0.0245 at 0.60 0.2468 0.4 Query 216: 0.0484 at 0.70 0.2153 Query 217: 0.1496 at 0.80 0.1639 Query 218: 0.6893 at 0.90 0.1271 Query 219: 0.0040 at 1.00 0.0520 Query 220: 0.0007 0.2 Query 221: 0.6689 Avg. prec. (non-interpolated) Query 222: 0.0139 for all rel. documents Query 223: 0.0907 0.2745 Query 224: 0.7678 Precision: Query 225: 0.5390 At 5 docs: 0.3640 0.0 Query 226: 0.0067 At 10 docs: 0.3560 0.0 0.2 0.4 0.6 0.8 1.0 Query 227: 0.0094 At 15 docs: 0.3307 Query 228: 0.0114 At 20 docs: 0.3150 Recall Query 229: 0.0190 At 30 docs: 0.2753 Query 230: 0.5848 At 100 docs: 0.1566 Query 231: 0.1948 At 200 docs: 0.0976 Run exemult5s Query 232: 0.0635 At 500 docs: 0.0458 Comparison to median by topic Query 233: 0.4645 At 1000 docs: 0.0243 Query 234: 0.1644 +1.0 Query 235: 0.0014 R-Precision (prec. after R Query 236: 0.7121 (=num_rel) docs. retrieved): Query 237: 0.5591 Exact: 0.2890 Query 238: 0.4019 Query 239: 0.0285 Query 240: 0.9038 +0.5 Query 241: 0.0133 Query 242: 0.0986 Query 243: 0.2635 Query 244: 0.3437 Query 245: 0.7542 Query 246: 0.0913 Query 247: 0.4304 0.0 Query 248: 0.3951 Query 249: 0.0191 Query 250: 0.0000 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Alicante, Multilingual English, Auto, TD Run IRn−Mu−Dexp Average precision Overall statistics (individual queries): (for 50 queries): Recall−Precision Values 1.0 Query 201: 0.0591 Total number of documents Query 202: 0.4645 over all queries Query 203: 0.5426 Retrieved: 50000 Query 204: 0.3881 Relevant: 1826 Query 205: 0.4279 Rel_ret: 1337 0.8 Query 206: 0.1440 Query 207: 0.1457 Interpolated Recall - Query 208: 0.1731 Precision Averages: Query 209: 0.0557 at 0.00 0.5581 Query 210: 0.1748 at 0.10 0.4167 0.6 Query 211: 0.7880 at 0.20 0.3395 Query 212: 0.0570 at 0.30 0.2885 Query 213: 0.4545 at 0.40 0.2525 Precision Query 214: 0.0463 at 0.50 0.2238 Query 215: 0.0555 at 0.60 0.2070 0.4 Query 216: 0.0433 at 0.70 0.1799 Query 217: 0.1386 at 0.80 0.1487 Query 218: 0.8496 at 0.90 0.1065 Query 219: 0.0451 at 1.00 0.0378 Query 220: 0.0018 0.2 Query 221: 0.4329 Avg. prec. (non-interpolated) Query 222: 0.0196 for all rel. documents Query 223: 0.0069 0.2330 Query 224: 0.6071 Precision: Query 225: 0.1090 At 5 docs: 0.3280 0.0 Query 226: 0.0232 At 10 docs: 0.3100 0.0 0.2 0.4 0.6 0.8 1.0 Query 227: 0.0010 At 15 docs: 0.3093 Query 228: 0.0953 At 20 docs: 0.2900 Recall Query 229: 0.1578 At 30 docs: 0.2620 Query 230: 0.5664 At 100 docs: 0.1600 Query 231: 0.2199 At 200 docs: 0.1025 Run IRn−Mu−Dexp Query 232: 0.0625 At 500 docs: 0.0494 Query 233: 0.2858 At 1000 docs: 0.0267 Comparison to median by topic Query 234: 0.0452 +1.0 Query 235: 0.0183 R-Precision (prec. after R Query 236: 0.4006 (=num_rel) docs. retrieved): Query 237: 0.7501 Exact: 0.2713 Query 238: 0.1847 Query 239: 0.0791 Query 240: 0.3450 +0.5 Query 241: 0.0550 Query 242: 0.2250 Query 243: 0.1056 Query 244: 0.1968 Query 245: 0.5942 Query 246: 0.0917 Query 247: 0.5116 0.0 Query 248: 0.3486 Query 249: 0.0249 Query 250: 0.0330 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Alicante, Multilingual English, Auto, TD Run IRn−Mu−nexp Average precision Overall statistics (individual queries): (for 50 queries): Recall−Precision Values 1.0 Query 201: 0.0235 Total number of documents Query 202: 0.4834 over all queries Query 203: 0.4645 Retrieved: 50000 Query 204: 0.3163 Relevant: 1826 Query 205: 0.5034 Rel_ret: 1252 0.8 Query 206: 0.2012 Query 207: 0.1368 Interpolated Recall - Query 208: 0.1729 Precision Averages: Query 209: 0.0831 at 0.00 0.5432 Query 210: 0.2733 at 0.10 0.4074 0.6 Query 211: 0.7863 at 0.20 0.3349 Query 212: 0.0273 at 0.30 0.2816 Query 213: 0.3419 at 0.40 0.2428 Precision Query 214: 0.0499 at 0.50 0.2148 Query 215: 0.0242 at 0.60 0.1836 0.4 Query 216: 0.0437 at 0.70 0.1607 Query 217: 0.1253 at 0.80 0.1276 Query 218: 0.8297 at 0.90 0.0774 Query 219: 0.0485 at 1.00 0.0321 Query 220: 0.0014 0.2 Query 221: 0.3583 Avg. prec. (non-interpolated) Query 222: 0.0059 for all rel. documents Query 223: 0.0085 0.2204 Query 224: 0.4897 Precision: Query 225: 0.1125 At 5 docs: 0.3400 0.0 Query 226: 0.0128 At 10 docs: 0.3120 0.0 0.2 0.4 0.6 0.8 1.0 Query 227: 0.0013 At 15 docs: 0.2867 Query 228: 0.0861 At 20 docs: 0.2710 Recall Query 229: 0.1824 At 30 docs: 0.2447 Query 230: 0.5356 At 100 docs: 0.1442 Query 231: 0.0882 At 200 docs: 0.0937 Run IRn−Mu−nexp Query 232: 0.0227 At 500 docs: 0.0457 Query 233: 0.2106 At 1000 docs: 0.0250 Comparison to median by topic Query 234: 0.0685 +1.0 Query 235: 0.0130 R-Precision (prec. after R Query 236: 0.1698 (=num_rel) docs. retrieved): Query 237: 0.7498 Exact: 0.2585 Query 238: 0.1611 Query 239: 0.0692 Query 240: 0.3485 +0.5 Query 241: 0.0398 Query 242: 0.1402 Query 243: 0.1108 Query 244: 0.2154 Query 245: 0.8301 Query 246: 0.1270 Query 247: 0.4779 0.0 Query 248: 0.3842 Query 249: 0.0180 Query 250: 0.0439 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Alicante, Multilingual English, Auto, TD Run IRn−Mu−Pexp Average precision Overall statistics (individual queries): (for 50 queries): Recall−Precision Values 1.0 Query 201: 0.0514 Total number of documents Query 202: 0.4645 over all queries Query 203: 0.5461 Retrieved: 50000 Query 204: 0.4044 Relevant: 1826 Query 205: 0.4242 Rel_ret: 1338 0.8 Query 206: 0.1451 Query 207: 0.1581 Interpolated Recall - Query 208: 0.1731 Precision Averages: Query 209: 0.0529 at 0.00 0.5408 Query 210: 0.1748 at 0.10 0.4138 0.6 Query 211: 0.7713 at 0.20 0.3399 Query 212: 0.0555 at 0.30 0.2971 Query 213: 0.4339 at 0.40 0.2611 Precision Query 214: 0.0412 at 0.50 0.2294 Query 215: 0.0514 at 0.60 0.2104 0.4 Query 216: 0.0518 at 0.70 0.1836 Query 217: 0.1388 at 0.80 0.1505 Query 218: 0.8363 at 0.90 0.1074 Query 219: 0.0456 at 1.00 0.0418 Query 220: 0.0017 0.2 Query 221: 0.4224 Avg. prec. (non-interpolated) Query 222: 0.0186 for all rel. documents Query 223: 0.0069 0.2353 Query 224: 0.5957 Precision: Query 225: 0.1371 At 5 docs: 0.3440 0.0 Query 226: 0.0202 At 10 docs: 0.3180 0.0 0.2 0.4 0.6 0.8 1.0 Query 227: 0.0009 At 15 docs: 0.3040 Query 228: 0.0856 At 20 docs: 0.2880 Recall Query 229: 0.1457 At 30 docs: 0.2633 Query 230: 0.5662 At 100 docs: 0.1574 Query 231: 0.2215 At 200 docs: 0.1021 Run IRn−Mu−Pexp Query 232: 0.0532 At 500 docs: 0.0492 Query 233: 0.2908 At 1000 docs: 0.0268 Comparison to median by topic Query 234: 0.0448 +1.0 Query 235: 0.0193 R-Precision (prec. after R Query 236: 0.4139 (=num_rel) docs. retrieved): Query 237: 0.7542 Exact: 0.2714 Query 238: 0.2099 Query 239: 0.0832 Query 240: 0.3594 +0.5 Query 241: 0.0465 Query 242: 0.2097 Query 243: 0.1057 Query 244: 0.1974 Query 245: 0.6017 Query 246: 0.1004 Query 247: 0.5989 0.0 Query 248: 0.3734 Query 249: 0.0263 Query 250: 0.0324 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number CEA/LIC2M, Multilingual English, Auto, TD Run lic2men1 Average precision Overall statistics Recall−Precision Values (individual queries): (for 50 queries): 1.0 Query 201: 0.0000 Total number of documents Query 202: 0.3181 over all queries Query 203: 0.0410 Retrieved: 50000 Query 204: 0.0309 Relevant: 1826 0.8 Query 205: 0.1282 Rel_ret: 736 Query 206: 0.2408 Query 207: 0.0077 Interpolated Recall - Query 208: 0.4000 Precision Averages: Query 209: 0.0004 at 0.00 0.5402 Query 210: 0.0567 at 0.10 0.3357 0.6 Query 211: 0.0356 at 0.20 0.2453 Query 212: 0.0214 at 0.30 0.1750 Query 213: 0.0507 at 0.40 0.1503 Precision Query 214: 0.0312 at 0.50 0.0923 Query 215: 0.0655 at 0.60 0.0597 0.4 Query 216: 0.1022 at 0.70 0.0418 Query 217: 0.0073 at 0.80 0.0216 Query 218: 0.2545 at 0.90 0.0048 Query 219: 0.0009 at 1.00 0.0000 Query 220: 0.0002 0.2 Query 221: 0.1192 Avg. prec. (non-interpolated) Query 222: 0.0032 for all rel. documents Query 223: 0.1131 0.1281 Query 224: 0.4957 Precision: Query 225: 0.0000 At 5 docs: 0.2880 0.0 Query 226: 0.0649 At 10 docs: 0.2320 0.0 0.2 0.4 0.6 0.8 1.0 Query 227: 0.0007 At 15 docs: 0.2080 Query 228: 0.1943 At 20 docs: 0.1790 Recall Query 229: 0.1342 At 30 docs: 0.1473 Query 230: 0.1631 At 100 docs: 0.0792 Query 231: 0.0229 At 200 docs: 0.0522 Run lic2men1 Query 232: 0.1379 At 500 docs: 0.0256 Comparison to median by topic Query 233: 0.3412 At 1000 docs: 0.0147 Query 234: 0.0018 +1.0 Query 235: 0.1095 R-Precision (prec. after R Query 236: 0.0296 (=num_rel) docs. retrieved): Query 237: 0.0799 Exact: 0.1669 Query 238: 0.1263 Query 239: 0.0363 Query 240: 0.4750 +0.5 Query 241: 0.0011 Query 242: 0.1083 Query 243: 0.2866 Query 244: 0.0000 Query 245: 0.5783 Query 246: 0.2185 0.0 Query 247: 0.5473 Query 248: 0.0514 Query 249: 0.1707 Query 250: 0.0024 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number CEA/LIC2M, Multilingual English, Auto, TDN Run lic2men2 Average precision Overall statistics Recall−Precision Values (individual queries): (for 50 queries): 1.0 Query 201: 0.0000 Total number of documents Query 202: 0.3310 over all queries Query 203: 0.1258 Retrieved: 50000 Query 204: 0.0826 Relevant: 1826 0.8 Query 205: 0.1310 Rel_ret: 777 Query 206: 0.1662 Query 207: 0.0379 Interpolated Recall - Query 208: 0.4000 Precision Averages: Query 209: 0.0004 at 0.00 0.5338 Query 210: 0.1046 at 0.10 0.3595 0.6 Query 211: 0.0366 at 0.20 0.2483 Query 212: 0.0364 at 0.30 0.1807 Query 213: 0.0415 at 0.40 0.1518 Precision Query 214: 0.0333 at 0.50 0.1182 Query 215: 0.0764 at 0.60 0.0925 0.4 Query 216: 0.0122 at 0.70 0.0548 Query 217: 0.0596 at 0.80 0.0129 Query 218: 0.5056 at 0.90 0.0061 Query 219: 0.0050 at 1.00 0.0061 Query 220: 0.0001 0.2 Query 221: 0.2497 Avg. prec. (non-interpolated) Query 222: 0.0116 for all rel. documents Query 223: 0.1406 0.1364 Query 224: 0.6217 Precision: Query 225: 0.0000 At 5 docs: 0.2920 0.0 Query 226: 0.0132 At 10 docs: 0.2220 0.0 0.2 0.4 0.6 0.8 1.0 Query 227: 0.0008 At 15 docs: 0.2040 Query 228: 0.1918 At 20 docs: 0.1810 Recall Query 229: 0.1247 At 30 docs: 0.1640 Query 230: 0.1476 At 100 docs: 0.0850 Query 231: 0.0229 At 200 docs: 0.0577 Run lic2men2 Query 232: 0.0741 At 500 docs: 0.0277 Comparison to median by topic Query 233: 0.3599 At 1000 docs: 0.0155 Query 234: 0.0023 +1.0 Query 235: 0.1102 R-Precision (prec. after R Query 236: 0.0363 (=num_rel) docs. retrieved): Query 237: 0.2500 Exact: 0.1683 Query 238: 0.1269 Query 239: 0.0396 Query 240: 0.6076 +0.5 Query 241: 0.0009 Query 242: 0.0531 Query 243: 0.1723 Query 244: 0.0018 Query 245: 0.5624 Query 246: 0.2135 0.0 Query 247: 0.2951 Query 248: 0.0455 Query 249: 0.1511 Query 250: 0.0073 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number CEA/LIC2M, Multilingual French, Auto, TDN Run lic2mfr1 Average precision Overall statistics Recall−Precision Values (individual queries): (for 50 queries): 1.0 Query 201: 0.0020 Total number of documents Query 202: 0.0450 over all queries Query 203: 0.0104 Retrieved: 50000 Query 204: 0.0121 Relevant: 1826 0.8 Query 205: 0.2232 Rel_ret: 753 Query 206: 0.3350 Query 207: 0.0080 Interpolated Recall - Query 208: 0.3660 Precision Averages: Query 209: 0.0697 at 0.00 0.4438 Query 210: 0.0838 at 0.10 0.3053 0.6 Query 211: 0.2546 at 0.20 0.2530 Query 212: 0.0322 at 0.30 0.1850 Query 213: 0.2814 at 0.40 0.1440 Precision Query 214: 0.0001 at 0.50 0.0970 Query 215: 0.0457 at 0.60 0.0734 0.4 Query 216: 0.0001 at 0.70 0.0500 Query 217: 0.0541 at 0.80 0.0237 Query 218: 0.5548 at 0.90 0.0030 Query 219: 0.0002 at 1.00 0.0005 Query 220: 0.0000 0.2 Query 221: 0.1491 Avg. prec. (non-interpolated) Query 222: 0.0271 for all rel. documents Query 223: 0.0045 0.1261 Query 224: 0.1445 Precision: Query 225: 0.0049 At 5 docs: 0.2600 0.0 Query 226: 0.0689 At 10 docs: 0.2360 0.0 0.2 0.4 0.6 0.8 1.0 Query 227: 0.0000 At 15 docs: 0.2120 Query 228: 0.0320 At 20 docs: 0.1970 Recall Query 229: 0.0587 At 30 docs: 0.1673 Query 230: 0.4579 At 100 docs: 0.0872 Query 231: 0.0281 At 200 docs: 0.0516 Run lic2mfr1 Query 232: 0.0181 At 500 docs: 0.0261 Comparison to median by topic Query 233: 0.3226 At 1000 docs: 0.0151 Query 234: 0.0000 +1.0 Query 235: 0.0125 R-Precision (prec. after R Query 236: 0.0475 (=num_rel) docs. retrieved): Query 237: 0.1608 Exact: 0.1657 Query 238: 0.1231 Query 239: 0.0245 Query 240: 0.2966 +0.5 Query 241: 0.0056 Query 242: 0.0028 Query 243: 0.3033 Query 244: 0.0000 Query 245: 0.5394 Query 246: 0.0032 0.0 Query 247: 0.6624 Query 248: 0.4099 Query 249: 0.0199 Query 250: 0.0008 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Amsterdam, Multilingual English, Auto, TD Run UAmsC04EnMu3Way Average precision Overall statistics (individual queries): (for 50 queries): Recall−Precision Values 1.0 Query 201: 0.0651 Total number of documents Query 202: 0.6218 over all queries Query 203: 0.6517 Retrieved: 50000 Query 204: 0.5185 Relevant: 1826 Query 205: 0.2820 Rel_ret: 1416 0.8 Query 206: 0.5162 Query 207: 0.2021 Interpolated Recall - Query 208: 0.4544 Precision Averages: Query 209: 0.0467 at 0.00 0.6937 Query 210: 0.0410 at 0.10 0.5393 0.6 Query 211: 0.8738 at 0.20 0.4859 Query 212: 0.1075 at 0.30 0.4342 Query 213: 0.6020 at 0.40 0.3696 Precision Query 214: 0.1661 at 0.50 0.3301 Query 215: 0.0942 at 0.60 0.2731 0.4 Query 216: 0.1245 at 0.70 0.2391 Query 217: 0.4342 at 0.80 0.2004 Query 218: 0.8479 at 0.90 0.1362 Query 219: 0.0074 at 1.00 0.0553 Query 220: 0.0296 0.2 Query 221: 0.6058 Avg. prec. (non-interpolated) Query 222: 0.0110 for all rel. documents Query 223: 0.0809 0.3258 Query 224: 0.6264 Precision: Query 225: 0.0886 At 5 docs: 0.4680 0.0 Query 226: 0.0482 At 10 docs: 0.4200 0.0 0.2 0.4 0.6 0.8 1.0 Query 227: 0.5000 At 15 docs: 0.3933 Query 228: 0.3613 At 20 docs: 0.3660 Recall Query 229: 0.2795 At 30 docs: 0.3147 Query 230: 0.6353 At 100 docs: 0.1878 Query 231: 0.4086 At 200 docs: 0.1163 Run UAmsC04EnMu3Way Query 232: 0.1375 At 500 docs: 0.0534 Query 233: 0.5002 At 1000 docs: 0.0283 Comparison to median by topic Query 234: 0.0812 +1.0 Query 235: 0.1428 R-Precision (prec. after R Query 236: 0.3780 (=num_rel) docs. retrieved): Query 237: 0.7234 Exact: 0.3393 Query 238: 0.3056 Query 239: 0.0848 Query 240: 0.8413 +0.5 Query 241: 0.0519 Query 242: 0.1627 Query 243: 0.2618 Query 244: 0.0680 Query 245: 0.7549 Query 246: 0.1113 Query 247: 0.8763 0.0 Query 248: 0.4066 Query 249: 0.0180 Query 250: 0.0516 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Amsterdam, Multilingual English, Auto, TD Run UAmsC04EnMu4Gr Average precision Overall statistics Recall−Precision Values (individual queries): (for 50 queries): 1.0 Query 201: 0.0360 Total number of documents Query 202: 0.4819 over all queries Query 203: 0.1550 Retrieved: 50000 Query 204: 0.5441 Relevant: 1826 Query 205: 0.3402 Rel_ret: 1185 0.8 Query 206: 0.3705 Query 207: 0.1770 Interpolated Recall - Query 208: 0.2503 Precision Averages: Query 209: 0.0113 at 0.00 0.5689 Query 210: 0.0653 at 0.10 0.4264 0.6 Query 211: 0.8440 at 0.20 0.3527 Query 212: 0.0476 at 0.30 0.3085 Query 213: 0.0381 at 0.40 0.2646 Precision Query 214: 0.2349 at 0.50 0.2334 Query 215: 0.3023 at 0.60 0.1953 0.4 Query 216: 0.0274 at 0.70 0.1715 Query 217: 0.0188 at 0.80 0.1401 Query 218: 0.8501 at 0.90 0.0769 Query 219: 0.0035 at 1.00 0.0260 Query 220: 0.0180 0.2 Query 221: 0.3463 Avg. prec. (non-interpolated) Query 222: 0.0108 for all rel. documents Query 223: 0.0539 0.2333 Query 224: 0.3288 Precision: Query 225: 0.0415 At 5 docs: 0.3400 0.0 Query 226: 0.0029 At 10 docs: 0.3340 0.0 0.2 0.4 0.6 0.8 1.0 Query 227: 0.0417 At 15 docs: 0.3040 Query 228: 0.2660 At 20 docs: 0.2820 Recall Query 229: 0.1035 At 30 docs: 0.2533 Query 230: 0.6053 At 100 docs: 0.1468 Query 231: 0.4305 At 200 docs: 0.0916 Run UAmsC04EnMu4Gr Query 232: 0.0709 At 500 docs: 0.0435 Comparison to median by topic Query 233: 0.3751 At 1000 docs: 0.0237 Query 234: 0.0065 +1.0 Query 235: 0.0028 R-Precision (prec. after R Query 236: 0.3449 (=num_rel) docs. retrieved): Query 237: 0.6050 Exact: 0.2462 Query 238: 0.2615 Query 239: 0.0768 Query 240: 0.3645 +0.5 Query 241: 0.0366 Query 242: 0.1622 Query 243: 0.2529 Query 244: 0.0201 Query 245: 0.7038 Query 246: 0.0809 Query 247: 0.7825 0.0 Query 248: 0.4534 Query 249: 0.0153 Query 250: 0.0043 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Amsterdam, Multilingual English, Auto, TD Run UAmsC04EnMuAll Average precision Overall statistics Recall−Precision Values (individual queries): (for 50 queries): 1.0 Query 201: 0.0549 Total number of documents Query 202: 0.6291 over all queries Query 203: 0.6831 Retrieved: 50000 Query 204: 0.5587 Relevant: 1826 Query 205: 0.4317 Rel_ret: 1395 0.8 Query 206: 0.5103 Query 207: 0.2129 Interpolated Recall - Query 208: 0.6073 Precision Averages: Query 209: 0.0351 at 0.00 0.7025 Query 210: 0.0585 at 0.10 0.5676 0.6 Query 211: 0.8954 at 0.20 0.5130 Query 212: 0.0965 at 0.30 0.4569 Query 213: 0.6079 at 0.40 0.3923 Precision Query 214: 0.1869 at 0.50 0.3596 Query 215: 0.1657 at 0.60 0.2879 0.4 Query 216: 0.0907 at 0.70 0.2503 Query 217: 0.4131 at 0.80 0.2097 Query 218: 0.8872 at 0.90 0.1428 Query 219: 0.0083 at 1.00 0.0539 Query 220: 0.0341 0.2 Query 221: 0.5475 Avg. prec. (non-interpolated) Query 222: 0.0073 for all rel. documents Query 223: 0.0805 0.3427 Query 224: 0.6831 Precision: Query 225: 0.1759 At 5 docs: 0.4800 0.0 Query 226: 0.0253 At 10 docs: 0.4420 0.0 0.2 0.4 0.6 0.8 1.0 Query 227: 0.5000 At 15 docs: 0.4053 Query 228: 0.3522 At 20 docs: 0.3780 Recall Query 229: 0.2800 At 30 docs: 0.3273 Query 230: 0.6589 At 100 docs: 0.1864 Query 231: 0.4851 At 200 docs: 0.1179 Run UAmsC04EnMuAll Query 232: 0.1205 At 500 docs: 0.0529 Comparison to median by topic Query 233: 0.4832 At 1000 docs: 0.0279 Query 234: 0.1492 +1.0 Query 235: 0.0720 R-Precision (prec. after R Query 236: 0.4365 (=num_rel) docs. retrieved): Query 237: 0.7519 Exact: 0.3538 Query 238: 0.3500 Query 239: 0.0840 Query 240: 0.7763 +0.5 Query 241: 0.0487 Query 242: 0.1786 Query 243: 0.2740 Query 244: 0.0839 Query 245: 0.7400 Query 246: 0.1529 Query 247: 0.9472 0.0 Query 248: 0.4573 Query 249: 0.0185 Query 250: 0.0452 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Amsterdam, Multilingual English, Auto, TD Run UAmsC04EnMuAll2 Average precision Overall statistics Recall−Precision Values (individual queries): (for 50 queries): 1.0 Query 201: 0.0250 Total number of documents Query 202: 0.6224 over all queries Query 203: 0.5160 Retrieved: 50000 Query 204: 0.4673 Relevant: 1826 Query 205: 0.4110 Rel_ret: 1350 0.8 Query 206: 0.2436 Query 207: 0.1978 Interpolated Recall - Query 208: 0.5003 Precision Averages: Query 209: 0.0250 at 0.00 0.5548 Query 210: 0.0753 at 0.10 0.4453 0.6 Query 211: 0.8307 at 0.20 0.3739 Query 212: 0.0639 at 0.30 0.3359 Query 213: 0.3720 at 0.40 0.2869 Precision Query 214: 0.1990 at 0.50 0.2635 Query 215: 0.1354 at 0.60 0.2122 0.4 Query 216: 0.0298 at 0.70 0.1922 Query 217: 0.2310 at 0.80 0.1599 Query 218: 0.8369 at 0.90 0.1007 Query 219: 0.0025 at 1.00 0.0334 Query 220: 0.0395 0.2 Query 221: 0.2836 Avg. prec. (non-interpolated) Query 222: 0.0019 for all rel. documents Query 223: 0.0353 0.2520 Query 224: 0.1843 Precision: Query 225: 0.0636 At 5 docs: 0.3160 0.0 Query 226: 0.0043 At 10 docs: 0.3040 0.0 0.2 0.4 0.6 0.8 1.0 Query 227: 0.5000 At 15 docs: 0.2840 Query 228: 0.2191 At 20 docs: 0.2840 Recall Query 229: 0.1304 At 30 docs: 0.2567 Query 230: 0.5234 At 100 docs: 0.1634 Query 231: 0.3274 At 200 docs: 0.1048 Run UAmsC04EnMuAll2 Query 232: 0.0832 At 500 docs: 0.0498 Comparison to median by topic Query 233: 0.2942 At 1000 docs: 0.0270 Query 234: 0.0263 +1.0 Query 235: 0.0424 R-Precision (prec. after R Query 236: 0.3621 (=num_rel) docs. retrieved): Query 237: 0.7398 Exact: 0.2762 Query 238: 0.2077 Query 239: 0.0444 Query 240: 0.6562 +0.5 Query 241: 0.0512 Query 242: 0.0892 Query 243: 0.2271 Query 244: 0.1190 Query 245: 0.6621 Query 246: 0.0478 Query 247: 0.5125 0.0 Query 248: 0.2971 Query 249: 0.0091 Query 250: 0.0302 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Amsterdam, Multilingual English, Auto, TD Run UAmsC04EnMuWSLM Average precision Overall statistics Recall−Precision Values (individual queries): (for 50 queries): 1.0 Query 201: 0.0386 Total number of documents Query 202: 0.5950 over all queries Query 203: 0.3541 Retrieved: 50000 Query 204: 0.3741 Relevant: 1826 Query 205: 0.4677 Rel_ret: 1375 0.8 Query 206: 0.3442 Query 207: 0.1623 Interpolated Recall - Query 208: 0.7566 Precision Averages: Query 209: 0.0165 at 0.00 0.7673 Query 210: 0.2285 at 0.10 0.5527 0.6 Query 211: 0.8164 at 0.20 0.4214 Query 212: 0.1267 at 0.30 0.3623 Query 213: 0.5384 at 0.40 0.3303 Precision Query 214: 0.1018 at 0.50 0.3012 Query 215: 0.0935 at 0.60 0.2589 0.4 Query 216: 0.2333 at 0.70 0.2281 Query 217: 0.5421 at 0.80 0.1894 Query 218: 0.7430 at 0.90 0.1231 Query 219: 0.1865 at 1.00 0.0480 Query 220: 0.0403 0.2 Query 221: 0.2515 Avg. prec. (non-interpolated) Query 222: 0.0013 for all rel. documents Query 223: 0.0539 0.3040 Query 224: 0.7167 Precision: Query 225: 0.2965 At 5 docs: 0.4440 0.0 Query 226: 0.0498 At 10 docs: 0.4060 0.0 0.2 0.4 0.6 0.8 1.0 Query 227: 0.0179 At 15 docs: 0.3627 Query 228: 0.1586 At 20 docs: 0.3270 Recall Query 229: 0.1156 At 30 docs: 0.2887 Query 230: 0.5307 At 100 docs: 0.1728 Query 231: 0.4036 At 200 docs: 0.1081 Run UAmsC04EnMuWSLM Query 232: 0.0794 At 500 docs: 0.0502 Comparison to median by topic Query 233: 0.3292 At 1000 docs: 0.0275 Query 234: 0.1813 +1.0 Query 235: 0.0814 R-Precision (prec. after R Query 236: 0.3331 (=num_rel) docs. retrieved): Query 237: 0.8127 Exact: 0.3325 Query 238: 0.2410 Query 239: 0.0738 Query 240: 0.8905 +0.5 Query 241: 0.1011 Query 242: 0.2339 Query 243: 0.3097 Query 244: 0.2020 Query 245: 0.5567 Query 246: 0.1490 Query 247: 0.9620 0.0 Query 248: 0.1655 Query 249: 0.0244 Query 250: 0.1192 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number SUNY Buffalo, Multilingual English, Auto, TD Run UBmult01 Average precision Overall statistics Recall−Precision Values (individual queries): (for 50 queries): 1.0 Query 201: 0.0009 Total number of documents Query 202: 0.4502 over all queries Query 203: 0.0001 Retrieved: 50000 Query 204: 0.6187 Relevant: 1826 Query 205: 0.3978 Rel_ret: 1092 0.8 Query 206: 0.2048 Query 207: 0.0553 Interpolated Recall - Query 208: 0.0409 Precision Averages: Query 209: 0.0007 at 0.00 0.4635 Query 210: 0.0142 at 0.10 0.3245 0.6 Query 211: 0.7026 at 0.20 0.2627 Query 212: 0.0259 at 0.30 0.2094 Query 213: 0.4634 at 0.40 0.1908 Precision Query 214: 0.1472 at 0.50 0.1674 Query 215: 0.1321 at 0.60 0.1392 0.4 Query 216: 0.2628 at 0.70 0.1186 Query 217: 0.1239 at 0.80 0.0930 Query 218: 0.8202 at 0.90 0.0548 Query 219: 0.0107 at 1.00 0.0189 Query 220: 0.0105 0.2 Query 221: 0.0613 Avg. prec. (non-interpolated) Query 222: 0.0037 for all rel. documents Query 223: 0.0862 0.1709 Query 224: 0.0534 Precision: Query 225: 0.0535 At 5 docs: 0.2320 0.0 Query 226: 0.0302 At 10 docs: 0.2360 0.0 0.2 0.4 0.6 0.8 1.0 Query 227: 0.0000 At 15 docs: 0.2280 Query 228: 0.0269 At 20 docs: 0.2210 Recall Query 229: 0.0074 At 30 docs: 0.1987 Query 230: 0.5837 At 100 docs: 0.1218 Query 231: 0.0472 At 200 docs: 0.0783 Run UBmult01 Query 232: 0.0446 At 500 docs: 0.0390 Comparison to median by topic Query 233: 0.2444 At 1000 docs: 0.0218 Query 234: 0.0164 +1.0 Query 235: 0.0319 R-Precision (prec. after R Query 236: 0.7050 (=num_rel) docs. retrieved): Query 237: 0.0863 Exact: 0.2003 Query 238: 0.2001 Query 239: 0.0052 Query 240: 0.4264 +0.5 Query 241: 0.0013 Query 242: 0.0989 Query 243: 0.1319 Query 244: 0.0000 Query 245: 0.6956 Query 246: 0.2087 Query 247: 0.1189 0.0 Query 248: 0.0654 Query 249: 0.0066 Query 250: 0.0213 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number SUNY Buffalo, Multilingual English, Auto, TD Run UBmult02 Average precision Overall statistics Recall−Precision Values (individual queries): (for 50 queries): 1.0 Query 201: 0.0235 Total number of documents Query 202: 0.5203 over all queries Query 203: 0.0000 Retrieved: 50000 Query 204: 0.4570 Relevant: 1826 Query 205: 0.2561 Rel_ret: 1135 0.8 Query 206: 0.0837 Query 207: 0.1372 Interpolated Recall - Query 208: 0.0439 Precision Averages: Query 209: 0.0032 at 0.00 0.4771 Query 210: 0.0150 at 0.10 0.3102 0.6 Query 211: 0.3776 at 0.20 0.2306 Query 212: 0.0570 at 0.30 0.1861 Query 213: 0.4267 at 0.40 0.1583 Precision Query 214: 0.0825 at 0.50 0.1312 Query 215: 0.1152 at 0.60 0.0981 0.4 Query 216: 0.2036 at 0.70 0.0816 Query 217: 0.0970 at 0.80 0.0626 Query 218: 0.4522 at 0.90 0.0365 Query 219: 0.0109 at 1.00 0.0122 Query 220: 0.0104 0.2 Query 221: 0.0539 Avg. prec. (non-interpolated) Query 222: 0.0062 for all rel. documents Query 223: 0.0284 0.1453 Query 224: 0.2111 Precision: Query 225: 0.1408 At 5 docs: 0.2800 0.0 Query 226: 0.0699 At 10 docs: 0.2400 0.0 0.2 0.4 0.6 0.8 1.0 Query 227: 0.0000 At 15 docs: 0.2227 Query 228: 0.0737 At 20 docs: 0.2080 Recall Query 229: 0.0890 At 30 docs: 0.1920 Query 230: 0.2846 At 100 docs: 0.1126 Query 231: 0.0505 At 200 docs: 0.0773 Run UBmult02 Query 232: 0.0647 At 500 docs: 0.0403 Comparison to median by topic Query 233: 0.1975 At 1000 docs: 0.0227 Query 234: 0.1374 +1.0 Query 235: 0.0209 R-Precision (prec. after R Query 236: 0.5295 (=num_rel) docs. retrieved): Query 237: 0.0822 Exact: 0.1884 Query 238: 0.2501 Query 239: 0.0251 Query 240: 0.4224 +0.5 Query 241: 0.0006 Query 242: 0.1242 Query 243: 0.2100 Query 244: 0.0000 Query 245: 0.5611 Query 246: 0.0748 Query 247: 0.0888 0.0 Query 248: 0.0707 Query 249: 0.0086 Query 250: 0.0174 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number SUNY Buffalo, Multilingual English, Auto, TD Run UBmulti03 Average precision Overall statistics Recall−Precision Values (individual queries): (for 50 queries): 1.0 Query 201: 0.1083 Total number of documents Query 202: 0.5239 over all queries Query 203: 0.2554 Retrieved: 50000 Query 204: 0.4787 Relevant: 1826 Query 205: 0.5209 Rel_ret: 1463 0.8 Query 206: 0.2514 Query 207: 0.1734 Interpolated Recall - Query 208: 0.6023 Precision Averages: Query 209: 0.1676 at 0.00 0.7095 Query 210: 0.0678 at 0.10 0.5358 0.6 Query 211: 0.5157 at 0.20 0.4385 Query 212: 0.1865 at 0.30 0.3554 Query 213: 0.3894 at 0.40 0.2990 Precision Query 214: 0.0708 at 0.50 0.2553 Query 215: 0.0265 at 0.60 0.2093 0.4 Query 216: 0.2620 at 0.70 0.1617 Query 217: 0.3280 at 0.80 0.1246 Query 218: 0.5660 at 0.90 0.0983 Query 219: 0.1872 at 1.00 0.0324 Query 220: 0.0194 0.2 Query 221: 0.2078 Avg. prec. (non-interpolated) Query 222: 0.0256 for all rel. documents Query 223: 0.1392 0.2748 Query 224: 0.4235 Precision: Query 225: 0.2704 At 5 docs: 0.4360 0.0 Query 226: 0.2861 At 10 docs: 0.3720 0.0 0.2 0.4 0.6 0.8 1.0 Query 227: 0.0833 At 15 docs: 0.3493 Query 228: 0.0789 At 20 docs: 0.3160 Recall Query 229: 0.1203 At 30 docs: 0.2733 Query 230: 0.4966 At 100 docs: 0.1604 Query 231: 0.3270 At 200 docs: 0.1065 Run UBmulti03 Query 232: 0.0440 At 500 docs: 0.0538 Comparison to median by topic Query 233: 0.4259 At 1000 docs: 0.0293 Query 234: 0.1854 +1.0 Query 235: 0.2306 R-Precision (prec. after R Query 236: 0.5908 (=num_rel) docs. retrieved): Query 237: 0.5448 Exact: 0.2817 Query 238: 0.2171 Query 239: 0.0880 Query 240: 0.4863 +0.5 Query 241: 0.0062 Query 242: 0.3729 Query 243: 0.2786 Query 244: 0.3900 Query 245: 0.6019 Query 246: 0.2794 Query 247: 0.4323 0.0 Query 248: 0.3798 Query 249: 0.0074 Query 250: 0.0171 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Chicago, Multilingual English, Auto, T Run UCEMULdecT3 Average precision Overall statistics Recall−Precision Values (individual queries): (for 50 queries): 1.0 Query 201: 0.1028 Total number of documents Query 202: 0.4060 over all queries Query 203: 0.0156 Retrieved: 50000 Query 204: 0.2997 Relevant: 1826 Query 205: 0.2304 Rel_ret: 1142 0.8 Query 206: 0.1653 Query 207: 0.0798 Interpolated Recall - Query 208: 0.0877 Precision Averages: Query 209: 0.0710 at 0.00 0.5437 Query 210: 0.0220 at 0.10 0.3378 0.6 Query 211: 0.4354 at 0.20 0.2748 Query 212: 0.2934 at 0.30 0.2026 Query 213: 0.1407 at 0.40 0.1680 Precision Query 214: 0.0384 at 0.50 0.1387 Query 215: 0.0070 at 0.60 0.1034 0.4 Query 216: 0.0584 at 0.70 0.0762 Query 217: 0.0813 at 0.80 0.0441 Query 218: 0.4153 at 0.90 0.0117 Query 219: 0.0087 at 1.00 0.0006 Query 220: 0.0000 0.2 Query 221: 0.2553 Avg. prec. (non-interpolated) Query 222: 0.0070 for all rel. documents Query 223: 0.0192 0.1545 Query 224: 0.4157 Precision: Query 225: 0.1329 At 5 docs: 0.2920 0.0 Query 226: 0.0042 At 10 docs: 0.2480 0.0 0.2 0.4 0.6 0.8 1.0 Query 227: 0.0086 At 15 docs: 0.2307 Query 228: 0.0000 At 20 docs: 0.2260 Recall Query 229: 0.0587 At 30 docs: 0.2013 Query 230: 0.3056 At 100 docs: 0.1222 Query 231: 0.2010 At 200 docs: 0.0806 Run UCEMULdecT3 Query 232: 0.1299 At 500 docs: 0.0408 Comparison to median by topic Query 233: 0.2513 At 1000 docs: 0.0228 Query 234: 0.1108 +1.0 Query 235: 0.1769 R-Precision (prec. after R Query 236: 0.3246 (=num_rel) docs. retrieved): Query 237: 0.4429 Exact: 0.1916 Query 238: 0.2885 Query 239: 0.0080 Query 240: 0.3150 +0.5 Query 241: 0.0178 Query 242: 0.2583 Query 243: 0.0141 Query 244: 0.0259 Query 245: 0.3916 Query 246: 0.2410 Query 247: 0.2089 0.0 Query 248: 0.1515 Query 249: 0.0011 Query 250: 0.0001 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Chicago, Multilingual English, Auto, T Run UCEMULlppT4 Average precision Overall statistics (individual queries): (for 50 queries): Recall−Precision Values 1.0 Query 201: 0.0913 Total number of documents Query 202: 0.3811 over all queries Query 203: 0.0018 Retrieved: 50000 Query 204: 0.1831 Relevant: 1826 Query 205: 0.1750 Rel_ret: 1022 0.8 Query 206: 0.1669 Query 207: 0.0751 Interpolated Recall - Query 208: 0.1153 Precision Averages: Query 209: 0.0638 at 0.00 0.5264 Query 210: 0.0093 at 0.10 0.2954 0.6 Query 211: 0.3385 at 0.20 0.2231 Query 212: 0.1778 at 0.30 0.1655 Query 213: 0.0838 at 0.40 0.1418 Precision Query 214: 0.0395 at 0.50 0.1151 Query 215: 0.0069 at 0.60 0.0866 0.4 Query 216: 0.0375 at 0.70 0.0632 Query 217: 0.0703 at 0.80 0.0388 Query 218: 0.3873 at 0.90 0.0115 Query 219: 0.0031 at 1.00 0.0006 Query 220: 0.0000 0.2 Query 221: 0.1491 Avg. prec. (non-interpolated) Query 222: 0.0091 for all rel. documents Query 223: 0.0260 0.1307 Query 224: 0.4754 Precision: Query 225: 0.0715 At 5 docs: 0.2640 0.0 Query 226: 0.0053 At 10 docs: 0.2180 0.0 0.2 0.4 0.6 0.8 1.0 Query 227: 0.0007 At 15 docs: 0.2040 Query 228: 0.0000 At 20 docs: 0.1890 Recall Query 229: 0.0611 At 30 docs: 0.1727 Query 230: 0.2031 At 100 docs: 0.1088 Query 231: 0.1450 At 200 docs: 0.0717 Run UCEMULlppT4 Query 232: 0.1423 At 500 docs: 0.0364 Query 233: 0.1885 At 1000 docs: 0.0204 Comparison to median by topic Query 234: 0.0609 +1.0 Query 235: 0.1140 R-Precision (prec. after R Query 236: 0.3113 (=num_rel) docs. retrieved): Query 237: 0.2913 Exact: 0.1753 Query 238: 0.2511 Query 239: 0.0076 Query 240: 0.3318 +0.5 Query 241: 0.0002 Query 242: 0.2404 Query 243: 0.0137 Query 244: 0.0007 Query 245: 0.4359 Query 246: 0.2240 Query 247: 0.2108 0.0 Query 248: 0.1569 Query 249: 0.0013 Query 250: 0.0001 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Chicago, Multilingual English, Auto, T Run UCEMULT2 Average precision Overall statistics Recall−Precision Values (individual queries): (for 50 queries): 1.0 Query 201: 0.0908 Total number of documents Query 202: 0.3821 over all queries Query 203: 0.0098 Retrieved: 50000 Query 204: 0.1831 Relevant: 1826 Query 205: 0.1750 Rel_ret: 1086 0.8 Query 206: 0.1669 Query 207: 0.0838 Interpolated Recall - Query 208: 0.1153 Precision Averages: Query 209: 0.0744 at 0.00 0.5442 Query 210: 0.0211 at 0.10 0.3268 0.6 Query 211: 0.3812 at 0.20 0.2511 Query 212: 0.2536 at 0.30 0.1793 Query 213: 0.1256 at 0.40 0.1536 Precision Query 214: 0.0400 at 0.50 0.1236 Query 215: 0.0069 at 0.60 0.0971 0.4 Query 216: 0.0408 at 0.70 0.0774 Query 217: 0.0703 at 0.80 0.0477 Query 218: 0.3932 at 0.90 0.0151 Query 219: 0.0031 at 1.00 0.0006 Query 220: 0.0000 0.2 Query 221: 0.1980 Avg. prec. (non-interpolated) Query 222: 0.0091 for all rel. documents Query 223: 0.0260 0.1464 Query 224: 0.4989 Precision: Query 225: 0.0761 At 5 docs: 0.2880 0.0 Query 226: 0.0053 At 10 docs: 0.2440 0.0 0.2 0.4 0.6 0.8 1.0 Query 227: 0.0094 At 15 docs: 0.2267 Query 228: 0.0000 At 20 docs: 0.2110 Recall Query 229: 0.0611 At 30 docs: 0.1913 Query 230: 0.3109 At 100 docs: 0.1178 Query 231: 0.2123 At 200 docs: 0.0774 Run UCEMULT2 Query 232: 0.1483 At 500 docs: 0.0390 Comparison to median by topic Query 233: 0.2478 At 1000 docs: 0.0217 Query 234: 0.0617 +1.0 Query 235: 0.1171 R-Precision (prec. after R Query 236: 0.3113 (=num_rel) docs. retrieved): Query 237: 0.4111 Exact: 0.1860 Query 238: 0.3021 Query 239: 0.0096 Query 240: 0.3318 +0.5 Query 241: 0.0212 Query 242: 0.2510 Query 243: 0.0137 Query 244: 0.0270 Query 245: 0.4491 Query 246: 0.2240 Query 247: 0.2108 0.0 Query 248: 0.1569 Query 249: 0.0013 Query 250: 0.0001 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Chicago, Multilingual English, Auto, TD Run UCEMULTD1 Average precision Overall statistics Recall−Precision Values (individual queries): (for 50 queries): 1.0 Query 201: 0.1184 Total number of documents Query 202: 0.4363 over all queries Query 203: 0.0239 Retrieved: 50000 Query 204: 0.1460 Relevant: 1826 Query 205: 0.2035 Rel_ret: 1103 0.8 Query 206: 0.1706 Query 207: 0.0814 Interpolated Recall - Query 208: 0.2144 Precision Averages: Query 209: 0.0707 at 0.00 0.5886 Query 210: 0.0207 at 0.10 0.3813 0.6 Query 211: 0.3888 at 0.20 0.2679 Query 212: 0.0925 at 0.30 0.2064 Query 213: 0.1047 at 0.40 0.1657 Precision Query 214: 0.1268 at 0.50 0.1350 Query 215: 0.0043 at 0.60 0.1064 0.4 Query 216: 0.0604 at 0.70 0.0829 Query 217: 0.1062 at 0.80 0.0554 Query 218: 0.3594 at 0.90 0.0157 Query 219: 0.0096 at 1.00 0.0013 Query 220: 0.0000 0.2 Query 221: 0.2667 Avg. prec. (non-interpolated) Query 222: 0.0118 for all rel. documents Query 223: 0.0139 0.1628 Query 224: 0.5565 Precision: Query 225: 0.0905 At 5 docs: 0.3080 0.0 Query 226: 0.0004 At 10 docs: 0.2520 0.0 0.2 0.4 0.6 0.8 1.0 Query 227: 0.0556 At 15 docs: 0.2400 Query 228: 0.0000 At 20 docs: 0.2180 Recall Query 229: 0.1170 At 30 docs: 0.1947 Query 230: 0.2702 At 100 docs: 0.1204 Query 231: 0.3988 At 200 docs: 0.0800 Run UCEMULTD1 Query 232: 0.1786 At 500 docs: 0.0399 Comparison to median by topic Query 233: 0.2515 At 1000 docs: 0.0221 Query 234: 0.0473 +1.0 Query 235: 0.1477 R-Precision (prec. after R Query 236: 0.2844 (=num_rel) docs. retrieved): Query 237: 0.4064 Exact: 0.2001 Query 238: 0.3686 Query 239: 0.0225 Query 240: 0.3705 +0.5 Query 241: 0.0234 Query 242: 0.0641 Query 243: 0.0315 Query 244: 0.1716 Query 245: 0.4619 Query 246: 0.2501 Query 247: 0.3598 0.0 Query 248: 0.1631 Query 249: 0.0132 Query 250: 0.0044 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Hildesheim, Multilingual English, Auto, TD Run UHImlt1 Average precision Overall statistics Recall−Precision Values (individual queries): (for 50 queries): 1.0 Query 201: 0.0356 Total number of documents Query 202: 0.4700 over all queries Query 203: 0.5531 Retrieved: 50000 Query 204: 0.3975 Relevant: 1826 Query 205: 0.1867 Rel_ret: 1031 0.8 Query 206: 0.1973 Query 207: 0.0954 Interpolated Recall - Query 208: 0.1589 Precision Averages: Query 209: 0.0013 at 0.00 0.5503 Query 210: 0.1294 at 0.10 0.3603 0.6 Query 211: 0.7103 at 0.20 0.3170 Query 212: 0.0290 at 0.30 0.2801 Query 213: 0.3307 at 0.40 0.2525 Precision Query 214: 0.0071 at 0.50 0.2201 Query 215: 0.0435 at 0.60 0.1534 0.4 Query 216: 0.0010 at 0.70 0.1157 Query 217: 0.0097 at 0.80 0.0739 Query 218: 0.6347 at 0.90 0.0339 Query 219: 0.0004 at 1.00 0.0036 Query 220: 0.0008 0.2 Query 221: 0.4649 Avg. prec. (non-interpolated) Query 222: 0.0193 for all rel. documents Query 223: 0.0057 0.1974 Query 224: 0.1194 Precision: Query 225: 0.0136 At 5 docs: 0.3360 0.0 Query 226: 0.0219 At 10 docs: 0.3040 0.0 0.2 0.4 0.6 0.8 1.0 Query 227: 0.0312 At 15 docs: 0.2760 Query 228: 0.0013 At 20 docs: 0.2600 Recall Query 229: 0.1439 At 30 docs: 0.2253 Query 230: 0.5822 At 100 docs: 0.1260 Query 231: 0.3632 At 200 docs: 0.0782 Run UHImlt1 Query 232: 0.0207 At 500 docs: 0.0370 Comparison to median by topic Query 233: 0.2105 At 1000 docs: 0.0206 Query 234: 0.0302 +1.0 Query 235: 0.0735 R-Precision (prec. after R Query 236: 0.7007 (=num_rel) docs. retrieved): Query 237: 0.4162 Exact: 0.2300 Query 238: 0.2105 Query 239: 0.0272 Query 240: 0.5887 +0.5 Query 241: 0.0163 Query 242: 0.0661 Query 243: 0.0722 Query 244: 0.3333 Query 245: 0.4739 Query 246: 0.0189 Query 247: 0.3438 0.0 Query 248: 0.5044 Query 249: 0.0057 Query 250: 0.0000 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Hildesheim, Multilingual English, Auto, TD Run UHImlt2 Average precision Overall statistics Recall−Precision Values (individual queries): (for 50 queries): 1.0 Query 201: 0.0214 Total number of documents Query 202: 0.4334 over all queries Query 203: 0.4682 Retrieved: 50000 Query 204: 0.4693 Relevant: 1826 Query 205: 0.1553 Rel_ret: 973 0.8 Query 206: 0.1681 Query 207: 0.0748 Interpolated Recall - Query 208: 0.0740 Precision Averages: Query 209: 0.0023 at 0.00 0.5521 Query 210: 0.1691 at 0.10 0.3538 0.6 Query 211: 0.6178 at 0.20 0.2990 Query 212: 0.0387 at 0.30 0.2615 Query 213: 0.3026 at 0.40 0.2368 Precision Query 214: 0.0043 at 0.50 0.2085 Query 215: 0.0216 at 0.60 0.1377 0.4 Query 216: 0.0005 at 0.70 0.0855 Query 217: 0.0020 at 0.80 0.0620 Query 218: 0.6689 at 0.90 0.0187 Query 219: 0.0001 at 1.00 0.0004 Query 220: 0.0009 0.2 Query 221: 0.3834 Avg. prec. (non-interpolated) Query 222: 0.0142 for all rel. documents Query 223: 0.0035 0.1849 Query 224: 0.0643 Precision: Query 225: 0.0009 At 5 docs: 0.3280 0.0 Query 226: 0.0511 At 10 docs: 0.2840 0.0 0.2 0.4 0.6 0.8 1.0 Query 227: 0.0082 At 15 docs: 0.2613 Query 228: 0.0016 At 20 docs: 0.2370 Recall Query 229: 0.1409 At 30 docs: 0.2053 Query 230: 0.5320 At 100 docs: 0.1174 Query 231: 0.1553 At 200 docs: 0.0728 Run UHImlt2 Query 232: 0.0272 At 500 docs: 0.0346 Comparison to median by topic Query 233: 0.1679 At 1000 docs: 0.0195 Query 234: 0.0213 +1.0 Query 235: 0.0501 R-Precision (prec. after R Query 236: 0.7600 (=num_rel) docs. retrieved): Query 237: 0.4495 Exact: 0.2165 Query 238: 0.1709 Query 239: 0.0184 Query 240: 0.5280 +0.5 Query 241: 0.0058 Query 242: 0.1205 Query 243: 0.0677 Query 244: 0.6667 Query 245: 0.5054 Query 246: 0.0233 Query 247: 0.2188 0.0 Query 248: 0.3930 Query 249: 0.0029 Query 250: 0.0000 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Jaen/SINAI, Multilingual English, Auto, TD Run UJAMLRL Average precision Overall statistics Recall−Precision Values (individual queries): (for 50 queries): 1.0 Query 201: 0.0382 Total number of documents Query 202: 0.5970 over all queries Query 203: 0.1963 Retrieved: 50000 Query 204: 0.5736 Relevant: 1826 0.8 Query 205: 0.4829 Rel_ret: 1346 Query 206: 0.3124 Query 207: 0.1907 Interpolated Recall - Query 208: 0.4907 Precision Averages: Query 209: 0.1800 at 0.00 0.6168 Query 210: 0.1908 at 0.10 0.4768 0.6 Query 211: 0.7902 at 0.20 0.4077 Query 212: 0.0776 at 0.30 0.3738 Query 213: 0.5421 at 0.40 0.3205 Precision Query 214: 0.0309 at 0.50 0.2972 Query 215: 0.0394 at 0.60 0.2609 0.4 Query 216: 0.0866 at 0.70 0.2138 Query 217: 0.2215 at 0.80 0.1787 Query 218: 0.8073 at 0.90 0.1123 Query 219: 0.0975 at 1.00 0.0242 Query 220: 0.0442 0.2 Query 221: 0.1960 Avg. prec. (non-interpolated) Query 222: 0.0205 for all rel. documents Query 223: 0.0302 0.2773 Query 224: 0.7497 Precision: Query 225: 0.2840 At 5 docs: 0.3720 0.0 Query 226: 0.0240 At 10 docs: 0.3920 0.0 0.2 0.4 0.6 0.8 1.0 Query 227: 0.0006 At 15 docs: 0.3613 Query 228: 0.0704 At 20 docs: 0.3360 Recall Query 229: 0.1638 At 30 docs: 0.2880 Query 230: 0.6445 At 100 docs: 0.1702 Query 231: 0.3460 At 200 docs: 0.1064 Run UJAMLRL Query 232: 0.0304 At 500 docs: 0.0492 Comparison to median by topic Query 233: 0.3360 At 1000 docs: 0.0269 Query 234: 0.1852 +1.0 Query 235: 0.2943 R-Precision (prec. after R Query 236: 0.1416 (=num_rel) docs. retrieved): Query 237: 0.8407 Exact: 0.3279 Query 238: 0.2339 Query 239: 0.0625 Query 240: 0.6337 +0.5 Query 241: 0.0200 Query 242: 0.4085 Query 243: 0.1495 Query 244: 0.0236 Query 245: 0.4828 Query 246: 0.1762 0.0 Query 247: 0.7140 Query 248: 0.5935 Query 249: 0.0148 Query 250: 0.0061 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Jaen/SINAI, Multilingual English, Auto, TD Run UJAMLRL2P Average precision Overall statistics Recall−Precision Values (individual queries): (for 50 queries): 1.0 Query 201: 0.0651 Total number of documents Query 202: 0.5631 over all queries Query 203: 0.1818 Retrieved: 50000 Query 204: 0.6561 Relevant: 1826 0.8 Query 205: 0.4967 Rel_ret: 1339 Query 206: 0.5305 Query 207: 0.2470 Interpolated Recall - Query 208: 0.6791 Precision Averages: Query 209: 0.0638 at 0.00 0.7611 Query 210: 0.2458 at 0.10 0.5813 0.6 Query 211: 0.8772 at 0.20 0.4979 Query 212: 0.0677 at 0.30 0.4256 Query 213: 0.6332 at 0.40 0.3681 Precision Query 214: 0.0316 at 0.50 0.3325 Query 215: 0.0683 at 0.60 0.2780 0.4 Query 216: 0.2105 at 0.70 0.2337 Query 217: 0.3527 at 0.80 0.1972 Query 218: 0.8482 at 0.90 0.1137 Query 219: 0.1277 at 1.00 0.0313 Query 220: 0.0996 0.2 Query 221: 0.2675 Avg. prec. (non-interpolated) Query 222: 0.0137 for all rel. documents Query 223: 0.0612 0.3336 Query 224: 0.7427 Precision: Query 225: 0.4796 At 5 docs: 0.5440 0.0 Query 226: 0.0368 At 10 docs: 0.4520 0.0 0.2 0.4 0.6 0.8 1.0 Query 227: 0.0006 At 15 docs: 0.3947 Query 228: 0.1457 At 20 docs: 0.3620 Recall Query 229: 0.3233 At 30 docs: 0.3100 Query 230: 0.6203 At 100 docs: 0.1740 Query 231: 0.4637 At 200 docs: 0.1072 Run UJAMLRL2P Query 232: 0.0652 At 500 docs: 0.0491 Comparison to median by topic Query 233: 0.4055 At 1000 docs: 0.0268 Query 234: 0.4005 +1.0 Query 235: 0.2629 R-Precision (prec. after R Query 236: 0.1862 (=num_rel) docs. retrieved): Query 237: 0.7781 Exact: 0.3501 Query 238: 0.2741 Query 239: 0.0585 Query 240: 0.9481 +0.5 Query 241: 0.0058 Query 242: 0.4448 Query 243: 0.2107 Query 244: 0.0185 Query 245: 0.6602 Query 246: 0.1670 0.0 Query 247: 0.8668 Query 248: 0.6884 Query 249: 0.0143 Query 250: 0.0240 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Jaen/SINAI, Multilingual English, Auto, TD Run UJAMLRL3P Average precision Overall statistics Recall−Precision Values (individual queries): (for 50 queries): 1.0 Query 201: 0.0482 Total number of documents Query 202: 0.5732 over all queries Query 203: 0.2581 Retrieved: 50000 Query 204: 0.6122 Relevant: 1826 0.8 Query 205: 0.4600 Rel_ret: 1358 Query 206: 0.4074 Query 207: 0.1948 Interpolated Recall - Query 208: 0.6038 Precision Averages: Query 209: 0.1712 at 0.00 0.6557 Query 210: 0.2207 at 0.10 0.5037 0.6 Query 211: 0.8805 at 0.20 0.4455 Query 212: 0.0832 at 0.30 0.4022 Query 213: 0.6221 at 0.40 0.3546 Precision Query 214: 0.0292 at 0.50 0.3170 Query 215: 0.0408 at 0.60 0.2744 0.4 Query 216: 0.1378 at 0.70 0.2266 Query 217: 0.2393 at 0.80 0.1962 Query 218: 0.8386 at 0.90 0.1162 Query 219: 0.0813 at 1.00 0.0290 Query 220: 0.0838 0.2 Query 221: 0.2452 Avg. prec. (non-interpolated) Query 222: 0.0168 for all rel. documents Query 223: 0.0619 0.3005 Query 224: 0.7163 Precision: Query 225: 0.2693 At 5 docs: 0.4160 0.0 Query 226: 0.0198 At 10 docs: 0.4200 0.0 0.2 0.4 0.6 0.8 1.0 Query 227: 0.0022 At 15 docs: 0.3813 Query 228: 0.1010 At 20 docs: 0.3520 Recall Query 229: 0.2698 At 30 docs: 0.3013 Query 230: 0.6034 At 100 docs: 0.1774 Query 231: 0.5242 At 200 docs: 0.1095 Run UJAMLRL3P Query 232: 0.0549 At 500 docs: 0.0500 Comparison to median by topic Query 233: 0.4022 At 1000 docs: 0.0272 Query 234: 0.2386 +1.0 Query 235: 0.2248 R-Precision (prec. after R Query 236: 0.1316 (=num_rel) docs. retrieved): Query 237: 0.8224 Exact: 0.3380 Query 238: 0.2918 Query 239: 0.0701 Query 240: 0.6337 +0.5 Query 241: 0.0062 Query 242: 0.3868 Query 243: 0.2316 Query 244: 0.0216 Query 245: 0.5778 Query 246: 0.2017 0.0 Query 247: 0.6690 Query 248: 0.6068 Query 249: 0.0144 Query 250: 0.0227 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Jaen/SINAI, Multilingual English, Auto, TD Run UJAMLRLRP Average precision Overall statistics Recall−Precision Values (individual queries): (for 50 queries): 1.0 Query 201: 0.0475 Total number of documents Query 202: 0.5719 over all queries Query 203: 0.2568 Retrieved: 50000 Query 204: 0.6123 Relevant: 1826 0.8 Query 205: 0.4598 Rel_ret: 1362 Query 206: 0.4072 Query 207: 0.2070 Interpolated Recall - Query 208: 0.6054 Precision Averages: Query 209: 0.1724 at 0.00 0.6554 Query 210: 0.2204 at 0.10 0.5024 0.6 Query 211: 0.8792 at 0.20 0.4465 Query 212: 0.0833 at 0.30 0.4034 Query 213: 0.6209 at 0.40 0.3551 Precision Query 214: 0.0293 at 0.50 0.3176 Query 215: 0.0403 at 0.60 0.2751 0.4 Query 216: 0.1333 at 0.70 0.2265 Query 217: 0.2393 at 0.80 0.1969 Query 218: 0.8384 at 0.90 0.1156 Query 219: 0.0816 at 1.00 0.0290 Query 220: 0.0828 0.2 Query 221: 0.2453 Avg. prec. (non-interpolated) Query 222: 0.0169 for all rel. documents Query 223: 0.0618 0.3008 Query 224: 0.7175 Precision: Query 225: 0.2768 At 5 docs: 0.4160 0.0 Query 226: 0.0198 At 10 docs: 0.4160 0.0 0.2 0.4 0.6 0.8 1.0 Query 227: 0.0018 At 15 docs: 0.3800 Query 228: 0.1008 At 20 docs: 0.3560 Recall Query 229: 0.2700 At 30 docs: 0.3020 Query 230: 0.6030 At 100 docs: 0.1766 Query 231: 0.5277 At 200 docs: 0.1092 Run UJAMLRLRP Query 232: 0.0587 At 500 docs: 0.0500 Comparison to median by topic Query 233: 0.4006 At 1000 docs: 0.0272 Query 234: 0.2381 +1.0 Query 235: 0.2271 R-Precision (prec. after R Query 236: 0.1332 (=num_rel) docs. retrieved): Query 237: 0.8216 Exact: 0.3362 Query 238: 0.2913 Query 239: 0.0697 Query 240: 0.6337 +0.5 Query 241: 0.0055 Query 242: 0.3866 Query 243: 0.2316 Query 244: 0.0208 Query 245: 0.5768 Query 246: 0.2048 0.0 Query 247: 0.6641 Query 248: 0.6094 Query 249: 0.0140 Query 250: 0.0227 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Jaen/SINAI, Multilingual English, Auto, TD Run UJAMLRSV2 Average precision Overall statistics Recall−Precision Values (individual queries): (for 50 queries): 1.0 Query 201: 0.0864 Total number of documents Query 202: 0.5667 over all queries Query 203: 0.2161 Retrieved: 50000 Query 204: 0.6625 Relevant: 1826 0.8 Query 205: 0.5455 Rel_ret: 1322 Query 206: 0.5553 Query 207: 0.2246 Interpolated Recall - Query 208: 0.6478 Precision Averages: Query 209: 0.0763 at 0.00 0.7501 Query 210: 0.2198 at 0.10 0.5801 0.6 Query 211: 0.8608 at 0.20 0.4930 Query 212: 0.0511 at 0.30 0.4260 Query 213: 0.6252 at 0.40 0.3759 Precision Query 214: 0.0643 at 0.50 0.3425 Query 215: 0.0842 at 0.60 0.2858 0.4 Query 216: 0.1960 at 0.70 0.2319 Query 217: 0.3256 at 0.80 0.2030 Query 218: 0.8661 at 0.90 0.1137 Query 219: 0.1089 at 1.00 0.0379 Query 220: 0.1323 0.2 Query 221: 0.2423 Avg. prec. (non-interpolated) Query 222: 0.0148 for all rel. documents Query 223: 0.0481 0.3341 Query 224: 0.7691 Precision: Query 225: 0.4724 At 5 docs: 0.5160 0.0 Query 226: 0.0638 At 10 docs: 0.4460 0.0 0.2 0.4 0.6 0.8 1.0 Query 227: 0.0000 At 15 docs: 0.3920 Query 228: 0.1504 At 20 docs: 0.3680 Recall Query 229: 0.3261 At 30 docs: 0.3233 Query 230: 0.7124 At 100 docs: 0.1778 Query 231: 0.4247 At 200 docs: 0.1074 Run UJAMLRSV2 Query 232: 0.0785 At 500 docs: 0.0493 Comparison to median by topic Query 233: 0.3914 At 1000 docs: 0.0264 Query 234: 0.3340 +1.0 Query 235: 0.2387 R-Precision (prec. after R Query 236: 0.1430 (=num_rel) docs. retrieved): Query 237: 0.7499 Exact: 0.3447 Query 238: 0.2819 Query 239: 0.0573 Query 240: 0.9481 +0.5 Query 241: 0.0030 Query 242: 0.4268 Query 243: 0.2290 Query 244: 0.0058 Query 245: 0.6716 Query 246: 0.1561 0.0 Query 247: 0.9259 Query 248: 0.6805 Query 249: 0.0132 Query 250: 0.0303 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Université de Neuchâtel, Multilingual English, Auto, TD Run UniNEmulti1 Average precision Overall statistics Recall−Precision Values (individual queries): (for 50 queries): 1.0 Query 201: 0.0723 Total number of documents Query 202: 0.5124 over all queries Query 203: 0.3789 Retrieved: 50000 Query 204: 0.5866 Relevant: 1826 0.8 Query 205: 0.2576 Rel_ret: 1327 Query 206: 0.4474 Query 207: 0.2164 Interpolated Recall - Query 208: 0.4017 Precision Averages: Query 209: 0.0967 at 0.00 0.6236 Query 210: 0.0668 at 0.10 0.5318 0.6 Query 211: 0.7627 at 0.20 0.4743 Query 212: 0.1052 at 0.30 0.4009 Query 213: 0.4424 at 0.40 0.3481 Precision Query 214: 0.0772 at 0.50 0.3047 Query 215: 0.1096 at 0.60 0.2683 0.4 Query 216: 0.1287 at 0.70 0.2339 Query 217: 0.2073 at 0.80 0.1986 Query 218: 0.8703 at 0.90 0.1477 Query 219: 0.0864 at 1.00 0.0627 Query 220: 0.0222 0.2 Query 221: 0.3914 Avg. prec. (non-interpolated) Query 222: 0.0537 for all rel. documents Query 223: 0.0698 0.3090 Query 224: 0.7080 Precision: Query 225: 0.1726 At 5 docs: 0.4400 0.0 Query 226: 0.0358 At 10 docs: 0.3700 0.0 0.2 0.4 0.6 0.8 1.0 Query 227: 0.0000 At 15 docs: 0.3520 Query 228: 0.3760 At 20 docs: 0.3410 Recall Query 229: 0.1583 At 30 docs: 0.3020 Query 230: 0.5240 At 100 docs: 0.1812 Query 231: 0.3757 At 200 docs: 0.1135 Run UniNEmulti1 Query 232: 0.0398 At 500 docs: 0.0504 Comparison to median by topic Query 233: 0.3644 At 1000 docs: 0.0265 Query 234: 0.1051 +1.0 Query 235: 0.0445 R-Precision (prec. after R Query 236: 0.8630 (=num_rel) docs. retrieved): Query 237: 0.5875 Exact: 0.3398 Query 238: 0.3064 Query 239: 0.0756 Query 240: 0.6173 +0.5 Query 241: 0.0073 Query 242: 0.5775 Query 243: 0.3727 Query 244: 0.1146 Query 245: 0.7250 Query 246: 0.2957 0.0 Query 247: 0.9823 Query 248: 0.6089 Query 249: 0.0078 Query 250: 0.0410 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Université de Neuchâtel, Multilingual English, Auto, TD Run UniNEmulti2 Average precision Overall statistics Recall−Precision Values (individual queries): (for 50 queries): 1.0 Query 201: 0.0851 Total number of documents Query 202: 0.7031 over all queries Query 203: 0.3720 Retrieved: 50000 Query 204: 0.5119 Relevant: 1826 0.8 Query 205: 0.3514 Rel_ret: 1423 Query 206: 0.3210 Query 207: 0.1843 Interpolated Recall - Query 208: 0.4481 Precision Averages: Query 209: 0.1602 at 0.00 0.6156 Query 210: 0.0699 at 0.10 0.5133 0.6 Query 211: 0.8510 at 0.20 0.4316 Query 212: 0.1483 at 0.30 0.3768 Query 213: 0.3773 at 0.40 0.3398 Precision Query 214: 0.0839 at 0.50 0.3090 Query 215: 0.1302 at 0.60 0.2712 0.4 Query 216: 0.1532 at 0.70 0.2352 Query 217: 0.2422 at 0.80 0.2055 Query 218: 0.7577 at 0.90 0.1557 Query 219: 0.0692 at 1.00 0.0676 Query 220: 0.0184 0.2 Query 221: 0.3479 Avg. prec. (non-interpolated) Query 222: 0.0404 for all rel. documents Query 223: 0.0712 0.2969 Query 224: 0.7198 Precision: Query 225: 0.2609 At 5 docs: 0.3520 0.0 Query 226: 0.0614 At 10 docs: 0.3440 0.0 0.2 0.4 0.6 0.8 1.0 Query 227: 0.0027 At 15 docs: 0.3413 Query 228: 0.2576 At 20 docs: 0.3270 Recall Query 229: 0.1461 At 30 docs: 0.2907 Query 230: 0.4331 At 100 docs: 0.1868 Query 231: 0.4166 At 200 docs: 0.1158 Run UniNEmulti2 Query 232: 0.0542 At 500 docs: 0.0532 Comparison to median by topic Query 233: 0.3499 At 1000 docs: 0.0285 Query 234: 0.1217 +1.0 Query 235: 0.0720 R-Precision (prec. after R Query 236: 0.6234 (=num_rel) docs. retrieved): Query 237: 0.4467 Exact: 0.3215 Query 238: 0.3072 Query 239: 0.0576 Query 240: 0.7221 +0.5 Query 241: 0.0135 Query 242: 0.5278 Query 243: 0.2722 Query 244: 0.0589 Query 245: 0.7331 Query 246: 0.2803 0.0 Query 247: 0.8755 Query 248: 0.4942 Query 249: 0.0117 Query 250: 0.0293 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Université de Neuchâtel, Multilingual English, Auto, TD Run UniNEmulti3 Average precision Overall statistics Recall−Precision Values (individual queries): (for 50 queries): 1.0 Query 201: 0.0676 Total number of documents Query 202: 0.6581 over all queries Query 203: 0.4721 Retrieved: 50000 Query 204: 0.5233 Relevant: 1826 0.8 Query 205: 0.5011 Rel_ret: 1309 Query 206: 0.2112 Query 207: 0.1331 Interpolated Recall - Query 208: 0.1690 Precision Averages: Query 209: 0.1318 at 0.00 0.6254 Query 210: 0.0280 at 0.10 0.5300 0.6 Query 211: 0.8852 at 0.20 0.4712 Query 212: 0.1642 at 0.30 0.3980 Query 213: 0.3774 at 0.40 0.3529 Precision Query 214: 0.0824 at 0.50 0.3070 Query 215: 0.1445 at 0.60 0.2751 0.4 Query 216: 0.1037 at 0.70 0.2227 Query 217: 0.2428 at 0.80 0.1856 Query 218: 0.8142 at 0.90 0.1186 Query 219: 0.5094 at 1.00 0.0395 Query 220: 0.0090 0.2 Query 221: 0.3070 Avg. prec. (non-interpolated) Query 222: 0.0241 for all rel. documents Query 223: 0.1311 0.3067 Query 224: 0.8895 Precision: Query 225: 0.4536 At 5 docs: 0.4440 0.0 Query 226: 0.0470 At 10 docs: 0.4100 0.0 0.2 0.4 0.6 0.8 1.0 Query 227: 0.0000 At 15 docs: 0.3707 Query 228: 0.3938 At 20 docs: 0.3480 Recall Query 229: 0.1241 At 30 docs: 0.2927 Query 230: 0.5365 At 100 docs: 0.1726 Query 231: 0.2021 At 200 docs: 0.1067 Run UniNEmulti3 Query 232: 0.0023 At 500 docs: 0.0489 Comparison to median by topic Query 233: 0.2567 At 1000 docs: 0.0262 Query 234: 0.2739 +1.0 Query 235: 0.0494 R-Precision (prec. after R Query 236: 0.7136 (=num_rel) docs. retrieved): Query 237: 0.5924 Exact: 0.3261 Query 238: 0.2128 Query 239: 0.0343 Query 240: 0.7768 +0.5 Query 241: 0.0009 Query 242: 0.6001 Query 243: 0.2825 Query 244: 0.0211 Query 245: 0.3930 Query 246: 0.3155 0.0 Query 247: 0.8896 Query 248: 0.5602 Query 249: 0.0089 Query 250: 0.0142 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Université de Neuchâtel, Multilingual English, Auto, TD Run UniNEmulti4 Average precision Overall statistics Recall−Precision Values (individual queries): (for 50 queries): 1.0 Query 201: 0.0723 Total number of documents Query 202: 0.5124 over all queries Query 203: 0.3732 Retrieved: 50000 Query 204: 0.5866 Relevant: 1826 0.8 Query 205: 0.3067 Rel_ret: 1240 Query 206: 0.4474 Query 207: 0.2164 Interpolated Recall - Query 208: 0.4017 Precision Averages: Query 209: 0.0967 at 0.00 0.6255 Query 210: 0.0668 at 0.10 0.5343 0.6 Query 211: 0.3389 at 0.20 0.4781 Query 212: 0.1052 at 0.30 0.4044 Query 213: 0.4424 at 0.40 0.3381 Precision Query 214: 0.0772 at 0.50 0.2890 Query 215: 0.0903 at 0.60 0.2525 0.4 Query 216: 0.1287 at 0.70 0.2184 Query 217: 0.2073 at 0.80 0.1835 Query 218: 0.8703 at 0.90 0.1314 Query 219: 0.0864 at 1.00 0.0594 Query 220: 0.0222 0.2 Query 221: 0.3914 Avg. prec. (non-interpolated) Query 222: 0.0537 for all rel. documents Query 223: 0.0698 0.3010 Query 224: 0.7080 Precision: Query 225: 0.1726 At 5 docs: 0.4400 0.0 Query 226: 0.0358 At 10 docs: 0.3700 0.0 0.2 0.4 0.6 0.8 1.0 Query 227: 0.0000 At 15 docs: 0.3547 Query 228: 0.3760 At 20 docs: 0.3450 Recall Query 229: 0.1583 At 30 docs: 0.3053 Query 230: 0.5240 At 100 docs: 0.1762 Query 231: 0.3757 At 200 docs: 0.1066 Run UniNEmulti4 Query 232: 0.0398 At 500 docs: 0.0470 Comparison to median by topic Query 233: 0.3644 At 1000 docs: 0.0248 Query 234: 0.1051 +1.0 Query 235: 0.0445 R-Precision (prec. after R Query 236: 0.8630 (=num_rel) docs. retrieved): Query 237: 0.5875 Exact: 0.3346 Query 238: 0.3064 Query 239: 0.0756 Query 240: 0.6173 +0.5 Query 241: 0.0074 Query 242: 0.5775 Query 243: 0.3727 Query 244: 0.1146 Query 245: 0.7250 Query 246: 0.2957 0.0 Query 247: 0.9823 Query 248: 0.6089 Query 249: 0.0078 Query 250: 0.0410 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Université de Neuchâtel, Multilingual English, Auto, TD Run UniNEmulti5 Average precision Overall statistics Recall−Precision Values (individual queries): (for 50 queries): 1.0 Query 201: 0.0948 Total number of documents Query 202: 0.6611 over all queries Query 203: 0.3382 Retrieved: 50000 Query 204: 0.4931 Relevant: 1826 0.8 Query 205: 0.2961 Rel_ret: 1388 Query 206: 0.4255 Query 207: 0.2394 Interpolated Recall - Query 208: 0.4278 Precision Averages: Query 209: 0.0667 at 0.00 0.6445 Query 210: 0.0637 at 0.10 0.5310 0.6 Query 211: 0.8111 at 0.20 0.4487 Query 212: 0.1671 at 0.30 0.3929 Query 213: 0.4310 at 0.40 0.3549 Precision Query 214: 0.0690 at 0.50 0.3199 Query 215: 0.1659 at 0.60 0.2631 0.4 Query 216: 0.1955 at 0.70 0.2175 Query 217: 0.2482 at 0.80 0.1891 Query 218: 0.7701 at 0.90 0.1240 Query 219: 0.0298 at 1.00 0.0435 Query 220: 0.0223 0.2 Query 221: 0.2843 Avg. prec. (non-interpolated) Query 222: 0.0368 for all rel. documents Query 223: 0.0651 0.3019 Query 224: 0.8501 Precision: Query 225: 0.0297 At 5 docs: 0.4280 0.0 Query 226: 0.0694 At 10 docs: 0.3820 0.0 0.2 0.4 0.6 0.8 1.0 Query 227: 0.0027 At 15 docs: 0.3600 Query 228: 0.3342 At 20 docs: 0.3340 Recall Query 229: 0.2104 At 30 docs: 0.2907 Query 230: 0.5080 At 100 docs: 0.1756 Query 231: 0.3145 At 200 docs: 0.1135 Run UniNEmulti5 Query 232: 0.0458 At 500 docs: 0.0512 Comparison to median by topic Query 233: 0.4176 At 1000 docs: 0.0278 Query 234: 0.0527 +1.0 Query 235: 0.0944 R-Precision (prec. after R Query 236: 0.6235 (=num_rel) docs. retrieved): Query 237: 0.4574 Exact: 0.3250 Query 238: 0.3006 Query 239: 0.0669 Query 240: 0.7708 +0.5 Query 241: 0.0134 Query 242: 0.6310 Query 243: 0.2529 Query 244: 0.0046 Query 245: 0.7902 Query 246: 0.2670 0.0 Query 247: 0.9823 Query 248: 0.5617 Query 249: 0.0161 Query 250: 0.0258 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number ILTG, Bilingual French to English, Auto, TDN Run ltrcbifren1 Average precision Overall statistics Recall−Precision Values (individual queries): (for 42 queries): 1.0 Query 201: 0.1765 Total number of documents Query 202: 0.6391 over all queries Query 204: 0.0504 Retrieved: 42000 Query 205: 0.1983 Relevant: 375 Query 206: 0.8667 Rel_ret: 257 0.8 Query 207: 0.0003 Query 208: 0.5000 Interpolated Recall - Query 209: 0.0000 Precision Averages: Query 210: 0.0345 at 0.00 0.4465 Query 211: 0.0055 at 0.10 0.4454 0.6 Query 212: 0.2478 at 0.20 0.4133 Query 213: 0.1049 at 0.30 0.3756 Query 214: 0.0186 at 0.40 0.3557 Precision Query 215: 0.0013 at 0.50 0.3536 Query 216: 0.0032 at 0.60 0.2988 0.4 Query 217: 0.5909 at 0.70 0.2616 Query 218: 0.1628 at 0.80 0.2450 Query 219: 0.0000 at 0.90 0.2228 Query 221: 1.0000 at 1.00 0.2005 Query 222: 0.0205 0.2 Query 223: 0.2500 Avg. prec. (non-interpolated) Query 224: 0.7733 for all rel. documents Query 226: 0.2687 0.3137 Query 228: 0.0000 Precision: Query 229: 0.0000 At 5 docs: 0.2571 0.0 Query 230: 0.4367 At 10 docs: 0.1738 0.0 0.2 0.4 0.6 0.8 1.0 Query 231: 0.0833 At 15 docs: 0.1460 Query 232: 0.0004 At 20 docs: 0.1298 Recall Query 233: 0.0029 At 30 docs: 0.1095 Query 235: 0.0436 At 100 docs: 0.0457 Query 236: 1.0000 At 200 docs: 0.0273 Run ltrcbifren1 Query 237: 1.0000 At 500 docs: 0.0118 Comparison to median by topic Query 238: 0.2572 At 1000 docs: 0.0061 Query 239: 0.1242 +1.0 Query 240: 0.7029 R-Precision (prec. after R Query 241: 0.0000 (=num_rel) docs. retrieved): Query 242: 1.0000 Exact: 0.3109 Query 245: 0.7926 Query 246: 1.0000 Query 247: 0.6792 +0.5 Query 248: 0.1226 Query 249: 0.0153 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number ILTG, Bilingual French to English, Auto, TDN Run ltrcbifren2 Average precision Overall statistics Recall−Precision Values (individual queries): (for 42 queries): 1.0 Query 201: 0.1608 Total number of documents Query 202: 0.6391 over all queries Query 204: 0.1185 Retrieved: 42000 Query 205: 0.4490 Relevant: 375 Query 206: 0.3833 Rel_ret: 262 0.8 Query 207: 0.0005 Query 208: 0.5000 Interpolated Recall - Query 209: 0.0000 Precision Averages: Query 210: 0.0099 at 0.00 0.4315 Query 211: 0.2350 at 0.10 0.4127 0.6 Query 212: 0.0856 at 0.20 0.3855 Query 213: 0.0580 at 0.30 0.3252 Query 214: 0.2167 at 0.40 0.3158 Precision Query 215: 0.0000 at 0.50 0.3079 Query 216: 0.0037 at 0.60 0.2632 0.4 Query 217: 0.2614 at 0.70 0.2455 Query 218: 0.7095 at 0.80 0.2267 Query 219: 0.0135 at 0.90 0.1832 Query 221: 1.0000 at 1.00 0.1650 Query 222: 0.0431 0.2 Query 223: 0.2540 Avg. prec. (non-interpolated) Query 224: 0.5633 for all rel. documents Query 226: 0.2687 0.2768 Query 228: 0.0000 Precision: Query 229: 0.0000 At 5 docs: 0.2381 0.0 Query 230: 0.5667 At 10 docs: 0.1833 0.0 0.2 0.4 0.6 0.8 1.0 Query 231: 0.0154 At 15 docs: 0.1587 Query 232: 0.0002 At 20 docs: 0.1429 Recall Query 233: 0.0010 At 30 docs: 0.1135 Query 235: 0.1581 At 100 docs: 0.0440 Query 236: 1.0000 At 200 docs: 0.0257 Run ltrcbifren2 Query 237: 1.0000 At 500 docs: 0.0119 Comparison to median by topic Query 238: 0.2636 At 1000 docs: 0.0062 Query 239: 0.0672 +1.0 Query 240: 0.7593 R-Precision (prec. after R Query 241: 0.0000 (=num_rel) docs. retrieved): Query 242: 0.0904 Exact: 0.2528 Query 245: 0.8088 Query 246: 0.5000 Query 247: 0.3742 +0.5 Query 248: 0.0222 Query 249: 0.0245 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number ILTG, Bilingual French to English, Auto, TDN Run ltrcbifren3 Average precision Overall statistics Recall−Precision Values (individual queries): (for 42 queries): 1.0 Query 201: 0.0619 Total number of documents Query 202: 0.5579 over all queries Query 204: 0.0556 Retrieved: 42000 Query 205: 0.1094 Relevant: 375 Query 206: 0.8667 Rel_ret: 289 0.8 Query 207: 0.2101 Query 208: 0.5000 Interpolated Recall - Query 209: 0.0170 Precision Averages: Query 210: 0.0063 at 0.00 0.4981 Query 211: 0.6968 at 0.10 0.4716 0.6 Query 212: 0.1949 at 0.20 0.4527 Query 213: 0.2327 at 0.30 0.4424 Query 214: 0.0186 at 0.40 0.4168 Precision Query 215: 0.0000 at 0.50 0.3998 Query 216: 0.4167 at 0.60 0.3439 0.4 Query 217: 0.0307 at 0.70 0.3144 Query 218: 0.8046 at 0.80 0.2869 Query 219: 0.0044 at 0.90 0.2511 Query 221: 0.8333 at 1.00 0.2246 Query 222: 0.0207 0.2 Query 223: 0.0009 Avg. prec. (non-interpolated) Query 224: 0.7774 for all rel. documents Query 226: 0.0079 0.3597 Query 228: 0.1667 Precision: Query 229: 0.2500 At 5 docs: 0.3238 0.0 Query 230: 0.6278 At 10 docs: 0.2429 0.0 0.2 0.4 0.6 0.8 1.0 Query 231: 0.1429 At 15 docs: 0.1968 Query 232: 0.0848 At 20 docs: 0.1702 Recall Query 233: 0.8637 At 30 docs: 0.1278 Query 235: 0.0004 At 100 docs: 0.0479 Query 236: 1.0000 At 200 docs: 0.0298 Run ltrcbifren3 Query 237: 1.0000 At 500 docs: 0.0133 Comparison to median by topic Query 238: 0.2456 At 1000 docs: 0.0069 Query 239: 0.0363 +1.0 Query 240: 0.6958 R-Precision (prec. after R Query 241: 0.0034 (=num_rel) docs. retrieved): Query 242: 1.0000 Exact: 0.3305 Query 245: 0.8657 Query 246: 0.5000 Query 247: 0.2734 +0.5 Query 248: 0.9167 Query 249: 0.0079 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number ILTG, Bilingual French to English, Auto, TDN Run ltrcbifren4 Average precision Overall statistics Recall−Precision Values (individual queries): (for 42 queries): 1.0 Query 201: 0.0636 Total number of documents Query 202: 0.1188 over all queries Query 204: 0.0556 Retrieved: 42000 Query 205: 0.4290 Relevant: 375 Query 206: 0.8667 Rel_ret: 254 0.8 Query 207: 0.0000 Query 208: 0.5000 Interpolated Recall - Query 209: 0.0000 Precision Averages: Query 210: 0.0303 at 0.00 0.4953 Query 211: 1.0000 at 0.10 0.4680 0.6 Query 212: 0.2228 at 0.20 0.4620 Query 213: 0.0879 at 0.30 0.4097 Query 214: 0.0929 at 0.40 0.4016 Precision Query 215: 0.0000 at 0.50 0.3942 Query 216: 0.0253 at 0.60 0.3204 0.4 Query 217: 0.1875 at 0.70 0.2835 Query 218: 0.8046 at 0.80 0.2517 Query 219: 0.0000 at 0.90 0.2246 Query 221: 1.0000 at 1.00 0.2190 Query 222: 0.0870 0.2 Query 223: 0.2534 Avg. prec. (non-interpolated) Query 224: 0.5511 for all rel. documents Query 226: 0.2687 0.3467 Query 228: 0.1667 Precision: Query 229: 0.2500 At 5 docs: 0.2762 0.0 Query 230: 0.7278 At 10 docs: 0.2143 0.0 0.2 0.4 0.6 0.8 1.0 Query 231: 0.0833 At 15 docs: 0.1714 Query 232: 0.0013 At 20 docs: 0.1417 Recall Query 233: 0.7418 At 30 docs: 0.1119 Query 235: 0.0000 At 100 docs: 0.0460 Query 236: 1.0000 At 200 docs: 0.0258 Run ltrcbifren4 Query 237: 1.0000 At 500 docs: 0.0114 Comparison to median by topic Query 238: 0.2408 At 1000 docs: 0.0060 Query 239: 0.0607 +1.0 Query 240: 0.7500 R-Precision (prec. after R Query 241: 0.0019 (=num_rel) docs. retrieved): Query 242: 1.0000 Exact: 0.3212 Query 245: 0.8187 Query 246: 0.5000 Query 247: 0.5592 +0.5 Query 248: 0.0042 Query 249: 0.0112 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number ILTG, Bilingual French to English, Auto, TDN Run ltrcbifren5 Average precision Overall statistics Recall−Precision Values (individual queries): (for 42 queries): 1.0 Query 201: 0.1317 Total number of documents Query 202: 0.1231 over all queries Query 204: 0.0556 Retrieved: 42000 Query 205: 0.3741 Relevant: 375 Query 206: 0.8667 Rel_ret: 284 0.8 Query 207: 0.1336 Query 208: 0.5000 Interpolated Recall - Query 209: 0.0170 Precision Averages: Query 210: 0.0049 at 0.00 0.6073 Query 211: 1.0000 at 0.10 0.5138 0.6 Query 212: 0.1873 at 0.20 0.4940 Query 213: 0.1987 at 0.30 0.4490 Query 214: 0.2000 at 0.40 0.4244 Precision Query 215: 0.0000 at 0.50 0.4205 Query 216: 0.3988 at 0.60 0.3418 0.4 Query 217: 0.0211 at 0.70 0.3141 Query 218: 0.8046 at 0.80 0.2798 Query 219: 0.0044 at 0.90 0.2339 Query 221: 0.8333 at 1.00 0.2252 Query 222: 0.1005 0.2 Query 223: 0.0164 Avg. prec. (non-interpolated) Query 224: 0.5511 for all rel. documents Query 226: 0.2687 0.3749 Query 228: 0.1667 Precision: Query 229: 0.2500 At 5 docs: 0.3286 0.0 Query 230: 0.6278 At 10 docs: 0.2452 0.0 0.2 0.4 0.6 0.8 1.0 Query 231: 0.0833 At 15 docs: 0.2016 Query 232: 0.1001 At 20 docs: 0.1667 Recall Query 233: 0.8148 At 30 docs: 0.1190 Query 235: 0.0000 At 100 docs: 0.0460 Query 236: 1.0000 At 200 docs: 0.0277 Run ltrcbifren5 Query 237: 1.0000 At 500 docs: 0.0125 Comparison to median by topic Query 238: 0.2408 At 1000 docs: 0.0068 Query 239: 0.1155 +1.0 Query 240: 0.6958 R-Precision (prec. after R Query 241: 0.0019 (=num_rel) docs. retrieved): Query 242: 1.0000 Exact: 0.3426 Query 245: 0.8657 Query 246: 0.5000 Query 247: 0.5592 +0.5 Query 248: 0.9167 Query 249: 0.0141 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number SICS, Bilingual Amharic to English, Manual, TD Run stockholmAmEnA Average precision Overall statistics Recall−Precision Values (individual queries): (for 42 queries): 1.0 Query 201: 0.1938 Total number of documents Query 202: 0.5525 over all queries Query 204: 0.0552 Retrieved: 42000 Query 205: 0.5170 Relevant: 375 Query 206: 0.6250 Rel_ret: 307 0.8 Query 207: 0.0020 Query 208: 1.0000 Interpolated Recall - Query 209: 0.0277 Precision Averages: Query 210: 0.0417 at 0.00 0.5150 Query 211: 1.0000 at 0.10 0.4961 0.6 Query 212: 0.0355 at 0.20 0.4896 Query 213: 0.2619 at 0.30 0.4392 Query 214: 0.0056 at 0.40 0.4181 Precision Query 215: 1.0000 at 0.50 0.4043 Query 216: 0.5076 at 0.60 0.3964 0.4 Query 217: 0.0019 at 0.70 0.3732 Query 218: 0.6315 at 0.80 0.3664 Query 219: 0.0179 at 0.90 0.3460 Query 221: 1.0000 at 1.00 0.3276 Query 222: 0.0199 0.2 Query 223: 0.0698 Avg. prec. (non-interpolated) Query 224: 0.7661 for all rel. documents Query 226: 0.2599 0.4009 Query 228: 0.0000 Precision: Query 229: 0.5000 At 5 docs: 0.2571 0.0 Query 230: 0.4476 At 10 docs: 0.2024 0.0 0.2 0.4 0.6 0.8 1.0 Query 231: 0.2000 At 15 docs: 0.1810 Query 232: 0.0451 At 20 docs: 0.1619 Recall Query 233: 0.0005 At 30 docs: 0.1270 Query 235: 0.1989 At 100 docs: 0.0521 Query 236: 0.9167 At 200 docs: 0.0287 Run stockholmAmEnA Query 237: 1.0000 At 500 docs: 0.0135 Comparison to median by topic Query 238: 0.2793 At 1000 docs: 0.0073 Query 239: 0.0024 +1.0 Query 240: 0.8139 R-Precision (prec. after R Query 241: 0.0117 (=num_rel) docs. retrieved): Query 242: 0.2041 Exact: 0.3663 Query 245: 0.7519 Query 246: 1.0000 Query 247: 1.0000 +0.5 Query 248: 0.8667 Query 249: 0.0070 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number SICS, Bilingual Amharic to English, Manual, TD Run stockholmAmEnI Average precision Overall statistics Recall−Precision Values (individual queries): (for 42 queries): 1.0 Query 201: 0.0636 Total number of documents Query 202: 0.5575 over all queries Query 204: 0.0546 Retrieved: 42000 Query 205: 0.5170 Relevant: 375 Query 206: 0.5917 Rel_ret: 297 0.8 Query 207: 0.0013 Query 208: 0.7000 Interpolated Recall - Query 209: 0.0276 Precision Averages: Query 210: 0.0417 at 0.00 0.4799 Query 211: 1.0000 at 0.10 0.4597 0.6 Query 212: 0.0405 at 0.20 0.4535 Query 213: 0.2587 at 0.30 0.4074 Query 214: 0.0021 at 0.40 0.3863 Precision Query 215: 1.0000 at 0.50 0.3724 Query 216: 0.5208 at 0.60 0.3458 0.4 Query 217: 0.0019 at 0.70 0.3356 Query 218: 0.6254 at 0.80 0.3273 Query 219: 0.0116 at 0.90 0.3109 Query 221: 0.3667 at 1.00 0.2961 Query 222: 0.0000 0.2 Query 223: 0.0686 Avg. prec. (non-interpolated) Query 224: 0.7661 for all rel. documents Query 226: 0.2630 0.3615 Query 228: 0.0000 Precision: Query 229: 0.5000 At 5 docs: 0.2619 0.0 Query 230: 0.4476 At 10 docs: 0.1952 0.0 0.2 0.4 0.6 0.8 1.0 Query 231: 0.0526 At 15 docs: 0.1698 Query 232: 0.0444 At 20 docs: 0.1560 Recall Query 233: 0.0009 At 30 docs: 0.1183 Query 235: 0.0000 At 100 docs: 0.0462 Query 236: 0.9167 At 200 docs: 0.0269 Run stockholmAmEnI Query 237: 1.0000 At 500 docs: 0.0126 Comparison to median by topic Query 238: 0.2448 At 1000 docs: 0.0071 Query 239: 0.0227 +1.0 Query 240: 0.8139 R-Precision (prec. after R Query 241: 0.0178 (=num_rel) docs. retrieved): Query 242: 0.2416 Exact: 0.3251 Query 245: 0.7519 Query 246: 1.0000 Query 247: 1.0000 +0.5 Query 248: 0.6389 Query 249: 0.0093 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Amsterdam, Bilingual Amharic to English, Auto, TD Run UAmsC04AmEn4GiSb Average precision Overall statistics Recall−Precision Values (individual queries): (for 42 queries): 1.0 Query 201: 0.1987 Total number of documents Query 202: 0.2073 over all queries Query 204: 0.2661 Retrieved: 42000 Query 205: 0.3307 Relevant: 375 Query 206: 0.2241 Rel_ret: 330 0.8 Query 207: 0.1144 Query 208: 0.0486 Interpolated Recall - Query 209: 0.0493 Precision Averages: Query 210: 0.0526 at 0.00 0.4877 Query 211: 1.0000 at 0.10 0.4536 0.6 Query 212: 0.0150 at 0.20 0.4286 Query 213: 0.0533 at 0.30 0.3670 Query 214: 0.0276 at 0.40 0.3453 Precision Query 215: 0.0333 at 0.50 0.3308 Query 216: 0.0133 at 0.60 0.3126 0.4 Query 217: 0.0173 at 0.70 0.2687 Query 218: 0.7852 at 0.80 0.2519 Query 219: 0.0000 at 0.90 0.2320 Query 221: 1.0000 at 1.00 0.2097 Query 222: 0.4259 0.2 Query 223: 0.2190 Avg. prec. (non-interpolated) Query 224: 0.7951 for all rel. documents Query 226: 0.0036 0.3207 Query 228: 0.0000 Precision: Query 229: 0.8333 At 5 docs: 0.2905 0.0 Query 230: 0.8242 At 10 docs: 0.2310 0.0 0.2 0.4 0.6 0.8 1.0 Query 231: 0.5000 At 15 docs: 0.1841 Query 232: 0.3983 At 20 docs: 0.1571 Recall Query 233: 0.3483 At 30 docs: 0.1167 Query 235: 0.6111 At 100 docs: 0.0514 Query 236: 0.0857 At 200 docs: 0.0312 Run UAmsC04AmEn4GiSb Query 237: 1.0000 At 500 docs: 0.0147 Comparison to median by topic Query 238: 0.1063 At 1000 docs: 0.0079 Query 239: 0.0253 +1.0 Query 240: 0.8734 R-Precision (prec. after R Query 241: 0.0111 (=num_rel) docs. retrieved): Query 242: 0.0183 Exact: 0.2863 Query 245: 0.6161 Query 246: 0.5000 Query 247: 0.4951 +0.5 Query 248: 0.3048 Query 249: 0.0380 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Amsterdam, Bilingual Amharic to English, Auto, TD Run UAmsC04AmEnAll Average precision Overall statistics Recall−Precision Values (individual queries): (for 42 queries): 1.0 Query 201: 0.4261 Total number of documents Query 202: 0.1153 over all queries Query 204: 0.2789 Retrieved: 42000 Query 205: 0.4871 Relevant: 375 Query 206: 0.2106 Rel_ret: 345 0.8 Query 207: 0.2126 Query 208: 0.5833 Interpolated Recall - Query 209: 0.0304 Precision Averages: Query 210: 0.0769 at 0.00 0.5017 Query 211: 1.0000 at 0.10 0.4618 0.6 Query 212: 0.0102 at 0.20 0.4456 Query 213: 0.0200 at 0.30 0.3888 Query 214: 0.0230 at 0.40 0.3626 Precision Query 215: 0.2500 at 0.50 0.3432 Query 216: 0.0142 at 0.60 0.3382 0.4 Query 217: 0.0101 at 0.70 0.3022 Query 218: 0.9421 at 0.80 0.2921 Query 219: 0.0000 at 0.90 0.2756 Query 221: 1.0000 at 1.00 0.2622 Query 222: 0.5900 0.2 Query 223: 0.2153 Avg. prec. (non-interpolated) Query 224: 0.8028 for all rel. documents Query 226: 0.0027 0.3470 Query 228: 0.0000 Precision: Query 229: 1.0000 At 5 docs: 0.2905 0.0 Query 230: 0.8254 At 10 docs: 0.2167 0.0 0.2 0.4 0.6 0.8 1.0 Query 231: 1.0000 At 15 docs: 0.1794 Query 232: 0.3580 At 20 docs: 0.1476 Recall Query 233: 0.0973 At 30 docs: 0.1111 Query 235: 0.1800 At 100 docs: 0.0483 Query 236: 0.1514 At 200 docs: 0.0304 Run UAmsC04AmEnAll Query 237: 1.0000 At 500 docs: 0.0152 Comparison to median by topic Query 238: 0.0618 At 1000 docs: 0.0082 Query 239: 0.0237 +1.0 Query 240: 0.9306 R-Precision (prec. after R Query 241: 0.0169 (=num_rel) docs. retrieved): Query 242: 0.0168 Exact: 0.3253 Query 245: 0.7464 Query 246: 0.0714 Query 247: 0.5000 +0.5 Query 248: 0.2106 Query 249: 0.0802 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Amsterdam, Bilingual Amharic to English, Auto, TD Run UAmsC04AmEnWrd Average precision Overall statistics Recall−Precision Values (individual queries): (for 42 queries): 1.0 Query 201: 0.4407 Total number of documents Query 202: 0.0064 over all queries Query 204: 0.0257 Retrieved: 42000 Query 205: 0.0796 Relevant: 375 Query 206: 0.0159 Rel_ret: 187 0.8 Query 207: 0.0400 Query 208: 0.0625 Interpolated Recall - Query 209: 0.0000 Precision Averages: Query 210: 0.1111 at 0.00 0.3016 Query 211: 1.0000 at 0.10 0.2849 0.6 Query 212: 0.0009 at 0.20 0.2663 Query 213: 0.0003 at 0.30 0.2476 Query 214: 0.0138 at 0.40 0.2158 Precision Query 215: 0.3333 at 0.50 0.2101 Query 216: 0.0000 at 0.60 0.1907 0.4 Query 217: 0.0012 at 0.70 0.1779 Query 218: 0.0250 at 0.80 0.1709 Query 219: 0.0000 at 0.90 0.1512 Query 221: 1.0000 at 1.00 0.1385 Query 222: 0.4167 0.2 Query 223: 0.1595 Avg. prec. (non-interpolated) Query 224: 0.7805 for all rel. documents Query 226: 0.0003 0.2071 Query 228: 0.0000 Precision: Query 229: 0.8333 At 5 docs: 0.1905 0.0 Query 230: 0.8909 At 10 docs: 0.1405 0.0 0.2 0.4 0.6 0.8 1.0 Query 231: 0.1429 At 15 docs: 0.1127 Query 232: 0.5135 At 20 docs: 0.0976 Recall Query 233: 0.0012 At 30 docs: 0.0738 Query 235: 0.0003 At 100 docs: 0.0307 Query 236: 0.1111 At 200 docs: 0.0171 Run UAmsC04AmEnWrd Query 237: 0.3333 At 500 docs: 0.0080 Comparison to median by topic Query 238: 0.0001 At 1000 docs: 0.0045 Query 239: 0.0154 +1.0 Query 240: 0.8972 R-Precision (prec. after R Query 241: 0.0238 (=num_rel) docs. retrieved): Query 242: 0.0000 Exact: 0.1876 Query 245: 0.0000 Query 246: 0.0000 Query 247: 0.3992 +0.5 Query 248: 0.0100 Query 249: 0.0103 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Oviedo, Bilingual Spanish to English, Auto, TD Run uoviESEN Average precision Overall statistics Recall−Precision Values (individual queries): (for 42 queries): 1.0 Query 201: 0.0001 Total number of documents Query 202: 0.1477 over all queries Query 204: 0.0047 Retrieved: 42000 Query 205: 0.1246 Relevant: 375 Query 206: 0.0054 Rel_ret: 145 0.8 Query 207: 0.0008 Query 208: 0.4167 Interpolated Recall - Query 209: 0.0247 Precision Averages: Query 210: 0.0000 at 0.00 0.1868 Query 211: 0.1247 at 0.10 0.1314 0.6 Query 212: 0.0000 at 0.20 0.1166 Query 213: 0.0295 at 0.30 0.0818 Query 214: 0.0000 at 0.40 0.0770 Precision Query 215: 0.0000 at 0.50 0.0676 Query 216: 0.0000 at 0.60 0.0495 0.4 Query 217: 0.0016 at 0.70 0.0219 Query 218: 0.3360 at 0.80 0.0177 Query 219: 0.0068 at 0.90 0.0150 Query 221: 0.0100 at 1.00 0.0150 Query 222: 0.0008 0.2 Query 223: 0.1006 Avg. prec. (non-interpolated) Query 224: 0.1375 for all rel. documents Query 226: 0.0000 0.0644 Query 228: 0.0054 Precision: Query 229: 0.0000 At 5 docs: 0.0810 0.0 Query 230: 0.1076 At 10 docs: 0.0619 0.0 0.2 0.4 0.6 0.8 1.0 Query 231: 0.0172 At 15 docs: 0.0524 Query 232: 0.0017 At 20 docs: 0.0464 Recall Query 233: 0.0053 At 30 docs: 0.0381 Query 235: 0.0000 At 100 docs: 0.0162 Query 236: 0.0000 At 200 docs: 0.0108 Run uoviESEN Query 237: 0.0526 At 500 docs: 0.0057 Comparison to median by topic Query 238: 0.1041 At 1000 docs: 0.0035 Query 239: 0.0546 +1.0 Query 240: 0.0083 R-Precision (prec. after R Query 241: 0.0000 (=num_rel) docs. retrieved): Query 242: 0.0357 Exact: 0.0816 Query 245: 0.1154 Query 246: 0.0095 Query 247: 0.0000 +0.5 Query 248: 0.7167 Query 249: 0.0000 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number JHU/APL, Bilingual German to French, Auto, TD Run aplbidefra Average precision Overall statistics (individual queries): (for 49 queries): Recall−Precision Values 1.0 Query 201: 0.1463 Total number of documents Query 202: 0.5612 over all queries Query 203: 0.4642 Retrieved: 49000 Query 204: 0.7273 Relevant: 915 Query 205: 0.0495 Rel_ret: 770 0.8 Query 206: 0.4100 Query 207: 0.2295 Interpolated Recall - Query 208: 0.0008 Precision Averages: Query 209: 0.2049 at 0.00 0.4891 Query 210: 0.1036 at 0.10 0.4583 0.6 Query 211: 0.8121 at 0.20 0.4207 Query 212: 0.4823 at 0.30 0.3911 Query 213: 0.5456 at 0.40 0.3625 Precision Query 214: 0.1845 at 0.50 0.3280 Query 215: 0.2557 at 0.60 0.3114 0.4 Query 216: 0.0140 at 0.70 0.2678 Query 217: 0.2561 at 0.80 0.2207 Query 218: 0.8703 at 0.90 0.1619 Query 219: 0.5500 at 1.00 0.1001 Query 220: 0.0047 0.2 Query 221: 0.7367 Avg. prec. (non-interpolated) Query 222: 0.0282 for all rel. documents Query 223: 0.0431 0.3030 Query 224: 0.0995 Precision: Query 225: 0.0035 At 5 docs: 0.3388 0.0 Query 226: 0.0233 At 10 docs: 0.3122 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.0128 At 15 docs: 0.2966 Query 229: 0.5132 At 20 docs: 0.2704 Recall Query 230: 0.7587 At 30 docs: 0.2476 Query 231: 0.1795 At 100 docs: 0.1220 Query 232: 0.0000 At 200 docs: 0.0700 Run aplbidefra Query 233: 0.5688 At 500 docs: 0.0305 Query 234: 0.0704 At 1000 docs: 0.0157 Comparison to median by topic Query 235: 0.4903 +1.0 Query 236: 0.5473 R-Precision (prec. after R Query 237: 0.7984 (=num_rel) docs. retrieved): Query 238: 0.3682 Exact: 0.2906 Query 239: 0.0022 Query 240: 0.0476 Query 241: 0.0001 +0.5 Query 242: 0.1724 Query 243: 0.4158 Query 244: 0.0043 Query 245: 0.7643 Query 246: 0.0264 Query 247: 0.4102 Query 248: 0.7183 0.0 Query 249: 0.0526 Query 250: 0.1166 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number JHU/APL, Bilingual Dutch to French, Auto, TD Run aplbinlfra Average precision Overall statistics (individual queries): (for 49 queries): Recall−Precision Values 1.0 Query 201: 0.1987 Total number of documents Query 202: 0.5772 over all queries Query 203: 0.4565 Retrieved: 49000 Query 204: 0.8333 Relevant: 915 Query 205: 0.0511 Rel_ret: 845 0.8 Query 206: 0.3367 Query 207: 0.0838 Interpolated Recall - Query 208: 0.8042 Precision Averages: Query 209: 0.2325 at 0.00 0.5921 Query 210: 0.1738 at 0.10 0.5673 0.6 Query 211: 0.7898 at 0.20 0.5375 Query 212: 0.5795 at 0.30 0.4633 Query 213: 0.3344 at 0.40 0.4105 Precision Query 214: 0.1355 at 0.50 0.3863 Query 215: 0.0488 at 0.60 0.3715 0.4 Query 216: 0.4308 at 0.70 0.3174 Query 217: 0.5191 at 0.80 0.2814 Query 218: 0.8829 at 0.90 0.2305 Query 219: 0.5206 at 1.00 0.1732 Query 220: 0.0065 0.2 Query 221: 0.7381 Avg. prec. (non-interpolated) Query 222: 0.0186 for all rel. documents Query 223: 0.0221 0.3753 Query 224: 0.6631 Precision: Query 225: 0.0286 At 5 docs: 0.3837 0.0 Query 226: 0.0021 At 10 docs: 0.3143 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.1203 At 15 docs: 0.2871 Query 229: 0.0265 At 20 docs: 0.2724 Recall Query 230: 0.6264 At 30 docs: 0.2463 Query 231: 0.1877 At 100 docs: 0.1255 Query 232: 0.2690 At 200 docs: 0.0748 Run aplbinlfra Query 233: 0.6486 At 500 docs: 0.0332 Query 234: 0.5161 At 1000 docs: 0.0172 Comparison to median by topic Query 235: 0.2773 +1.0 Query 236: 0.2970 R-Precision (prec. after R Query 237: 0.7724 (=num_rel) docs. retrieved): Query 238: 0.4661 Exact: 0.3769 Query 239: 0.0409 Query 240: 1.0000 Query 241: 0.0001 +0.5 Query 242: 0.1409 Query 243: 0.1212 Query 244: 1.0000 Query 245: 0.7900 Query 246: 0.1820 Query 247: 0.6782 Query 248: 0.6250 0.0 Query 249: 0.0455 Query 250: 0.0891 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Daedalus, Bilingual German to French, Auto, TD Run de2frcomb1s101 Average precision Overall statistics Recall−Precision Values (individual queries): (for 49 queries): 1.0 Query 201: 0.0054 Total number of documents Query 202: 0.6255 over all queries Query 203: 0.5256 Retrieved: 49000 Query 204: 0.5360 Relevant: 915 Query 205: 0.5160 Rel_ret: 749 0.8 Query 206: 0.4842 Query 207: 0.3473 Interpolated Recall - Query 208: 0.7333 Precision Averages: Query 209: 0.0150 at 0.00 0.5381 Query 210: 0.0754 at 0.10 0.4855 0.6 Query 211: 0.6640 at 0.20 0.4351 Query 212: 0.2042 at 0.30 0.4013 Query 213: 0.8145 at 0.40 0.3583 Precision Query 214: 0.1020 at 0.50 0.3310 Query 215: 0.0715 at 0.60 0.2965 0.4 Query 216: 0.0072 at 0.70 0.2647 Query 217: 0.3516 at 0.80 0.2190 Query 218: 0.8768 at 0.90 0.1806 Query 219: 0.0101 at 1.00 0.1241 Query 220: 0.2317 0.2 Query 221: 0.3978 Avg. prec. (non-interpolated) Query 222: 0.0060 for all rel. documents Query 223: 0.0213 0.3166 Query 224: 0.7663 Precision: Query 225: 0.0135 At 5 docs: 0.3347 0.0 Query 226: 0.0385 At 10 docs: 0.2959 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.0552 At 15 docs: 0.2667 Query 229: 0.5019 At 20 docs: 0.2500 Recall Query 230: 0.0265 At 30 docs: 0.2156 Query 231: 0.2791 At 100 docs: 0.1051 Query 232: 0.0178 At 200 docs: 0.0621 Run de2frcomb1s101 Query 233: 0.4790 At 500 docs: 0.0288 Comparison to median by topic Query 234: 0.3502 At 1000 docs: 0.0153 Query 235: 0.0000 +1.0 Query 236: 0.5736 R-Precision (prec. after R Query 237: 0.8819 (=num_rel) docs. retrieved): Query 238: 0.4226 Exact: 0.3013 Query 239: 0.0465 Query 240: 1.0000 Query 241: 0.0030 +0.5 Query 242: 0.3691 Query 243: 0.6333 Query 244: 0.0012 Query 245: 0.9167 Query 246: 0.1483 Query 247: 0.1301 Query 248: 0.2087 0.0 Query 249: 0.0294 Query 250: 0.0000 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Daedalus, Bilingual German to French, Auto, TD Run de2frcomb2s201 Average precision Overall statistics Recall−Precision Values (individual queries): (for 49 queries): 1.0 Query 201: 0.0092 Total number of documents Query 202: 0.6184 over all queries Query 203: 0.4833 Retrieved: 49000 Query 204: 0.5778 Relevant: 915 Query 205: 0.5075 Rel_ret: 759 0.8 Query 206: 0.4524 Query 207: 0.3144 Interpolated Recall - Query 208: 0.6917 Precision Averages: Query 209: 0.0099 at 0.00 0.5265 Query 210: 0.0944 at 0.10 0.4736 0.6 Query 211: 0.6661 at 0.20 0.4360 Query 212: 0.1219 at 0.30 0.4007 Query 213: 0.8043 at 0.40 0.3551 Precision Query 214: 0.0715 at 0.50 0.3287 Query 215: 0.0717 at 0.60 0.2924 0.4 Query 216: 0.0146 at 0.70 0.2606 Query 217: 0.2948 at 0.80 0.2144 Query 218: 0.8792 at 0.90 0.1773 Query 219: 0.0136 at 1.00 0.1265 Query 220: 0.2630 0.2 Query 221: 0.4060 Avg. prec. (non-interpolated) Query 222: 0.0096 for all rel. documents Query 223: 0.0270 0.3116 Query 224: 0.6931 Precision: Query 225: 0.0127 At 5 docs: 0.3388 0.0 Query 226: 0.0204 At 10 docs: 0.2939 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.0617 At 15 docs: 0.2680 Query 229: 0.4741 At 20 docs: 0.2500 Recall Query 230: 0.0708 At 30 docs: 0.2129 Query 231: 0.2812 At 100 docs: 0.1108 Query 232: 0.0413 At 200 docs: 0.0651 Run de2frcomb2s201 Query 233: 0.4917 At 500 docs: 0.0290 Comparison to median by topic Query 234: 0.3362 At 1000 docs: 0.0155 Query 235: 0.0002 +1.0 Query 236: 0.5586 R-Precision (prec. after R Query 237: 0.8893 (=num_rel) docs. retrieved): Query 238: 0.3975 Exact: 0.3051 Query 239: 0.0659 Query 240: 1.0000 Query 241: 0.0006 +0.5 Query 242: 0.3635 Query 243: 0.6105 Query 244: 0.0000 Query 245: 0.9167 Query 246: 0.1635 Query 247: 0.0937 Query 248: 0.2938 0.0 Query 249: 0.0286 Query 250: 0.0001 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Daedalus, Bilingual German to French, Auto, TD Run de2frR2FWnormal Average precision Overall statistics Recall−Precision Values (individual queries): (for 49 queries): 1.0 Query 201: 0.0093 Total number of documents Query 202: 0.6290 over all queries Query 203: 0.5995 Retrieved: 49000 Query 204: 0.5510 Relevant: 915 Query 205: 0.5019 Rel_ret: 732 0.8 Query 206: 0.4780 Query 207: 0.3512 Interpolated Recall - Query 208: 0.7708 Precision Averages: Query 209: 0.0144 at 0.00 0.5485 Query 210: 0.1023 at 0.10 0.4988 0.6 Query 211: 0.6696 at 0.20 0.4469 Query 212: 0.1722 at 0.30 0.4067 Query 213: 0.8148 at 0.40 0.3608 Precision Query 214: 0.1030 at 0.50 0.3360 Query 215: 0.0714 at 0.60 0.3028 0.4 Query 216: 0.0114 at 0.70 0.2640 Query 217: 0.3329 at 0.80 0.2185 Query 218: 0.8768 at 0.90 0.1825 Query 219: 0.0190 at 1.00 0.1263 Query 220: 0.3041 0.2 Query 221: 0.3876 Avg. prec. (non-interpolated) Query 222: 0.0079 for all rel. documents Query 223: 0.0226 0.3201 Query 224: 0.7663 Precision: Query 225: 0.0137 At 5 docs: 0.3429 0.0 Query 226: 0.0370 At 10 docs: 0.2918 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.0574 At 15 docs: 0.2789 Query 229: 0.4643 At 20 docs: 0.2541 Recall Query 230: 0.0423 At 30 docs: 0.2170 Query 231: 0.1560 At 100 docs: 0.1073 Query 232: 0.0012 At 200 docs: 0.0629 Run de2frR2FWnormal Query 233: 0.4779 At 500 docs: 0.0281 Comparison to median by topic Query 234: 0.3344 At 1000 docs: 0.0149 Query 235: 0.0000 +1.0 Query 236: 0.4839 R-Precision (prec. after R Query 237: 0.8819 (=num_rel) docs. retrieved): Query 238: 0.4226 Exact: 0.3059 Query 239: 0.0423 Query 240: 1.0000 Query 241: 0.0051 +0.5 Query 242: 0.4854 Query 243: 0.6277 Query 244: 0.0000 Query 245: 0.9167 Query 246: 0.1253 Query 247: 0.2597 Query 248: 0.2552 0.0 Query 249: 0.0270 Query 250: 0.0000 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Daedalus, Bilingual German to French, Auto, TD Run de2frR3FWnormal Average precision Overall statistics Recall−Precision Values (individual queries): (for 49 queries): 1.0 Query 201: 0.0054 Total number of documents Query 202: 0.6255 over all queries Query 203: 0.5256 Retrieved: 49000 Query 204: 0.5360 Relevant: 915 Query 205: 0.5160 Rel_ret: 749 0.8 Query 206: 0.4842 Query 207: 0.3116 Interpolated Recall - Query 208: 0.7333 Precision Averages: Query 209: 0.0150 at 0.00 0.5340 Query 210: 0.0754 at 0.10 0.4957 0.6 Query 211: 0.6640 at 0.20 0.4419 Query 212: 0.2042 at 0.30 0.4081 Query 213: 0.8145 at 0.40 0.3651 Precision Query 214: 0.1020 at 0.50 0.3378 Query 215: 0.0715 at 0.60 0.2965 0.4 Query 216: 0.0072 at 0.70 0.2647 Query 217: 0.3738 at 0.80 0.2190 Query 218: 0.8768 at 0.90 0.1806 Query 219: 0.0101 at 1.00 0.1241 Query 220: 0.2317 0.2 Query 221: 0.3978 Avg. prec. (non-interpolated) Query 222: 0.0060 for all rel. documents Query 223: 0.0213 0.3199 Query 224: 0.7663 Precision: Query 225: 0.0135 At 5 docs: 0.3347 0.0 Query 226: 0.0385 At 10 docs: 0.2959 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.0552 At 15 docs: 0.2667 Query 229: 0.4662 At 20 docs: 0.2500 Recall Query 230: 0.0265 At 30 docs: 0.2156 Query 231: 0.2791 At 100 docs: 0.1051 Query 232: 0.0178 At 200 docs: 0.0621 Run de2frR3FWnormal Query 233: 0.4790 At 500 docs: 0.0288 Comparison to median by topic Query 234: 0.3502 At 1000 docs: 0.0153 Query 235: 0.0000 +1.0 Query 236: 0.5736 R-Precision (prec. after R Query 237: 0.8819 (=num_rel) docs. retrieved): Query 238: 0.4226 Exact: 0.3013 Query 239: 0.0465 Query 240: 1.0000 Query 241: 0.0030 +0.5 Query 242: 0.5775 Query 243: 0.6333 Query 244: 0.0012 Query 245: 0.9167 Query 246: 0.1483 Query 247: 0.1301 Query 248: 0.2087 0.0 Query 249: 0.0294 Query 250: 0.0000 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Dublin City University, Bilingual German to French, Auto, TD Run exefrde04a Average precision Overall statistics Recall−Precision Values (individual queries): (for 49 queries): 1.0 Query 201: 0.0006 Total number of documents Query 202: 0.7088 over all queries Query 203: 0.0054 Retrieved: 49000 Query 204: 0.7151 Relevant: 915 Query 205: 0.1464 Rel_ret: 704 0.8 Query 206: 0.4734 Query 207: 0.2345 Interpolated Recall - Query 208: 0.8042 Precision Averages: Query 209: 0.0000 at 0.00 0.4662 Query 210: 0.0082 at 0.10 0.4393 0.6 Query 211: 0.8649 at 0.20 0.4154 Query 212: 0.0904 at 0.30 0.3623 Query 213: 0.7347 at 0.40 0.3303 Precision Query 214: 0.0896 at 0.50 0.3150 Query 215: 0.0435 at 0.60 0.2921 0.4 Query 216: 0.0065 at 0.70 0.2585 Query 217: 0.4321 at 0.80 0.2216 Query 218: 0.9062 at 0.90 0.1772 Query 219: 0.0114 at 1.00 0.1221 Query 220: 0.0697 0.2 Query 221: 0.5591 Avg. prec. (non-interpolated) Query 222: 0.0008 for all rel. documents Query 223: 0.0267 0.2990 Query 224: 0.8722 Precision: Query 225: 0.0000 At 5 docs: 0.3265 0.0 Query 226: 0.0270 At 10 docs: 0.2653 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.0115 At 15 docs: 0.2503 Query 229: 0.5147 At 20 docs: 0.2347 Recall Query 230: 0.0184 At 30 docs: 0.1980 Query 231: 0.0343 At 100 docs: 0.0998 Query 232: 0.0048 At 200 docs: 0.0590 Run exefrde04a Query 233: 0.5572 At 500 docs: 0.0267 Comparison to median by topic Query 234: 0.3435 At 1000 docs: 0.0144 Query 235: 0.0002 +1.0 Query 236: 0.3718 R-Precision (prec. after R Query 237: 0.8118 (=num_rel) docs. retrieved): Query 238: 0.3510 Exact: 0.2830 Query 239: 0.0298 Query 240: 1.0000 Query 241: 0.0000 +0.5 Query 242: 0.2958 Query 243: 0.5241 Query 244: 0.0000 Query 245: 0.8750 Query 246: 0.2143 Query 247: 0.1779 Query 248: 0.5394 0.0 Query 249: 0.1429 Query 250: 0.0000 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Dublin City University, Bilingual German to French, Auto, TD Run exefrde04q Average precision Overall statistics (individual queries): (for 49 queries): Recall−Precision Values 1.0 Query 201: 0.0006 Total number of documents Query 202: 0.7020 over all queries Query 203: 0.0127 Retrieved: 49000 Query 204: 0.7254 Relevant: 915 Query 205: 0.1552 Rel_ret: 713 0.8 Query 206: 0.4646 Query 207: 0.2422 Interpolated Recall - Query 208: 0.8042 Precision Averages: Query 209: 0.0000 at 0.00 0.4483 Query 210: 0.0127 at 0.10 0.4250 0.6 Query 211: 0.8731 at 0.20 0.4002 Query 212: 0.0986 at 0.30 0.3726 Query 213: 0.7486 at 0.40 0.3333 Precision Query 214: 0.0024 at 0.50 0.3183 Query 215: 0.0415 at 0.60 0.2930 0.4 Query 216: 0.0095 at 0.70 0.2662 Query 217: 0.4083 at 0.80 0.2275 Query 218: 0.9023 at 0.90 0.1707 Query 219: 0.0115 at 1.00 0.1180 Query 220: 0.0761 0.2 Query 221: 0.5392 Avg. prec. (non-interpolated) Query 222: 0.0007 for all rel. documents Query 223: 0.0286 0.2963 Query 224: 0.8722 Precision: Query 225: 0.0000 At 5 docs: 0.3102 0.0 Query 226: 0.0179 At 10 docs: 0.2653 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.0123 At 15 docs: 0.2408 Query 229: 0.5234 At 20 docs: 0.2224 Recall Query 230: 0.0536 At 30 docs: 0.1918 Query 231: 0.0083 At 100 docs: 0.0990 Query 232: 0.0113 At 200 docs: 0.0593 Run exefrde04q Query 233: 0.5615 At 500 docs: 0.0270 Query 234: 0.3486 At 1000 docs: 0.0146 Comparison to median by topic Query 235: 0.0000 +1.0 Query 236: 0.4658 R-Precision (prec. after R Query 237: 0.8113 (=num_rel) docs. retrieved): Query 238: 0.3318 Exact: 0.2771 Query 239: 0.0114 Query 240: 1.0000 Query 241: 0.0000 +0.5 Query 242: 0.3080 Query 243: 0.5347 Query 244: 0.0000 Query 245: 0.8750 Query 246: 0.2144 Query 247: 0.0183 Query 248: 0.5368 0.0 Query 249: 0.1429 Query 250: 0.0000 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Dublin City University, Bilingual German to French, Auto, TD Run exefrde04t Average precision Overall statistics Recall−Precision Values (individual queries): (for 49 queries): 1.0 Query 201: 0.0018 Total number of documents Query 202: 0.7314 over all queries Query 203: 0.0090 Retrieved: 49000 Query 204: 0.7277 Relevant: 915 Query 205: 0.2294 Rel_ret: 727 0.8 Query 206: 0.4973 Query 207: 0.2478 Interpolated Recall - Query 208: 0.7095 Precision Averages: Query 209: 0.0000 at 0.00 0.4579 Query 210: 0.0082 at 0.10 0.4251 0.6 Query 211: 0.8532 at 0.20 0.4054 Query 212: 0.0875 at 0.30 0.3637 Query 213: 0.7372 at 0.40 0.3317 Precision Query 214: 0.0029 at 0.50 0.3076 Query 215: 0.0399 at 0.60 0.2841 0.4 Query 216: 0.0095 at 0.70 0.2581 Query 217: 0.4007 at 0.80 0.2151 Query 218: 0.9039 at 0.90 0.1694 Query 219: 0.0108 at 1.00 0.1169 Query 220: 0.0687 0.2 Query 221: 0.5576 Avg. prec. (non-interpolated) Query 222: 0.0008 for all rel. documents Query 223: 0.0221 0.2945 Query 224: 0.8889 Precision: Query 225: 0.0000 At 5 docs: 0.3184 0.0 Query 226: 0.0222 At 10 docs: 0.2633 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.0128 At 15 docs: 0.2408 Query 229: 0.5016 At 20 docs: 0.2194 Recall Query 230: 0.0565 At 30 docs: 0.1946 Query 231: 0.0374 At 100 docs: 0.0978 Query 232: 0.0210 At 200 docs: 0.0598 Run exefrde04t Query 233: 0.5308 At 500 docs: 0.0276 Comparison to median by topic Query 234: 0.3506 At 1000 docs: 0.0148 Query 235: 0.0003 +1.0 Query 236: 0.4322 R-Precision (prec. after R Query 237: 0.8152 (=num_rel) docs. retrieved): Query 238: 0.3390 Exact: 0.2644 Query 239: 0.0117 Query 240: 1.0000 Query 241: 0.0000 +0.5 Query 242: 0.2958 Query 243: 0.5262 Query 244: 0.0000 Query 245: 0.8333 Query 246: 0.2176 Query 247: 0.0185 Query 248: 0.4618 0.0 Query 249: 0.2000 Query 250: 0.0000 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Dublin City University, Bilingual Dutch to French, Auto, TD Run exefrnl04a Average precision Overall statistics Recall−Precision Values (individual queries): (for 49 queries): 1.0 Query 201: 0.0733 Total number of documents Query 202: 0.6593 over all queries Query 203: 0.1670 Retrieved: 49000 Query 204: 0.7869 Relevant: 915 Query 205: 0.2040 Rel_ret: 770 0.8 Query 206: 0.3803 Query 207: 0.3024 Interpolated Recall - Query 208: 0.5711 Precision Averages: Query 209: 0.0010 at 0.00 0.5215 Query 210: 0.0007 at 0.10 0.4669 0.6 Query 211: 0.8848 at 0.20 0.4566 Query 212: 0.0650 at 0.30 0.3877 Query 213: 0.6340 at 0.40 0.3593 Precision Query 214: 0.0002 at 0.50 0.3385 Query 215: 0.0423 at 0.60 0.3225 0.4 Query 216: 0.0105 at 0.70 0.3025 Query 217: 0.5562 at 0.80 0.2627 Query 218: 0.9194 at 0.90 0.2020 Query 219: 0.0209 at 1.00 0.1454 Query 220: 0.0033 0.2 Query 221: 0.4847 Avg. prec. (non-interpolated) Query 222: 0.0011 for all rel. documents Query 223: 0.0044 0.3339 Query 224: 0.9242 Precision: Query 225: 0.0037 At 5 docs: 0.3469 0.0 Query 226: 0.0015 At 10 docs: 0.2959 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.4328 At 15 docs: 0.2680 Query 229: 0.5281 At 20 docs: 0.2510 Recall Query 230: 0.8472 At 30 docs: 0.2156 Query 231: 0.5092 At 100 docs: 0.1133 Query 232: 0.0196 At 200 docs: 0.0653 Run exefrnl04a Query 233: 0.4759 At 500 docs: 0.0293 Comparison to median by topic Query 234: 0.0248 At 1000 docs: 0.0157 Query 235: 0.9333 +1.0 Query 236: 0.1803 R-Precision (prec. after R Query 237: 0.7809 (=num_rel) docs. retrieved): Query 238: 0.3708 Exact: 0.2977 Query 239: 0.0045 Query 240: 1.0000 Query 241: 0.0001 +0.5 Query 242: 0.0989 Query 243: 0.5262 Query 244: 0.0026 Query 245: 1.0000 Query 246: 0.0886 Query 247: 0.0111 Query 248: 0.7904 0.0 Query 249: 0.0333 Query 250: 0.0002 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Dublin City University, Bilingual Dutch to French, Auto, TD Run exefrnl04t Average precision Overall statistics Recall−Precision Values (individual queries): (for 49 queries): 1.0 Query 201: 0.0426 Total number of documents Query 202: 0.6871 over all queries Query 203: 0.1700 Retrieved: 49000 Query 204: 0.7784 Relevant: 915 Query 205: 0.2222 Rel_ret: 777 0.8 Query 206: 0.3832 Query 207: 0.3315 Interpolated Recall - Query 208: 0.6875 Precision Averages: Query 209: 0.0016 at 0.00 0.5097 Query 210: 0.0008 at 0.10 0.4603 0.6 Query 211: 0.8806 at 0.20 0.4475 Query 212: 0.0876 at 0.30 0.3772 Query 213: 0.5820 at 0.40 0.3577 Precision Query 214: 0.0001 at 0.50 0.3428 Query 215: 0.0385 at 0.60 0.3269 0.4 Query 216: 0.0106 at 0.70 0.3007 Query 217: 0.5053 at 0.80 0.2545 Query 218: 0.9118 at 0.90 0.2033 Query 219: 0.0210 at 1.00 0.1457 Query 220: 0.0037 0.2 Query 221: 0.4921 Avg. prec. (non-interpolated) Query 222: 0.0016 for all rel. documents Query 223: 0.0049 0.3312 Query 224: 0.9444 Precision: Query 225: 0.0041 At 5 docs: 0.3388 0.0 Query 226: 0.0017 At 10 docs: 0.2857 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.3997 At 15 docs: 0.2667 Query 229: 0.5325 At 20 docs: 0.2449 Recall Query 230: 0.8645 At 30 docs: 0.2136 Query 231: 0.4863 At 100 docs: 0.1114 Query 232: 0.0229 At 200 docs: 0.0641 Run exefrnl04t Query 233: 0.2974 At 500 docs: 0.0293 Comparison to median by topic Query 234: 0.0260 At 1000 docs: 0.0159 Query 235: 0.9056 +1.0 Query 236: 0.1333 R-Precision (prec. after R Query 237: 0.7895 (=num_rel) docs. retrieved): Query 238: 0.5190 Exact: 0.2992 Query 239: 0.0050 Query 240: 1.0000 Query 241: 0.0001 +0.5 Query 242: 0.0919 Query 243: 0.5301 Query 244: 0.0026 Query 245: 0.9167 Query 246: 0.0639 Query 247: 0.0105 Query 248: 0.8058 0.0 Query 249: 0.0286 Query 250: 0.0002 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Padua, Bilingual German to French, Auto, TD Run IMSBDEFRN100 Average precision Overall statistics Recall−Precision Values (individual queries): (for 49 queries): 1.0 Query 201: 0.0002 Total number of documents Query 202: 0.4183 over all queries Query 203: 0.1655 Retrieved: 45423 Query 204: 0.0007 Relevant: 915 0.8 Query 205: 0.0388 Rel_ret: 310 Query 206: 0.0005 Query 207: 0.0076 Interpolated Recall - Query 208: 0.0018 Precision Averages: Query 209: 0.0019 at 0.00 0.2594 Query 210: 0.0000 at 0.10 0.2482 0.6 Query 211: 0.0001 at 0.20 0.1970 Query 212: 0.0010 at 0.30 0.1618 Query 213: 0.0001 at 0.40 0.1546 Precision Query 214: 0.0005 at 0.50 0.1436 Query 215: 0.3109 at 0.60 0.1350 0.4 Query 216: 0.0000 at 0.70 0.1125 Query 217: 0.0000 at 0.80 0.0893 Query 218: 0.7862 at 0.90 0.0491 Query 219: 0.0000 at 1.00 0.0302 Query 220: 0.0000 0.2 Query 221: 0.1467 Avg. prec. (non-interpolated) Query 222: 0.0008 for all rel. documents Query 223: 0.0000 0.1384 Query 224: 0.0844 Precision: Query 225: 0.0000 At 5 docs: 0.1714 0.0 Query 226: 0.0019 At 10 docs: 0.1490 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.0009 At 15 docs: 0.1333 Query 229: 0.0044 At 20 docs: 0.1133 Recall Query 230: 0.5918 At 30 docs: 0.0864 Query 231: 0.0678 At 100 docs: 0.0390 Query 232: 0.0000 At 200 docs: 0.0232 Run IMSBDEFRN100 Query 233: 0.1848 At 500 docs: 0.0114 Comparison to median by topic Query 234: 0.0000 At 1000 docs: 0.0063 Query 235: 0.3396 +1.0 Query 236: 0.9573 R-Precision (prec. after R Query 237: 0.8831 (=num_rel) docs. retrieved): Query 238: 0.0456 Exact: 0.1378 Query 239: 0.0037 Query 240: 0.0000 Query 241: 0.0001 +0.5 Query 242: 0.0007 Query 243: 0.1191 Query 244: 0.0000 Query 245: 0.7562 Query 246: 0.0056 Query 247: 0.8542 0.0 Query 248: 0.0000 Query 249: 0.0000 Query 250: 0.0001 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Padua, Bilingual German to French, Auto, TD Run IMSBDEFRN50 Average precision Overall statistics Recall−Precision Values (individual queries): (for 49 queries): 1.0 Query 201: 0.0003 Total number of documents Query 202: 0.3958 over all queries Query 203: 0.1655 Retrieved: 46422 Query 204: 0.0007 Relevant: 915 Query 205: 0.0388 Rel_ret: 376 0.8 Query 206: 0.0000 Query 207: 0.0073 Interpolated Recall - Query 208: 0.0018 Precision Averages: Query 209: 0.0019 at 0.00 0.2749 Query 210: 0.0000 at 0.10 0.2364 0.6 Query 211: 0.0001 at 0.20 0.1892 Query 212: 0.0000 at 0.30 0.1669 Query 213: 0.1303 at 0.40 0.1603 Precision Query 214: 0.0001 at 0.50 0.1434 Query 215: 0.2533 at 0.60 0.1349 0.4 Query 216: 0.0000 at 0.70 0.1037 Query 217: 0.0000 at 0.80 0.0745 Query 218: 0.7916 at 0.90 0.0470 Query 219: 0.0000 at 1.00 0.0278 Query 220: 0.0000 0.2 Query 221: 0.1471 Avg. prec. (non-interpolated) Query 222: 0.0008 for all rel. documents Query 223: 0.0000 0.1349 Query 224: 0.0288 Precision: Query 225: 0.0000 At 5 docs: 0.1633 0.0 Query 226: 0.0019 At 10 docs: 0.1449 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.0009 At 15 docs: 0.1347 Query 229: 0.0044 At 20 docs: 0.1122 Recall Query 230: 0.5812 At 30 docs: 0.0925 Query 231: 0.0864 At 100 docs: 0.0431 Query 232: 0.0000 At 200 docs: 0.0259 Run IMSBDEFRN50 Query 233: 0.1841 At 500 docs: 0.0140 Comparison to median by topic Query 234: 0.0000 At 1000 docs: 0.0077 Query 235: 0.3396 +1.0 Query 236: 0.9573 R-Precision (prec. after R Query 237: 0.7952 (=num_rel) docs. retrieved): Query 238: 0.0456 Exact: 0.1374 Query 239: 0.0032 Query 240: 0.0000 Query 241: 0.0002 +0.5 Query 242: 0.0009 Query 243: 0.1194 Query 244: 0.0000 Query 245: 0.7583 Query 246: 0.0056 Query 247: 0.7584 Query 248: 0.0018 0.0 Query 249: 0.0000 Query 250: 0.0001 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Padua, Bilingual German to French, Auto, TD Run IMSBDEFRP100 Average precision Overall statistics Recall−Precision Values (individual queries): (for 49 queries): 1.0 Query 201: 0.0001 Total number of documents Query 202: 0.5251 over all queries Query 203: 0.2175 Retrieved: 46003 Query 204: 0.0005 Relevant: 915 0.8 Query 205: 0.0469 Rel_ret: 309 Query 206: 0.0017 Query 207: 0.0066 Interpolated Recall - Query 208: 0.0016 Precision Averages: Query 209: 0.0012 at 0.00 0.2564 Query 210: 0.0000 at 0.10 0.2387 0.6 Query 211: 0.0000 at 0.20 0.1905 Query 212: 0.0009 at 0.30 0.1766 Query 213: 0.0000 at 0.40 0.1551 Precision Query 214: 0.0003 at 0.50 0.1431 Query 215: 0.3257 at 0.60 0.1264 0.4 Query 216: 0.0123 at 0.70 0.1182 Query 217: 0.0000 at 0.80 0.0940 Query 218: 0.6775 at 0.90 0.0718 Query 219: 0.0000 at 1.00 0.0317 Query 220: 0.0000 0.2 Query 221: 0.2373 Avg. prec. (non-interpolated) Query 222: 0.0050 for all rel. documents Query 223: 0.0000 0.1411 Query 224: 0.0340 Precision: Query 225: 0.0000 At 5 docs: 0.1755 0.0 Query 226: 0.0000 At 10 docs: 0.1571 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.0012 At 15 docs: 0.1293 Query 229: 0.0028 At 20 docs: 0.1133 Recall Query 230: 0.5088 At 30 docs: 0.0891 Query 231: 0.0519 At 100 docs: 0.0422 Query 232: 0.0000 At 200 docs: 0.0235 Run IMSBDEFRP100 Query 233: 0.1048 At 500 docs: 0.0104 Comparison to median by topic Query 234: 0.0123 At 1000 docs: 0.0063 Query 235: 0.3038 +1.0 Query 236: 1.0000 R-Precision (prec. after R Query 237: 0.9288 (=num_rel) docs. retrieved): Query 238: 0.0387 Exact: 0.1437 Query 239: 0.0050 Query 240: 0.0000 Query 241: 0.0040 +0.5 Query 242: 0.0003 Query 243: 0.1688 Query 244: 0.0000 Query 245: 0.7786 Query 246: 0.0043 Query 247: 0.9043 0.0 Query 248: 0.0000 Query 249: 0.0000 Query 250: 0.0001 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Padua, Bilingual German to French, Auto, TD Run IMSBDEFRP50 Average precision Overall statistics Recall−Precision Values (individual queries): (for 49 queries): 1.0 Query 201: 0.0001 Total number of documents Query 202: 0.5228 over all queries Query 203: 0.2175 Retrieved: 47002 Query 204: 0.0005 Relevant: 915 Query 205: 0.0469 Rel_ret: 379 0.8 Query 206: 0.0008 Query 207: 0.0052 Interpolated Recall - Query 208: 0.0016 Precision Averages: Query 209: 0.0012 at 0.00 0.2669 Query 210: 0.0000 at 0.10 0.2429 0.6 Query 211: 0.0000 at 0.20 0.1900 Query 212: 0.0000 at 0.30 0.1775 Query 213: 0.1018 at 0.40 0.1613 Precision Query 214: 0.0000 at 0.50 0.1473 Query 215: 0.3079 at 0.60 0.1281 0.4 Query 216: 0.0123 at 0.70 0.1119 Query 217: 0.0000 at 0.80 0.0878 Query 218: 0.6540 at 0.90 0.0538 Query 219: 0.0000 at 1.00 0.0266 Query 220: 0.0000 0.2 Query 221: 0.2376 Avg. prec. (non-interpolated) Query 222: 0.0050 for all rel. documents Query 223: 0.0000 0.1388 Query 224: 0.0185 Precision: Query 225: 0.0000 At 5 docs: 0.1714 0.0 Query 226: 0.0000 At 10 docs: 0.1510 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.0012 At 15 docs: 0.1320 Query 229: 0.0028 At 20 docs: 0.1153 Recall Query 230: 0.5022 At 30 docs: 0.0905 Query 231: 0.0643 At 100 docs: 0.0465 Query 232: 0.0000 At 200 docs: 0.0276 Run IMSBDEFRP50 Query 233: 0.1037 At 500 docs: 0.0131 Comparison to median by topic Query 234: 0.0128 At 1000 docs: 0.0077 Query 235: 0.3038 +1.0 Query 236: 1.0000 R-Precision (prec. after R Query 237: 0.8454 (=num_rel) docs. retrieved): Query 238: 0.0387 Exact: 0.1392 Query 239: 0.0042 Query 240: 0.0000 Query 241: 0.0040 +0.5 Query 242: 0.0004 Query 243: 0.1670 Query 244: 0.0000 Query 245: 0.7756 Query 246: 0.0043 Query 247: 0.8047 Query 248: 0.0314 0.0 Query 249: 0.0000 Query 250: 0.0013 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Padua, Bilingual German to French, Auto, TD Run IMSBDEFRUd651 Average precision Overall statistics Recall−Precision Values (individual queries): (for 49 queries): 1.0 Query 201: 0.0000 Total number of documents Query 202: 0.3963 over all queries Query 203: 0.1483 Retrieved: 45423 Query 204: 0.0005 Relevant: 915 Query 205: 0.0458 Rel_ret: 304 0.8 Query 206: 0.0014 Query 207: 0.0085 Interpolated Recall - Query 208: 0.0018 Precision Averages: Query 209: 0.0014 at 0.00 0.2530 Query 210: 0.0000 at 0.10 0.2381 0.6 Query 211: 0.0001 at 0.20 0.1834 Query 212: 0.0008 at 0.30 0.1657 Query 213: 0.0001 at 0.40 0.1513 Precision Query 214: 0.0004 at 0.50 0.1431 Query 215: 0.3220 at 0.60 0.1278 0.4 Query 216: 0.0063 at 0.70 0.1163 Query 217: 0.0000 at 0.80 0.0905 Query 218: 0.7620 at 0.90 0.0671 Query 219: 0.0000 at 1.00 0.0351 Query 220: 0.0000 0.2 Query 221: 0.1764 Avg. prec. (non-interpolated) Query 222: 0.0065 for all rel. documents Query 223: 0.0000 0.1377 Query 224: 0.0337 Precision: Query 225: 0.0000 At 5 docs: 0.1673 0.0 Query 226: 0.0019 At 10 docs: 0.1531 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.0009 At 15 docs: 0.1265 Query 229: 0.0038 At 20 docs: 0.1102 Recall Query 230: 0.5393 At 30 docs: 0.0891 Query 231: 0.0439 At 100 docs: 0.0398 Query 232: 0.0000 At 200 docs: 0.0222 Run IMSBDEFRUd651 Query 233: 0.1398 At 500 docs: 0.0105 Comparison to median by topic Query 234: 0.0000 At 1000 docs: 0.0062 Query 235: 0.3175 +1.0 Query 236: 1.0000 R-Precision (prec. after R Query 237: 0.9346 (=num_rel) docs. retrieved): Query 238: 0.0415 Exact: 0.1390 Query 239: 0.0034 Query 240: 0.0000 Query 241: 0.0002 +0.5 Query 242: 0.0010 Query 243: 0.1140 Query 244: 0.0000 Query 245: 0.7845 Query 246: 0.0054 Query 247: 0.9025 Query 248: 0.0000 0.0 Query 249: 0.0000 Query 250: 0.0001 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Padua, Bilingual German to French, Auto, TD Run IMSBDEFRUd655 Average precision Overall statistics Recall−Precision Values (individual queries): (for 49 queries): 1.0 Query 201: 0.0001 Total number of documents Query 202: 0.3693 over all queries Query 203: 0.1483 Retrieved: 46422 Query 204: 0.0005 Relevant: 915 Query 205: 0.0458 Rel_ret: 369 0.8 Query 206: 0.0008 Query 207: 0.0080 Interpolated Recall - Query 208: 0.0017 Precision Averages: Query 209: 0.0014 at 0.00 0.2726 Query 210: 0.0000 at 0.10 0.2419 0.6 Query 211: 0.0001 at 0.20 0.1872 Query 212: 0.0000 at 0.30 0.1657 Query 213: 0.1612 at 0.40 0.1546 Precision Query 214: 0.0001 at 0.50 0.1457 Query 215: 0.2865 at 0.60 0.1298 0.4 Query 216: 0.0063 at 0.70 0.1139 Query 217: 0.0000 at 0.80 0.0809 Query 218: 0.7777 at 0.90 0.0540 Query 219: 0.0000 at 1.00 0.0287 Query 220: 0.0000 0.2 Query 221: 0.1763 Avg. prec. (non-interpolated) Query 222: 0.0075 for all rel. documents Query 223: 0.0000 0.1365 Query 224: 0.0142 Precision: Query 225: 0.0000 At 5 docs: 0.1633 0.0 Query 226: 0.0019 At 10 docs: 0.1490 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.0009 At 15 docs: 0.1279 Query 229: 0.0038 At 20 docs: 0.1153 Recall Query 230: 0.5341 At 30 docs: 0.0952 Query 231: 0.0499 At 100 docs: 0.0453 Query 232: 0.0000 At 200 docs: 0.0261 Run IMSBDEFRUd655 Query 233: 0.1399 At 500 docs: 0.0123 Comparison to median by topic Query 234: 0.0000 At 1000 docs: 0.0075 Query 235: 0.3175 +1.0 Query 236: 1.0000 R-Precision (prec. after R Query 237: 0.8648 (=num_rel) docs. retrieved): Query 238: 0.0415 Exact: 0.1360 Query 239: 0.0039 Query 240: 0.0000 Query 241: 0.0002 +0.5 Query 242: 0.0011 Query 243: 0.1137 Query 244: 0.0000 Query 245: 0.7812 Query 246: 0.0054 Query 247: 0.8174 Query 248: 0.0031 0.0 Query 249: 0.0000 Query 250: 0.0001 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number NII Group, Bilingual German to French, Auto, TD Run NiiDic03 Average precision Overall statistics Recall−Precision Values (individual queries): (for 49 queries): 1.0 Query 201: 0.0000 Total number of documents Query 202: 0.6242 over all queries Query 203: 0.4989 Retrieved: 49000 Query 204: 0.8378 Relevant: 915 Query 205: 0.4484 Rel_ret: 636 0.8 Query 206: 0.1416 Query 207: 0.3465 Interpolated Recall - Query 208: 0.3723 Precision Averages: Query 209: 0.0000 at 0.00 0.3985 Query 210: 0.0241 at 0.10 0.3619 0.6 Query 211: 0.8339 at 0.20 0.3398 Query 212: 0.0003 at 0.30 0.3272 Query 213: 0.6929 at 0.40 0.3106 Precision Query 214: 0.0022 at 0.50 0.2785 Query 215: 0.0238 at 0.60 0.2550 0.4 Query 216: 0.0000 at 0.70 0.2398 Query 217: 0.0130 at 0.80 0.2140 Query 218: 0.9532 at 0.90 0.1881 Query 219: 0.0000 at 1.00 0.1157 Query 220: 0.0093 0.2 Query 221: 0.6755 Avg. prec. (non-interpolated) Query 222: 0.0000 for all rel. documents Query 223: 0.0000 0.2690 Query 224: 0.0005 Precision: Query 225: 0.0011 At 5 docs: 0.2694 0.0 Query 226: 0.0132 At 10 docs: 0.2429 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.0000 At 15 docs: 0.2259 Query 229: 0.3069 At 20 docs: 0.2133 Recall Query 230: 0.8277 At 30 docs: 0.1884 Query 231: 0.5953 At 100 docs: 0.1000 Query 232: 0.0000 At 200 docs: 0.0580 Run NiiDic03 Query 233: 0.1772 At 500 docs: 0.0250 Comparison to median by topic Query 234: 0.0000 At 1000 docs: 0.0130 Query 235: 0.6221 +1.0 Query 236: 0.0513 R-Precision (prec. after R Query 237: 0.7915 (=num_rel) docs. retrieved): Query 238: 0.3302 Exact: 0.2549 Query 239: 0.0008 Query 240: 1.0000 Query 241: 0.0203 +0.5 Query 242: 0.1070 Query 243: 0.4546 Query 244: 0.0128 Query 245: 0.3201 Query 246: 0.0267 Query 247: 0.9500 Query 248: 0.0003 0.0 Query 249: 0.0455 Query 250: 0.0266 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number NII Group, Bilingual German to French, Auto, TD Run NiiDic04 Average precision Overall statistics Recall−Precision Values (individual queries): (for 49 queries): 1.0 Query 201: 0.0000 Total number of documents Query 202: 0.6242 over all queries Query 203: 0.5970 Retrieved: 49000 Query 204: 0.8426 Relevant: 915 Query 205: 0.4529 Rel_ret: 639 0.8 Query 206: 0.2009 Query 207: 0.3526 Interpolated Recall - Query 208: 0.3696 Precision Averages: Query 209: 0.0000 at 0.00 0.3963 Query 210: 0.0238 at 0.10 0.3738 0.6 Query 211: 0.7887 at 0.20 0.3516 Query 212: 0.0003 at 0.30 0.3343 Query 213: 0.7976 at 0.40 0.3218 Precision Query 214: 0.0021 at 0.50 0.2911 Query 215: 0.0134 at 0.60 0.2723 0.4 Query 216: 0.0000 at 0.70 0.2491 Query 217: 0.0131 at 0.80 0.2102 Query 218: 0.9333 at 0.90 0.1845 Query 219: 0.0000 at 1.00 0.1128 Query 220: 0.0089 0.2 Query 221: 0.6753 Avg. prec. (non-interpolated) Query 222: 0.0002 for all rel. documents Query 223: 0.0000 0.2746 Query 224: 0.0065 Precision: Query 225: 0.0000 At 5 docs: 0.2857 0.0 Query 226: 0.0000 At 10 docs: 0.2551 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.0000 At 15 docs: 0.2286 Query 229: 0.4254 At 20 docs: 0.2102 Recall Query 230: 0.7795 At 30 docs: 0.1878 Query 231: 0.4517 At 100 docs: 0.0984 Query 232: 0.0000 At 200 docs: 0.0576 Run NiiDic04 Query 233: 0.0955 At 500 docs: 0.0248 Comparison to median by topic Query 234: 0.0000 At 1000 docs: 0.0130 Query 235: 0.6505 +1.0 Query 236: 0.0513 R-Precision (prec. after R Query 237: 0.7929 (=num_rel) docs. retrieved): Query 238: 0.3328 Exact: 0.2542 Query 239: 0.0044 Query 240: 1.0000 Query 241: 0.0194 +0.5 Query 242: 0.0026 Query 243: 0.4327 Query 244: 0.0149 Query 245: 0.6522 Query 246: 0.0251 Query 247: 0.9500 Query 248: 0.0000 0.0 Query 249: 0.0476 Query 250: 0.0218 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number NII Group, Bilingual German to French, Auto, TD Run NiiDic05 Average precision Overall statistics Recall−Precision Values (individual queries): (for 49 queries): 1.0 Query 201: 0.0000 Total number of documents Query 202: 0.2921 over all queries Query 203: 0.0159 Retrieved: 49000 Query 204: 0.1024 Relevant: 915 Query 205: 0.3757 Rel_ret: 497 0.8 Query 206: 0.0355 Query 207: 0.0059 Interpolated Recall - Query 208: 0.0756 Precision Averages: Query 209: 0.0136 at 0.00 0.2558 Query 210: 0.0000 at 0.10 0.1867 0.6 Query 211: 0.3657 at 0.20 0.1504 Query 212: 0.0006 at 0.30 0.1328 Query 213: 0.2426 at 0.40 0.1135 Precision Query 214: 0.0000 at 0.50 0.0993 Query 215: 0.0061 at 0.60 0.0928 0.4 Query 216: 0.0026 at 0.70 0.0813 Query 217: 0.0000 at 0.80 0.0486 Query 218: 0.8493 at 0.90 0.0311 Query 219: 0.0000 at 1.00 0.0055 Query 220: 0.0000 0.2 Query 221: 0.2449 Avg. prec. (non-interpolated) Query 222: 0.0096 for all rel. documents Query 223: 0.0000 0.1015 Query 224: 0.0702 Precision: Query 225: 0.0000 At 5 docs: 0.1306 0.0 Query 226: 0.0021 At 10 docs: 0.1122 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.0045 At 15 docs: 0.1020 Query 229: 0.0128 At 20 docs: 0.0929 Recall Query 230: 0.0015 At 30 docs: 0.0878 Query 231: 0.1920 At 100 docs: 0.0490 Query 232: 0.0000 At 200 docs: 0.0309 Run NiiDic05 Query 233: 0.0367 At 500 docs: 0.0169 Comparison to median by topic Query 234: 0.0000 At 1000 docs: 0.0101 Query 235: 0.0212 +1.0 Query 236: 0.0202 R-Precision (prec. after R Query 237: 0.0108 (=num_rel) docs. retrieved): Query 238: 0.0588 Exact: 0.1024 Query 239: 0.0612 Query 240: 0.1111 Query 241: 0.0069 +0.5 Query 242: 0.0063 Query 243: 0.2212 Query 244: 0.0000 Query 245: 0.7500 Query 246: 0.0707 Query 247: 0.6593 Query 248: 0.0000 0.0 Query 249: 0.0175 Query 250: 0.0000 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number NII Group, Bilingual German to French, Auto, TD Run NiiMt02 Average precision Overall statistics Recall−Precision Values (individual queries): (for 49 queries): 1.0 Query 201: 0.0632 Total number of documents Query 202: 0.5808 over all queries Query 203: 0.4555 Retrieved: 49000 Query 204: 0.6646 Relevant: 915 Query 205: 0.2886 Rel_ret: 799 0.8 Query 206: 0.3261 Query 207: 0.3516 Interpolated Recall - Query 208: 0.7333 Precision Averages: Query 209: 0.0007 at 0.00 0.4559 Query 210: 0.0555 at 0.10 0.4340 0.6 Query 211: 0.8408 at 0.20 0.4260 Query 212: 0.1784 at 0.30 0.4030 Query 213: 0.8106 at 0.40 0.3820 Precision Query 214: 0.0592 at 0.50 0.3618 Query 215: 0.0425 at 0.60 0.3441 0.4 Query 216: 0.0453 at 0.70 0.3259 Query 217: 0.4580 at 0.80 0.2789 Query 218: 0.9289 at 0.90 0.2326 Query 219: 0.0000 at 1.00 0.1612 Query 220: 0.0292 0.2 Query 221: 0.6484 Avg. prec. (non-interpolated) Query 222: 0.0016 for all rel. documents Query 223: 0.0067 0.3368 Query 224: 0.9762 Precision: Query 225: 0.0333 At 5 docs: 0.3265 0.0 Query 226: 0.0106 At 10 docs: 0.3102 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.8165 At 15 docs: 0.2871 Query 229: 0.3137 At 20 docs: 0.2684 Recall Query 230: 0.8350 At 30 docs: 0.2313 Query 231: 0.2715 At 100 docs: 0.1231 Query 232: 0.0030 At 200 docs: 0.0713 Run NiiMt02 Query 233: 0.0666 At 500 docs: 0.0310 Comparison to median by topic Query 234: 0.0040 At 1000 docs: 0.0163 Query 235: 0.0428 +1.0 Query 236: 0.9588 R-Precision (prec. after R Query 237: 0.7801 (=num_rel) docs. retrieved): Query 238: 0.2467 Exact: 0.3125 Query 239: 0.1949 Query 240: 1.0000 Query 241: 0.0126 +0.5 Query 242: 0.2816 Query 243: 0.3925 Query 244: 0.0120 Query 245: 0.7577 Query 246: 0.0741 Query 247: 0.0416 Query 248: 0.7128 0.0 Query 249: 0.0556 Query 250: 0.0419 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Daedalus, Bilingual Dutch to French, Auto, TD Run nl2frav Average precision Overall statistics Recall−Precision Values (individual queries): (for 49 queries): 1.0 Query 201: 0.2354 Total number of documents Query 202: 0.5703 over all queries Query 203: 0.1587 Retrieved: 49000 Query 204: 0.8211 Relevant: 915 Query 205: 0.4068 Rel_ret: 755 0.8 Query 206: 0.4675 Query 207: 0.3206 Interpolated Recall - Query 208: 0.7431 Precision Averages: Query 209: 0.1231 at 0.00 0.5628 Query 210: 0.0110 at 0.10 0.5149 0.6 Query 211: 0.7423 at 0.20 0.4599 Query 212: 0.1308 at 0.30 0.4088 Query 213: 0.6358 at 0.40 0.3785 Precision Query 214: 0.0000 at 0.50 0.3594 Query 215: 0.0710 at 0.60 0.3296 0.4 Query 216: 0.0517 at 0.70 0.2984 Query 217: 0.4782 at 0.80 0.2668 Query 218: 0.8929 at 0.90 0.2224 Query 219: 0.0217 at 1.00 0.1668 Query 220: 0.0019 0.2 Query 221: 0.3326 Avg. prec. (non-interpolated) Query 222: 0.0165 for all rel. documents Query 223: 0.0017 0.3505 Query 224: 0.9583 Precision: Query 225: 0.0263 At 5 docs: 0.3878 0.0 Query 226: 0.0263 At 10 docs: 0.3306 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.2451 At 15 docs: 0.2884 Query 229: 0.4732 At 20 docs: 0.2673 Recall Query 230: 0.9224 At 30 docs: 0.2238 Query 231: 0.6693 At 100 docs: 0.1147 Query 232: 0.0009 At 200 docs: 0.0643 Run nl2frav Query 233: 0.4265 At 500 docs: 0.0287 Comparison to median by topic Query 234: 0.0090 At 1000 docs: 0.0154 Query 235: 0.9167 +1.0 Query 236: 0.0653 R-Precision (prec. after R Query 237: 0.8526 (=num_rel) docs. retrieved): Query 238: 0.5550 Exact: 0.3387 Query 239: 0.0161 Query 240: 1.0000 Query 241: 0.0146 +0.5 Query 242: 0.1823 Query 243: 0.6168 Query 244: 0.0000 Query 245: 1.0000 Query 246: 0.0543 Query 247: 0.0156 Query 248: 0.8775 0.0 Query 249: 0.0127 Query 250: 0.0008 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Daedalus, Bilingual Dutch to French, Auto, TD Run nl2frcomb1s101 Average precision Overall statistics Recall−Precision Values (individual queries): (for 49 queries): 1.0 Query 201: 0.2363 Total number of documents Query 202: 0.5844 over all queries Query 203: 0.1392 Retrieved: 49000 Query 204: 0.8075 Relevant: 915 Query 205: 0.4185 Rel_ret: 749 0.8 Query 206: 0.4710 Query 207: 0.3120 Interpolated Recall - Query 208: 0.7463 Precision Averages: Query 209: 0.1015 at 0.00 0.5515 Query 210: 0.0128 at 0.10 0.4966 0.6 Query 211: 0.7389 at 0.20 0.4521 Query 212: 0.1303 at 0.30 0.4108 Query 213: 0.6452 at 0.40 0.3804 Precision Query 214: 0.0000 at 0.50 0.3534 Query 215: 0.0716 at 0.60 0.3229 0.4 Query 216: 0.0548 at 0.70 0.2930 Query 217: 0.4784 at 0.80 0.2639 Query 218: 0.8963 at 0.90 0.2175 Query 219: 0.0191 at 1.00 0.1595 Query 220: 0.0019 0.2 Query 221: 0.3284 Avg. prec. (non-interpolated) Query 222: 0.0162 for all rel. documents Query 223: 0.0006 0.3449 Query 224: 0.9444 Precision: Query 225: 0.0278 At 5 docs: 0.3755 0.0 Query 226: 0.0263 At 10 docs: 0.3306 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.2424 At 15 docs: 0.2857 Query 229: 0.4714 At 20 docs: 0.2663 Recall Query 230: 0.9172 At 30 docs: 0.2252 Query 231: 0.5513 At 100 docs: 0.1147 Query 232: 0.0002 At 200 docs: 0.0635 Run nl2frcomb1s101 Query 233: 0.4374 At 500 docs: 0.0287 Comparison to median by topic Query 234: 0.0064 At 1000 docs: 0.0153 Query 235: 0.9167 +1.0 Query 236: 0.0461 R-Precision (prec. after R Query 237: 0.8597 (=num_rel) docs. retrieved): Query 238: 0.4550 Exact: 0.3352 Query 239: 0.0182 Query 240: 1.0000 Query 241: 0.0174 +0.5 Query 242: 0.1830 Query 243: 0.6136 Query 244: 0.0000 Query 245: 1.0000 Query 246: 0.0471 Query 247: 0.0101 Query 248: 0.8828 0.0 Query 249: 0.0127 Query 250: 0.0003 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Daedalus, Bilingual Dutch to French, Auto, TD Run nl2frR4FWnormal Average precision Overall statistics Recall−Precision Values (individual queries): (for 49 queries): 1.0 Query 201: 0.2363 Total number of documents Query 202: 0.5844 over all queries Query 203: 0.1392 Retrieved: 49000 Query 204: 0.8075 Relevant: 915 Query 205: 0.4324 Rel_ret: 749 0.8 Query 206: 0.4710 Query 207: 0.3120 Interpolated Recall - Query 208: 0.7463 Precision Averages: Query 209: 0.1015 at 0.00 0.5583 Query 210: 0.0128 at 0.10 0.5034 0.6 Query 211: 0.7389 at 0.20 0.4590 Query 212: 0.1303 at 0.30 0.4108 Query 213: 0.6452 at 0.40 0.3804 Precision Query 214: 0.0000 at 0.50 0.3534 Query 215: 0.0716 at 0.60 0.3229 0.4 Query 216: 0.0548 at 0.70 0.2930 Query 217: 0.4784 at 0.80 0.2639 Query 218: 0.8963 at 0.90 0.2175 Query 219: 0.0191 at 1.00 0.1595 Query 220: 0.0019 0.2 Query 221: 0.3284 Avg. prec. (non-interpolated) Query 222: 0.0162 for all rel. documents Query 223: 0.0006 0.3472 Query 224: 0.9444 Precision: Query 225: 0.0278 At 5 docs: 0.3755 0.0 Query 226: 0.0263 At 10 docs: 0.3306 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.2424 At 15 docs: 0.2857 Query 229: 0.4714 At 20 docs: 0.2663 Recall Query 230: 0.9172 At 30 docs: 0.2252 Query 231: 0.5513 At 100 docs: 0.1147 Query 232: 0.0002 At 200 docs: 0.0635 Run nl2frR4FWnormal Query 233: 0.4374 At 500 docs: 0.0287 Comparison to median by topic Query 234: 0.0064 At 1000 docs: 0.0153 Query 235: 0.9167 +1.0 Query 236: 0.0461 R-Precision (prec. after R Query 237: 0.8597 (=num_rel) docs. retrieved): Query 238: 0.5550 Exact: 0.3352 Query 239: 0.0182 Query 240: 1.0000 Query 241: 0.0174 +0.5 Query 242: 0.1830 Query 243: 0.6136 Query 244: 0.0000 Query 245: 1.0000 Query 246: 0.0471 Query 247: 0.0101 Query 248: 0.8828 0.0 Query 249: 0.0127 Query 250: 0.0003 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Daedalus, Bilingual Dutch to French, Auto, TD Run nl2frR5FWnormal Average precision Overall statistics Recall−Precision Values (individual queries): (for 49 queries): 1.0 Query 201: 0.2370 Total number of documents Query 202: 0.5891 over all queries Query 203: 0.1330 Retrieved: 49000 Query 204: 0.8037 Relevant: 915 Query 205: 0.4332 Rel_ret: 754 0.8 Query 206: 0.4722 Query 207: 0.3119 Interpolated Recall - Query 208: 0.7431 Precision Averages: Query 209: 0.1014 at 0.00 0.5598 Query 210: 0.0124 at 0.10 0.5021 0.6 Query 211: 0.7440 at 0.20 0.4584 Query 212: 0.1436 at 0.30 0.4115 Query 213: 0.6512 at 0.40 0.3817 Precision Query 214: 0.0000 at 0.50 0.3560 Query 215: 0.0694 at 0.60 0.3262 0.4 Query 216: 0.0556 at 0.70 0.2955 Query 217: 0.4743 at 0.80 0.2674 Query 218: 0.8932 at 0.90 0.2188 Query 219: 0.0182 at 1.00 0.1593 Query 220: 0.0018 0.2 Query 221: 0.3279 Avg. prec. (non-interpolated) Query 222: 0.0159 for all rel. documents Query 223: 0.0007 0.3483 Query 224: 0.9444 Precision: Query 225: 0.0238 At 5 docs: 0.3837 0.0 Query 226: 0.0263 At 10 docs: 0.3286 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.2366 At 15 docs: 0.2871 Query 229: 0.4724 At 20 docs: 0.2684 Recall Query 230: 0.9172 At 30 docs: 0.2252 Query 231: 0.5948 At 100 docs: 0.1149 Query 232: 0.0002 At 200 docs: 0.0640 Run nl2frR5FWnormal Query 233: 0.4392 At 500 docs: 0.0289 Comparison to median by topic Query 234: 0.0031 At 1000 docs: 0.0154 Query 235: 0.9167 +1.0 Query 236: 0.0624 R-Precision (prec. after R Query 237: 0.8597 (=num_rel) docs. retrieved): Query 238: 0.5425 Exact: 0.3400 Query 239: 0.0188 Query 240: 1.0000 Query 241: 0.0226 +0.5 Query 242: 0.1832 Query 243: 0.6131 Query 244: 0.0000 Query 245: 1.0000 Query 246: 0.0493 Query 247: 0.0098 Query 248: 0.8850 0.0 Query 249: 0.0141 Query 250: 0.0006 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number SICS, Bilingual Swedish to French, Auto, TD Run SICSsvfrQF Average precision Overall statistics Recall−Precision Values (individual queries): (for 49 queries): 1.0 Query 201: 0.0533 Total number of documents Query 202: 0.5339 over all queries Query 203: 0.4034 Retrieved: 49000 Query 204: 0.8165 Relevant: 915 Query 205: 0.3336 Rel_ret: 784 0.8 Query 206: 0.1266 Query 207: 0.0823 Interpolated Recall - Query 208: 0.5087 Precision Averages: Query 209: 0.0009 at 0.00 0.5023 Query 210: 0.3382 at 0.10 0.4320 0.6 Query 211: 0.6426 at 0.20 0.3602 Query 212: 0.1999 at 0.30 0.3350 Query 213: 0.5669 at 0.40 0.2958 Precision Query 214: 0.0000 at 0.50 0.2680 Query 215: 0.0611 at 0.60 0.2372 0.4 Query 216: 0.0007 at 0.70 0.2070 Query 217: 0.1969 at 0.80 0.1708 Query 218: 0.8344 at 0.90 0.1486 Query 219: 0.0014 at 1.00 0.0832 Query 220: 0.0127 0.2 Query 221: 0.1899 Avg. prec. (non-interpolated) Query 222: 0.0076 for all rel. documents Query 223: 0.0004 0.2622 Query 224: 0.6663 Precision: Query 225: 0.0026 At 5 docs: 0.2980 0.0 Query 226: 0.0000 At 10 docs: 0.2449 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.0565 At 15 docs: 0.2204 Query 229: 0.0004 At 20 docs: 0.2010 Recall Query 230: 0.5194 At 30 docs: 0.1830 Query 231: 0.2795 At 100 docs: 0.1088 Query 232: 0.1573 At 200 docs: 0.0665 Run SICSsvfrQF Query 233: 0.3612 At 500 docs: 0.0301 Query 234: 0.0833 At 1000 docs: 0.0160 Comparison to median by topic Query 235: 0.8179 +1.0 Query 236: 0.2021 R-Precision (prec. after R Query 237: 0.9164 (=num_rel) docs. retrieved): Query 238: 0.1135 Exact: 0.2586 Query 239: 0.0590 Query 240: 1.0000 Query 241: 0.0351 +0.5 Query 242: 0.0222 Query 243: 0.3921 Query 244: 0.0833 Query 245: 0.7524 Query 246: 0.0454 Query 247: 0.0030 Query 248: 0.3361 0.0 Query 249: 0.0164 Query 250: 0.0154 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Thomson Legal, Bilingual German to French, Auto, TD Run tlrde2fr1 Average precision Overall statistics Recall−Precision Values (individual queries): (for 49 queries): 1.0 Query 201: 0.0769 Total number of documents Query 202: 0.1873 over all queries Query 203: 0.1930 Retrieved: 49000 Query 204: 0.4244 Relevant: 915 Query 205: 0.2558 Rel_ret: 685 0.8 Query 206: 0.1727 Query 207: 0.0000 Interpolated Recall - Query 208: 0.8042 Precision Averages: Query 209: 0.3111 at 0.00 0.5240 Query 210: 0.2988 at 0.10 0.4785 0.6 Query 211: 0.7595 at 0.20 0.4214 Query 212: 0.1973 at 0.30 0.3397 Query 213: 0.7137 at 0.40 0.3006 Precision Query 214: 0.0001 at 0.50 0.2731 Query 215: 0.1135 at 0.60 0.2308 0.4 Query 216: 0.0026 at 0.70 0.2054 Query 217: 0.3126 at 0.80 0.1690 Query 218: 0.8101 at 0.90 0.1374 Query 219: 0.2341 at 1.00 0.0999 Query 220: 0.0638 0.2 Query 221: 0.4650 Avg. prec. (non-interpolated) Query 222: 0.0054 for all rel. documents Query 223: 0.0259 0.2723 Query 224: 0.8020 Precision: Query 225: 0.0070 At 5 docs: 0.3020 0.0 Query 226: 0.0185 At 10 docs: 0.2571 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.3423 At 15 docs: 0.2354 Query 229: 0.0019 At 20 docs: 0.2153 Recall Query 230: 0.2071 At 30 docs: 0.1857 Query 231: 0.3768 At 100 docs: 0.0951 Query 232: 0.0000 At 200 docs: 0.0585 Run tlrde2fr1 Query 233: 0.3633 At 500 docs: 0.0265 Comparison to median by topic Query 234: 0.0000 At 1000 docs: 0.0140 Query 235: 0.0078 +1.0 Query 236: 0.1087 R-Precision (prec. after R Query 237: 0.6568 (=num_rel) docs. retrieved): Query 238: 0.4371 Exact: 0.2877 Query 239: 0.0369 Query 240: 1.0000 Query 241: 0.0311 +0.5 Query 242: 0.5160 Query 243: 0.6804 Query 244: 0.0106 Query 245: 0.7672 Query 246: 0.2529 Query 247: 0.0351 Query 248: 0.1848 0.0 Query 249: 0.0625 Query 250: 0.0066 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Thomson Legal, Bilingual German to French, Auto, TD Run tlrde2fr2 Average precision Overall statistics Recall−Precision Values (individual queries): (for 49 queries): 1.0 Query 201: 0.0808 Total number of documents Query 202: 0.0836 over all queries Query 203: 0.2213 Retrieved: 49000 Query 204: 0.4248 Relevant: 915 Query 205: 0.2768 Rel_ret: 704 0.8 Query 206: 0.1722 Query 207: 0.2156 Interpolated Recall - Query 208: 0.8042 Precision Averages: Query 209: 0.4042 at 0.00 0.5628 Query 210: 0.3478 at 0.10 0.5249 0.6 Query 211: 0.8104 at 0.20 0.4793 Query 212: 0.1393 at 0.30 0.4189 Query 213: 0.6897 at 0.40 0.3681 Precision Query 214: 0.0001 at 0.50 0.3235 Query 215: 0.1019 at 0.60 0.2828 0.4 Query 216: 0.0010 at 0.70 0.2595 Query 217: 0.3231 at 0.80 0.2080 Query 218: 0.8107 at 0.90 0.1615 Query 219: 0.1240 at 1.00 0.1168 Query 220: 0.0112 0.2 Query 221: 0.5245 Avg. prec. (non-interpolated) Query 222: 0.0062 for all rel. documents Query 223: 0.0067 0.3225 Query 224: 0.8556 Precision: Query 225: 0.0024 At 5 docs: 0.3673 0.0 Query 226: 0.0179 At 10 docs: 0.3082 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.3620 At 15 docs: 0.2735 Query 229: 0.4873 At 20 docs: 0.2541 Recall Query 230: 0.5001 At 30 docs: 0.2082 Query 231: 0.3672 At 100 docs: 0.1076 Query 232: 0.0005 At 200 docs: 0.0622 Run tlrde2fr2 Query 233: 0.3693 At 500 docs: 0.0277 Comparison to median by topic Query 234: 0.0000 At 1000 docs: 0.0144 Query 235: 0.0425 +1.0 Query 236: 0.1569 R-Precision (prec. after R Query 237: 0.8893 (=num_rel) docs. retrieved): Query 238: 0.4581 Exact: 0.3250 Query 239: 0.0417 Query 240: 1.0000 Query 241: 0.0250 +0.5 Query 242: 0.5156 Query 243: 0.7870 Query 244: 0.0062 Query 245: 0.7675 Query 246: 0.2327 Query 247: 0.6942 Query 248: 0.5232 0.0 Query 249: 0.1111 Query 250: 0.0093 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Thomson Legal, Bilingual German to French, Auto, TD Run tlrde2fr3 Average precision Overall statistics Recall−Precision Values (individual queries): (for 49 queries): 1.0 Query 201: 0.1651 Total number of documents Query 202: 0.7259 over all queries Query 203: 0.5346 Retrieved: 49000 Query 204: 0.7677 Relevant: 915 Query 205: 0.2675 Rel_ret: 752 0.8 Query 206: 0.1706 Query 207: 0.2647 Interpolated Recall - Query 208: 0.8875 Precision Averages: Query 209: 0.2870 at 0.00 0.5482 Query 210: 0.3837 at 0.10 0.4998 0.6 Query 211: 0.8431 at 0.20 0.4801 Query 212: 0.1807 at 0.30 0.4414 Query 213: 0.7867 at 0.40 0.4264 Precision Query 214: 0.0000 at 0.50 0.3999 Query 215: 0.1353 at 0.60 0.3775 0.4 Query 216: 0.0076 at 0.70 0.3499 Query 217: 0.2385 at 0.80 0.3126 Query 218: 0.8483 at 0.90 0.2701 Query 219: 0.1945 at 1.00 0.2097 Query 220: 0.0072 0.2 Query 221: 0.6969 Avg. prec. (non-interpolated) Query 222: 0.0002 for all rel. documents Query 223: 0.0118 0.3750 Query 224: 0.9583 Precision: Query 225: 0.0052 At 5 docs: 0.3837 0.0 Query 226: 0.0000 At 10 docs: 0.3531 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.6970 At 15 docs: 0.3279 Query 229: 0.3998 At 20 docs: 0.3000 Recall Query 230: 0.6562 At 30 docs: 0.2571 Query 231: 0.1921 At 100 docs: 0.1255 Query 232: 0.0000 At 200 docs: 0.0707 Run tlrde2fr3 Query 233: 0.3806 At 500 docs: 0.0302 Comparison to median by topic Query 234: 0.0000 At 1000 docs: 0.0153 Query 235: 0.1386 +1.0 Query 236: 0.6347 R-Precision (prec. after R Query 237: 0.9074 (=num_rel) docs. retrieved): Query 238: 0.4833 Exact: 0.3409 Query 239: 0.0077 Query 240: 0.5000 Query 241: 0.0025 +0.5 Query 242: 0.3305 Query 243: 0.8412 Query 244: 0.0035 Query 245: 0.8409 Query 246: 0.2241 Query 247: 1.0000 Query 248: 0.7219 0.0 Query 249: 0.0435 Query 250: 0.0029 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Thomson Legal, Bilingual German to French, Auto, TD Run tlrde2fr4 Average precision Overall statistics Recall−Precision Values (individual queries): (for 49 queries): 1.0 Query 201: 0.1457 Total number of documents Query 202: 0.4007 over all queries Query 203: 0.5590 Retrieved: 49000 Query 204: 0.7106 Relevant: 915 Query 205: 0.2086 Rel_ret: 706 0.8 Query 206: 0.1809 Query 207: 0.0001 Interpolated Recall - Query 208: 0.8875 Precision Averages: Query 209: 0.3476 at 0.00 0.4998 Query 210: 0.6266 at 0.10 0.4539 0.6 Query 211: 0.8403 at 0.20 0.4366 Query 212: 0.4061 at 0.30 0.4060 Query 213: 0.8319 at 0.40 0.3669 Precision Query 214: 0.0000 at 0.50 0.3384 Query 215: 0.1859 at 0.60 0.3212 0.4 Query 216: 0.0021 at 0.70 0.2880 Query 217: 0.2679 at 0.80 0.2535 Query 218: 0.8362 at 0.90 0.2215 Query 219: 0.1388 at 1.00 0.1693 Query 220: 0.0023 0.2 Query 221: 0.6137 Avg. prec. (non-interpolated) Query 222: 0.0004 for all rel. documents Query 223: 0.0125 0.3289 Query 224: 0.9762 Precision: Query 225: 0.0030 At 5 docs: 0.3143 0.0 Query 226: 0.0000 At 10 docs: 0.2959 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.0002 At 15 docs: 0.2748 Query 229: 0.0000 At 20 docs: 0.2531 Recall Query 230: 0.6023 At 30 docs: 0.2197 Query 231: 0.1943 At 100 docs: 0.1157 Query 232: 0.0001 At 200 docs: 0.0662 Run tlrde2fr4 Query 233: 0.3735 At 500 docs: 0.0284 Comparison to median by topic Query 234: 0.0000 At 1000 docs: 0.0144 Query 235: 0.0417 +1.0 Query 236: 0.2629 R-Precision (prec. after R Query 237: 0.8926 (=num_rel) docs. retrieved): Query 238: 0.6597 Exact: 0.3005 Query 239: 0.0006 Query 240: 0.5000 Query 241: 0.0034 +0.5 Query 242: 0.3373 Query 243: 0.9060 Query 244: 0.0038 Query 245: 0.8409 Query 246: 0.4345 Query 247: 0.0345 Query 248: 0.7620 0.0 Query 249: 0.0769 Query 250: 0.0024 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number JHU/APL, Bilingual Spanish to Finnish, Auto, TD Run aplbiesfia Average precision Overall statistics (individual queries): (for 45 queries): Recall−Precision Values 1.0 Query 201: 0.1107 Total number of documents Query 202: 0.8769 over all queries Query 203: 0.6333 Retrieved: 45000 Query 204: 0.0017 Relevant: 413 Query 205: 0.2634 Rel_ret: 310 0.8 Query 207: 0.0015 Query 208: 0.2704 Interpolated Recall - Query 209: 0.2500 Precision Averages: Query 210: 1.0000 at 0.00 0.4429 Query 211: 0.9689 at 0.10 0.4153 0.6 Query 212: 0.3246 at 0.20 0.3907 Query 213: 0.0254 at 0.30 0.3649 Query 214: 0.0133 at 0.40 0.3426 Precision Query 215: 1.0000 at 0.50 0.3124 Query 216: 0.2250 at 0.60 0.2672 0.4 Query 217: 0.4308 at 0.70 0.2444 Query 218: 0.2971 at 0.80 0.2308 Query 219: 0.0172 at 0.90 0.2127 Query 220: 0.0177 at 1.00 0.2025 Query 221: 0.9429 0.2 Query 222: 0.0020 Avg. prec. (non-interpolated) Query 223: 0.1018 for all rel. documents Query 224: 0.0833 0.2982 Query 225: 0.0077 Precision: Query 226: 0.1276 At 5 docs: 0.2533 0.0 Query 228: 0.0511 At 10 docs: 0.1822 0.0 0.2 0.4 0.6 0.8 1.0 Query 229: 0.0051 At 15 docs: 0.1570 Query 230: 0.5178 At 20 docs: 0.1322 Recall Query 232: 0.0204 At 30 docs: 0.1044 Query 233: 0.3912 At 100 docs: 0.0433 Query 234: 0.4586 At 200 docs: 0.0260 Run aplbiesfia Query 235: 0.0645 At 500 docs: 0.0122 Query 236: 0.9167 At 1000 docs: 0.0069 Comparison to median by topic Query 237: 0.8875 +1.0 Query 238: 0.9167 R-Precision (prec. after R Query 239: 0.0308 (=num_rel) docs. retrieved): Query 241: 0.0016 Exact: 0.2421 Query 242: 0.3250 Query 243: 0.0116 Query 244: 0.0500 +0.5 Query 245: 0.0031 Query 246: 0.3333 Query 248: 0.3903 Query 249: 0.0456 Query 250: 0.0040 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number JHU/APL, Bilingual French to Finnish, Auto, TD Run aplbifrfia Average precision Overall statistics (individual queries): (for 45 queries): Recall−Precision Values 1.0 Query 201: 0.2667 Total number of documents Query 202: 0.9945 over all queries Query 203: 0.3409 Retrieved: 45000 Query 204: 0.0996 Relevant: 413 Query 205: 0.6210 Rel_ret: 322 0.8 Query 207: 0.1154 Query 208: 0.3135 Interpolated Recall - Query 209: 0.0169 Precision Averages: Query 210: 0.0625 at 0.00 0.5251 Query 211: 0.9552 at 0.10 0.4879 0.6 Query 212: 0.2860 at 0.20 0.4146 Query 213: 0.3346 at 0.30 0.3539 Query 214: 0.3367 at 0.40 0.2997 Precision Query 215: 0.0476 at 0.50 0.2688 Query 216: 0.0264 at 0.60 0.2375 0.4 Query 217: 0.5042 at 0.70 0.2201 Query 218: 0.8379 at 0.80 0.2013 Query 219: 0.0003 at 0.90 0.1834 Query 220: 0.0490 at 1.00 0.1681 Query 221: 0.7533 0.2 Query 222: 0.0962 Avg. prec. (non-interpolated) Query 223: 0.0315 for all rel. documents Query 224: 0.0145 0.2899 Query 225: 0.1173 Precision: Query 226: 0.1104 At 5 docs: 0.2933 0.0 Query 228: 0.0060 At 10 docs: 0.2200 0.0 0.2 0.4 0.6 0.8 1.0 Query 229: 0.3359 At 15 docs: 0.1926 Query 230: 0.2535 At 20 docs: 0.1711 Recall Query 232: 0.0011 At 30 docs: 0.1319 Query 233: 0.4207 At 100 docs: 0.0527 Query 234: 0.4593 At 200 docs: 0.0307 Run aplbifrfia Query 235: 0.1424 At 500 docs: 0.0136 Query 236: 1.0000 At 1000 docs: 0.0072 Comparison to median by topic Query 237: 1.0000 +1.0 Query 238: 1.0000 R-Precision (prec. after R Query 239: 0.1212 (=num_rel) docs. retrieved): Query 241: 0.0004 Exact: 0.2689 Query 242: 0.0365 Query 243: 0.2865 Query 244: 0.0189 +0.5 Query 245: 0.0000 Query 246: 0.1250 Query 248: 0.4709 Query 249: 0.0342 Query 250: 0.0000 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number CLIPS, Bilingual English to Finnish, Auto, TDN Run CLIPS04ENFI1 Average precision Overall statistics Recall−Precision Values (individual queries): (for 45 queries): 1.0 Query 201: 0.0624 Total number of documents Query 202: 0.0176 over all queries Query 203: 0.0000 Retrieved: 44001 Query 204: 0.0000 Relevant: 413 Query 205: 0.1006 Rel_ret: 215 0.8 Query 207: 0.0000 Query 208: 0.1069 Interpolated Recall - Query 209: 0.0000 Precision Averages: Query 210: 0.0000 at 0.00 0.1938 Query 211: 0.0002 at 0.10 0.1700 0.6 Query 212: 0.0863 at 0.20 0.1539 Query 213: 0.7377 at 0.30 0.1464 Query 214: 0.0079 at 0.40 0.1350 Precision Query 215: 0.0000 at 0.50 0.1318 Query 216: 0.0333 at 0.60 0.1171 0.4 Query 217: 0.0022 at 0.70 0.0945 Query 218: 0.3299 at 0.80 0.0754 Query 219: 0.0099 at 0.90 0.0495 Query 220: 0.0000 at 1.00 0.0360 Query 221: 0.0203 0.2 Query 222: 0.0000 Avg. prec. (non-interpolated) Query 223: 0.0032 for all rel. documents Query 224: 0.0000 0.1148 Query 225: 0.0000 Precision: Query 226: 0.9593 At 5 docs: 0.1333 0.0 Query 228: 0.0000 At 10 docs: 0.1133 0.0 0.2 0.4 0.6 0.8 1.0 Query 229: 0.0000 At 15 docs: 0.0963 Query 230: 0.0736 At 20 docs: 0.0856 Recall Query 232: 0.0278 At 30 docs: 0.0659 Query 233: 0.1055 At 100 docs: 0.0280 Query 234: 0.6867 At 200 docs: 0.0163 Run CLIPS04ENFI1 Query 235: 0.8103 At 500 docs: 0.0084 Comparison to median by topic Query 236: 0.0000 At 1000 docs: 0.0048 Query 237: 0.0000 +1.0 Query 238: 0.0028 R-Precision (prec. after R Query 239: 0.0180 (=num_rel) docs. retrieved): Query 241: 0.0907 Exact: 0.1077 Query 242: 0.8333 Query 243: 0.0000 Query 244: 0.0000 +0.5 Query 245: 0.0030 Query 246: 0.0000 Query 248: 0.0006 Query 249: 0.0343 Query 250: 0.0000 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number CLIPS, Bilingual French to Finnish, Auto, TDN Run CLIPS04FRFI1 Average precision Overall statistics Recall−Precision Values (individual queries): (for 45 queries): 1.0 Query 201: 0.0021 Total number of documents Query 202: 0.0023 over all queries Query 203: 0.0035 Retrieved: 45000 Query 204: 0.0000 Relevant: 413 Query 205: 0.0160 Rel_ret: 164 0.8 Query 207: 0.0086 Query 208: 0.1559 Interpolated Recall - Query 209: 0.0016 Precision Averages: Query 210: 0.0000 at 0.00 0.1873 Query 211: 0.0013 at 0.10 0.1783 0.6 Query 212: 0.0004 at 0.20 0.1681 Query 213: 0.8401 at 0.30 0.1502 Query 214: 0.1111 at 0.40 0.1366 Precision Query 215: 0.0000 at 0.50 0.1341 Query 216: 0.0550 at 0.60 0.1129 0.4 Query 217: 0.0002 at 0.70 0.1074 Query 218: 0.3385 at 0.80 0.0810 Query 219: 0.0043 at 0.90 0.0548 Query 220: 0.0000 at 1.00 0.0490 Query 221: 0.0230 0.2 Query 222: 0.0014 Avg. prec. (non-interpolated) Query 223: 0.0008 for all rel. documents Query 224: 1.0000 0.1199 Query 225: 0.0000 Precision: Query 226: 0.0000 At 5 docs: 0.0978 0.0 Query 228: 0.0000 At 10 docs: 0.0844 0.0 0.2 0.4 0.6 0.8 1.0 Query 229: 0.0014 At 15 docs: 0.0800 Query 230: 0.4576 At 20 docs: 0.0700 Recall Query 232: 0.0000 At 30 docs: 0.0511 Query 233: 0.0000 At 100 docs: 0.0227 Query 234: 0.7190 At 200 docs: 0.0130 Run CLIPS04FRFI1 Query 235: 0.8546 At 500 docs: 0.0065 Comparison to median by topic Query 236: 0.0000 At 1000 docs: 0.0036 Query 237: 0.0004 +1.0 Query 238: 0.0015 R-Precision (prec. after R Query 239: 0.0978 (=num_rel) docs. retrieved): Query 241: 0.1077 Exact: 0.1151 Query 242: 0.5833 Query 243: 0.0000 Query 244: 0.0000 +0.5 Query 245: 0.0030 Query 246: 0.0000 Query 248: 0.0000 Query 249: 0.0049 Query 250: 0.0000 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number JHU/APL, Bilingual English to Portuguese, Auto, TD Run aplbienpta Average precision Overall statistics (individual queries): (for 46 queries): Recall−Precision Values 1.0 Query 201: 0.0321 Total number of documents Query 202: 0.8846 over all queries Query 203: 0.0779 Retrieved: 46000 Query 204: 0.9821 Relevant: 678 Query 205: 0.0889 Rel_ret: 423 0.8 Query 206: 1.0000 Query 207: 0.0399 Interpolated Recall - Query 208: 0.2604 Precision Averages: Query 209: 0.5038 at 0.00 0.4984 Query 210: 0.1920 at 0.10 0.4895 0.6 Query 211: 0.9352 at 0.20 0.4642 Query 212: 0.1189 at 0.30 0.4205 Query 213: 0.5655 at 0.40 0.3722 Precision Query 214: 0.0030 at 0.50 0.3604 Query 215: 0.1000 at 0.60 0.3031 0.4 Query 217: 0.1200 at 0.70 0.2889 Query 218: 0.6928 at 0.80 0.2753 Query 219: 0.0777 at 0.90 0.2566 Query 221: 0.7052 at 1.00 0.2228 Query 222: 0.0249 0.2 Query 223: 0.3333 Avg. prec. (non-interpolated) Query 224: 0.8333 for all rel. documents Query 225: 0.0175 0.3419 Query 226: 0.2003 Precision: Query 228: 0.1310 At 5 docs: 0.2696 0.0 Query 229: 0.0006 At 10 docs: 0.2174 0.0 0.2 0.4 0.6 0.8 1.0 Query 230: 0.6005 At 15 docs: 0.1870 Query 231: 0.0009 At 20 docs: 0.1652 Recall Query 232: 0.0097 At 30 docs: 0.1377 Query 233: 0.6313 At 100 docs: 0.0596 Query 234: 0.8333 At 200 docs: 0.0336 Run aplbienpta Query 235: 0.0000 At 500 docs: 0.0161 Query 236: 0.4741 At 1000 docs: 0.0092 Comparison to median by topic Query 237: 0.4435 +1.0 Query 238: 0.0714 R-Precision (prec. after R Query 239: 0.1801 (=num_rel) docs. retrieved): Query 241: 0.0067 Exact: 0.2887 Query 242: 0.1734 Query 243: 0.0227 Query 244: 0.0065 +0.5 Query 245: 1.0000 Query 246: 1.0000 Query 247: 0.6108 Query 248: 0.2933 Query 249: 0.3665 Query 250: 0.0794 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number JHU/APL, Bilingual Spanish to Portuguese, Auto, TD Run aplbiespta Average precision Overall statistics (individual queries): (for 46 queries): Recall−Precision Values 1.0 Query 201: 0.0328 Total number of documents Query 202: 0.8783 over all queries Query 203: 0.2674 Retrieved: 46000 Query 204: 0.6925 Relevant: 678 Query 205: 0.1213 Rel_ret: 546 0.8 Query 206: 1.0000 Query 207: 0.2988 Interpolated Recall - Query 208: 1.0000 Precision Averages: Query 209: 0.2700 at 0.00 0.6536 Query 210: 0.6461 at 0.10 0.5995 0.6 Query 211: 0.9572 at 0.20 0.5705 Query 212: 0.0833 at 0.30 0.5260 Query 213: 0.6920 at 0.40 0.4910 Precision Query 214: 0.1179 at 0.50 0.4658 Query 215: 1.0000 at 0.60 0.4266 0.4 Query 217: 1.0000 at 0.70 0.4014 Query 218: 0.6510 at 0.80 0.3736 Query 219: 0.1214 at 0.90 0.3398 Query 221: 0.9583 at 1.00 0.3101 Query 222: 0.0000 0.2 Query 223: 0.3333 Avg. prec. (non-interpolated) Query 224: 1.0000 for all rel. documents Query 225: 0.0256 0.4537 Query 226: 0.4447 Precision: Query 228: 0.2442 At 5 docs: 0.3913 0.0 Query 229: 0.2622 At 10 docs: 0.3174 0.0 0.2 0.4 0.6 0.8 1.0 Query 230: 0.3996 At 15 docs: 0.2609 Query 231: 0.0133 At 20 docs: 0.2250 Recall Query 232: 0.3248 At 30 docs: 0.1812 Query 233: 0.6876 At 100 docs: 0.0798 Query 234: 0.5833 At 200 docs: 0.0468 Run aplbiespta Query 235: 0.0217 At 500 docs: 0.0214 Query 236: 0.8056 At 1000 docs: 0.0119 Comparison to median by topic Query 237: 0.6667 +1.0 Query 238: 0.0476 R-Precision (prec. after R Query 239: 0.1902 (=num_rel) docs. retrieved): Query 241: 0.0007 Exact: 0.4187 Query 242: 0.7875 Query 243: 0.2500 Query 244: 0.3333 +0.5 Query 245: 1.0000 Query 246: 0.2000 Query 247: 0.3924 Query 248: 0.7329 Query 249: 0.2670 Query 250: 0.0657 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number JHU/APL, Bilingual Spanish to Portuguese, Auto, TD Run aplbiesptb Average precision Overall statistics (individual queries): (for 46 queries): Recall−Precision Values 1.0 Query 201: 0.0277 Total number of documents Query 202: 0.8171 over all queries Query 203: 0.2318 Retrieved: 46000 Query 204: 0.6148 Relevant: 678 Query 205: 0.2159 Rel_ret: 439 0.8 Query 206: 0.0429 Query 207: 0.5254 Interpolated Recall - Query 208: 0.9667 Precision Averages: Query 209: 0.2679 at 0.00 0.5504 Query 210: 0.1133 at 0.10 0.5123 0.6 Query 211: 0.9669 at 0.20 0.4733 Query 212: 0.2003 at 0.30 0.4468 Query 213: 0.2202 at 0.40 0.4340 Precision Query 214: 0.2974 at 0.50 0.4247 Query 215: 0.2000 at 0.60 0.3759 0.4 Query 217: 0.9367 at 0.70 0.3546 Query 218: 0.8123 at 0.80 0.3018 Query 219: 0.0192 at 0.90 0.2637 Query 221: 1.0000 at 1.00 0.2391 Query 222: 0.0000 0.2 Query 223: 0.5000 Avg. prec. (non-interpolated) Query 224: 1.0000 for all rel. documents Query 225: 0.0035 0.3825 Query 226: 0.6667 Precision: Query 228: 0.5046 At 5 docs: 0.3652 0.0 Query 229: 0.0076 At 10 docs: 0.2826 0.0 0.2 0.4 0.6 0.8 1.0 Query 230: 0.4977 At 15 docs: 0.2333 Query 231: 0.0062 At 20 docs: 0.2054 Recall Query 232: 0.0894 At 30 docs: 0.1594 Query 233: 0.4717 At 100 docs: 0.0680 Query 234: 0.0000 At 200 docs: 0.0377 Run aplbiesptb Query 235: 0.0059 At 500 docs: 0.0175 Query 236: 0.6389 At 1000 docs: 0.0095 Comparison to median by topic Query 237: 1.0000 +1.0 Query 238: 0.0345 R-Precision (prec. after R Query 239: 0.2072 (=num_rel) docs. retrieved): Query 241: 0.0254 Exact: 0.3278 Query 242: 0.4879 Query 243: 0.2500 Query 244: 0.5000 +0.5 Query 245: 0.3206 Query 246: 0.2500 Query 247: 0.8867 Query 248: 0.5840 Query 249: 0.1507 Query 250: 0.0278 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Alicante, Bilingual English to Portuguese, Auto, TD Run IRn−BEnPF−nexp Average precision Overall statistics (individual queries): (for 46 queries): Recall−Precision Values 1.0 Query 201: 0.0258 Total number of documents Query 202: 0.3552 over all queries Query 203: 0.2368 Retrieved: 46000 Query 204: 0.3714 Relevant: 678 Query 205: 0.5192 Rel_ret: 331 0.8 Query 206: 1.0000 Query 207: 0.0093 Interpolated Recall - Query 208: 0.6127 Precision Averages: Query 209: 0.0000 at 0.00 0.4302 Query 210: 0.0051 at 0.10 0.3998 0.6 Query 211: 0.0650 at 0.20 0.3461 Query 212: 0.2185 at 0.30 0.2880 Query 213: 0.4384 at 0.40 0.2551 Precision Query 214: 0.0000 at 0.50 0.2252 Query 215: 0.0025 at 0.60 0.1937 0.4 Query 217: 0.0991 at 0.70 0.1690 Query 218: 0.7111 at 0.80 0.1612 Query 219: 0.0000 at 0.90 0.1502 Query 221: 0.7140 at 1.00 0.1389 Query 222: 0.0027 0.2 Query 223: 0.0769 Avg. prec. (non-interpolated) Query 224: 0.0726 for all rel. documents Query 225: 1.0000 0.2378 Query 226: 0.3594 Precision: Query 228: 0.0380 At 5 docs: 0.2087 0.0 Query 229: 0.0022 At 10 docs: 0.1522 0.0 0.2 0.4 0.6 0.8 1.0 Query 230: 0.6238 At 15 docs: 0.1333 Query 231: 0.0048 At 20 docs: 0.1152 Recall Query 232: 0.0006 At 30 docs: 0.0986 Query 233: 0.6487 At 100 docs: 0.0433 Query 234: 0.0220 At 200 docs: 0.0257 Run IRn−BEnPF−nexp Query 235: 0.0000 At 500 docs: 0.0128 Query 236: 0.1493 At 1000 docs: 0.0072 Comparison to median by topic Query 237: 1.0000 +1.0 Query 238: 0.0179 R-Precision (prec. after R Query 239: 0.0188 (=num_rel) docs. retrieved): Query 241: 0.0278 Exact: 0.2124 Query 242: 0.0172 Query 243: 0.2500 Query 244: 0.0769 +0.5 Query 245: 0.9167 Query 246: 0.0169 Query 247: 0.0131 Query 248: 0.1389 Query 249: 0.0518 Query 250: 0.0055 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Alicante, Bilingual English to Portuguese, Auto, TD Run IRn−BEnPF−Pexp Average precision Overall statistics (individual queries): (for 46 queries): Recall−Precision Values 1.0 Query 201: 0.0255 Total number of documents Query 202: 0.5344 over all queries Query 203: 0.2175 Retrieved: 46000 Query 204: 0.4116 Relevant: 678 Query 205: 0.2692 Rel_ret: 337 0.8 Query 206: 0.3667 Query 207: 0.0087 Interpolated Recall - Query 208: 0.4361 Precision Averages: Query 209: 0.0000 at 0.00 0.3907 Query 210: 0.0000 at 0.10 0.3384 0.6 Query 211: 0.0794 at 0.20 0.3025 Query 212: 0.1649 at 0.30 0.2613 Query 213: 0.5473 at 0.40 0.2326 Precision Query 214: 0.0000 at 0.50 0.2123 Query 215: 0.0286 at 0.60 0.1910 0.4 Query 217: 0.3147 at 0.70 0.1747 Query 218: 0.6478 at 0.80 0.1589 Query 219: 0.0000 at 0.90 0.1436 Query 221: 0.8968 at 1.00 0.1309 Query 222: 0.0000 0.2 Query 223: 0.1250 Avg. prec. (non-interpolated) Query 224: 0.2667 for all rel. documents Query 225: 0.2000 0.2173 Query 226: 0.2926 Precision: Query 228: 0.0371 At 5 docs: 0.2348 0.0 Query 229: 0.0014 At 10 docs: 0.1674 0.0 0.2 0.4 0.6 0.8 1.0 Query 230: 0.4949 At 15 docs: 0.1464 Query 231: 0.0109 At 20 docs: 0.1293 Recall Query 232: 0.0017 At 30 docs: 0.1058 Query 233: 0.6672 At 100 docs: 0.0457 Query 234: 0.0060 At 200 docs: 0.0267 Run IRn−BEnPF−Pexp Query 235: 0.0000 At 500 docs: 0.0133 Query 236: 0.1208 At 1000 docs: 0.0073 Comparison to median by topic Query 237: 1.0000 +1.0 Query 238: 0.0169 R-Precision (prec. after R Query 239: 0.0448 (=num_rel) docs. retrieved): Query 241: 0.0207 Exact: 0.1761 Query 242: 0.1000 Query 243: 0.2000 Query 244: 0.3333 +0.5 Query 245: 0.8056 Query 246: 0.0172 Query 247: 0.0125 Query 248: 0.2428 Query 249: 0.0236 Query 250: 0.0043 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Alicante, Bilingual English to Portuguese, Auto, TD Run IRn−BEnPM−nexp Average precision Overall statistics (individual queries): (for 46 queries): Recall−Precision Values 1.0 Query 201: 0.0288 Total number of documents Query 202: 0.3282 over all queries Query 203: 0.1607 Retrieved: 46000 Query 204: 0.3393 Relevant: 678 Query 205: 0.5208 Rel_ret: 351 0.8 Query 206: 0.6250 Query 207: 0.0447 Interpolated Recall - Query 208: 0.7326 Precision Averages: Query 209: 0.0012 at 0.00 0.4788 Query 210: 0.3179 at 0.10 0.4397 0.6 Query 211: 0.7620 at 0.20 0.4190 Query 212: 0.2628 at 0.30 0.3776 Query 213: 0.5446 at 0.40 0.3308 Precision Query 214: 0.0000 at 0.50 0.3134 Query 215: 0.0179 at 0.60 0.2573 0.4 Query 217: 0.0816 at 0.70 0.2243 Query 218: 0.7119 at 0.80 0.2089 Query 219: 0.0000 at 0.90 0.1880 Query 221: 0.7728 at 1.00 0.1633 Query 222: 0.0024 0.2 Query 223: 0.0909 Avg. prec. (non-interpolated) Query 224: 0.2250 for all rel. documents Query 225: 1.0000 0.2975 Query 226: 0.4570 Precision: Query 228: 0.0189 At 5 docs: 0.2826 0.0 Query 229: 0.0039 At 10 docs: 0.2130 0.0 0.2 0.4 0.6 0.8 1.0 Query 230: 0.6455 At 15 docs: 0.1797 Query 231: 0.0122 At 20 docs: 0.1533 Recall Query 232: 0.0007 At 30 docs: 0.1217 Query 233: 0.6510 At 100 docs: 0.0509 Query 234: 0.0179 At 200 docs: 0.0297 Run IRn−BEnPM−nexp Query 235: 0.0000 At 500 docs: 0.0138 Query 236: 0.1163 At 1000 docs: 0.0076 Comparison to median by topic Query 237: 1.0000 +1.0 Query 238: 0.0164 R-Precision (prec. after R Query 239: 0.0507 (=num_rel) docs. retrieved): Query 241: 0.0523 Exact: 0.2715 Query 242: 0.1520 Query 243: 0.2000 Query 244: 1.0000 +0.5 Query 245: 0.9167 Query 246: 0.0182 Query 247: 0.0154 Query 248: 0.7455 Query 249: 0.0257 Query 250: 0.0000 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Alicante, Bilingual English to Portuguese, Auto, TD Run IRn−BEnPM−Pexp Average precision Overall statistics (individual queries): (for 46 queries): Recall−Precision Values 1.0 Query 201: 0.0208 Total number of documents Query 202: 0.4764 over all queries Query 203: 0.1222 Retrieved: 46000 Query 204: 0.3027 Relevant: 678 Query 205: 0.5200 Rel_ret: 361 0.8 Query 206: 0.2000 Query 207: 0.0490 Interpolated Recall - Query 208: 0.6326 Precision Averages: Query 209: 0.0013 at 0.00 0.5119 Query 210: 0.7208 at 0.10 0.4507 0.6 Query 211: 0.8057 at 0.20 0.4211 Query 212: 0.3217 at 0.30 0.3988 Query 213: 0.5623 at 0.40 0.3431 Precision Query 214: 0.0000 at 0.50 0.3128 Query 215: 0.0455 at 0.60 0.2786 0.4 Query 217: 0.1249 at 0.70 0.2580 Query 218: 0.6570 at 0.80 0.2422 Query 219: 0.0000 at 0.90 0.2032 Query 221: 0.9333 at 1.00 0.1855 Query 222: 0.0017 0.2 Query 223: 0.1111 Avg. prec. (non-interpolated) Query 224: 0.3250 for all rel. documents Query 225: 1.0000 0.3123 Query 226: 0.6083 Precision: Query 228: 0.0159 At 5 docs: 0.2783 0.0 Query 229: 0.0035 At 10 docs: 0.2130 0.0 0.2 0.4 0.6 0.8 1.0 Query 230: 0.5739 At 15 docs: 0.1797 Query 231: 0.0116 At 20 docs: 0.1598 Recall Query 232: 0.0007 At 30 docs: 0.1232 Query 233: 0.6826 At 100 docs: 0.0528 Query 234: 0.0109 At 200 docs: 0.0303 Run IRn−BEnPM−Pexp Query 235: 0.0000 At 500 docs: 0.0140 Query 236: 0.3967 At 1000 docs: 0.0078 Comparison to median by topic Query 237: 1.0000 +1.0 Query 238: 0.0164 R-Precision (prec. after R Query 239: 0.1076 (=num_rel) docs. retrieved): Query 241: 0.0543 Exact: 0.2650 Query 242: 0.2103 Query 243: 0.2000 Query 244: 1.0000 +0.5 Query 245: 0.8056 Query 246: 0.0172 Query 247: 0.0154 Query 248: 0.6765 Query 249: 0.0249 Query 250: 0.0000 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Alicante, Bilingual Spanish to Portuguese, Auto, TD Run IRn−BEsPM−nexp Average precision Overall statistics (individual queries): (for 46 queries): Recall−Precision Values 1.0 Query 201: 0.0498 Total number of documents Query 202: 0.5892 over all queries Query 203: 0.1187 Retrieved: 46000 Query 204: 0.3506 Relevant: 678 Query 205: 0.2083 Rel_ret: 398 0.8 Query 206: 0.6111 Query 207: 0.0051 Interpolated Recall - Query 208: 0.9667 Precision Averages: Query 209: 0.0007 at 0.00 0.4705 Query 210: 0.3958 at 0.10 0.4225 0.6 Query 211: 0.6470 at 0.20 0.3846 Query 212: 0.0000 at 0.30 0.3460 Query 213: 0.4649 at 0.40 0.3196 Precision Query 214: 0.0487 at 0.50 0.3059 Query 215: 0.0099 at 0.60 0.2668 0.4 Query 217: 0.0349 at 0.70 0.2501 Query 218: 0.6707 at 0.80 0.2374 Query 219: 0.0000 at 0.90 0.2088 Query 221: 0.8302 at 1.00 0.1943 Query 222: 0.0008 0.2 Query 223: 0.1667 Avg. prec. (non-interpolated) Query 224: 0.2262 for all rel. documents Query 225: 1.0000 0.2977 Query 226: 0.1207 Precision: Query 228: 0.0455 At 5 docs: 0.2522 0.0 Query 229: 0.0172 At 10 docs: 0.2022 0.0 0.2 0.4 0.6 0.8 1.0 Query 230: 0.5260 At 15 docs: 0.1681 Query 231: 0.0074 At 20 docs: 0.1467 Recall Query 232: 0.0216 At 30 docs: 0.1196 Query 233: 0.5108 At 100 docs: 0.0507 Query 234: 0.0009 At 200 docs: 0.0308 Run IRn−BEsPM−nexp Query 235: 0.0014 At 500 docs: 0.0150 Query 236: 0.4550 At 1000 docs: 0.0087 Comparison to median by topic Query 237: 1.0000 +1.0 Query 238: 0.0141 R-Precision (prec. after R Query 239: 0.0997 (=num_rel) docs. retrieved): Query 241: 0.0184 Exact: 0.2752 Query 242: 0.0668 Query 243: 0.1667 Query 244: 1.0000 +0.5 Query 245: 1.0000 Query 246: 0.0196 Query 247: 0.9127 Query 248: 0.2893 Query 249: 0.0045 Query 250: 0.0000 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Alicante, Bilingual Spanish to Portuguese, Auto, TD Run IRn−BEsPM−Pexp Average precision Overall statistics (individual queries): (for 46 queries): Recall−Precision Values 1.0 Query 201: 0.0306 Total number of documents Query 202: 0.6831 over all queries Query 203: 0.1543 Retrieved: 46000 Query 204: 0.3522 Relevant: 678 Query 205: 0.1394 Rel_ret: 416 0.8 Query 206: 0.1909 Query 207: 0.0058 Interpolated Recall - Query 208: 1.0000 Precision Averages: Query 209: 0.0007 at 0.00 0.4699 Query 210: 0.7012 at 0.10 0.4473 0.6 Query 211: 0.7131 at 0.20 0.4077 Query 212: 0.0000 at 0.30 0.3668 Query 213: 0.6233 at 0.40 0.3408 Precision Query 214: 0.0870 at 0.50 0.3315 Query 215: 0.0238 at 0.60 0.3076 0.4 Query 217: 0.0385 at 0.70 0.2777 Query 218: 0.6262 at 0.80 0.2628 Query 219: 0.0000 at 0.90 0.2345 Query 221: 0.8968 at 1.00 0.2159 Query 222: 0.0008 0.2 Query 223: 0.1667 Avg. prec. (non-interpolated) Query 224: 0.3667 for all rel. documents Query 225: 1.0000 0.3243 Query 226: 0.1467 Precision: Query 228: 0.1479 At 5 docs: 0.3043 0.0 Query 229: 0.0151 At 10 docs: 0.2174 0.0 0.2 0.4 0.6 0.8 1.0 Query 230: 0.6188 At 15 docs: 0.1739 Query 231: 0.0060 At 20 docs: 0.1565 Recall Query 232: 0.0233 At 30 docs: 0.1283 Query 233: 0.6185 At 100 docs: 0.0561 Query 234: 0.0008 At 200 docs: 0.0330 Run IRn−BEsPM−Pexp Query 235: 0.0061 At 500 docs: 0.0160 Query 236: 0.5625 At 1000 docs: 0.0090 Comparison to median by topic Query 237: 1.0000 +1.0 Query 238: 0.0143 R-Precision (prec. after R Query 239: 0.0822 (=num_rel) docs. retrieved): Query 241: 0.0145 Exact: 0.2888 Query 242: 0.1659 Query 243: 0.2000 Query 244: 1.0000 +0.5 Query 245: 1.0000 Query 246: 0.0161 Query 247: 1.0000 Query 248: 0.4715 Query 249: 0.0091 Query 250: 0.0000 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Amsterdam, Bilingual English to Portuguese, Auto, TD Run UAmsC04EnPo4GiSb Average precision Overall statistics Recall−Precision Values (individual queries): (for 46 queries): 1.0 Query 201: 0.0140 Total number of documents Query 202: 0.8211 over all queries Query 203: 0.3287 Retrieved: 46000 Query 204: 0.5158 Relevant: 678 Query 205: 0.4167 Rel_ret: 546 0.8 Query 206: 0.6250 Query 207: 0.1378 Interpolated Recall - Query 208: 0.8143 Precision Averages: Query 209: 0.0746 at 0.00 0.5542 Query 210: 0.8850 at 0.10 0.5257 0.6 Query 211: 0.9277 at 0.20 0.5069 Query 212: 0.5298 at 0.30 0.4910 Query 213: 0.7698 at 0.40 0.4481 Precision Query 214: 0.0265 at 0.50 0.4098 Query 215: 0.2000 at 0.60 0.3601 0.4 Query 217: 0.9571 at 0.70 0.3220 Query 218: 0.8052 at 0.80 0.3022 Query 219: 0.0310 at 0.90 0.2495 Query 221: 0.9242 at 1.00 0.2326 Query 222: 0.0073 0.2 Query 223: 0.5000 Avg. prec. (non-interpolated) Query 224: 0.2083 for all rel. documents Query 225: 0.0244 0.3850 Query 226: 0.5250 Precision: Query 228: 0.0138 At 5 docs: 0.3870 0.0 Query 229: 0.4195 At 10 docs: 0.3043 0.0 0.2 0.4 0.6 0.8 1.0 Query 230: 0.4746 At 15 docs: 0.2478 Query 231: 0.0038 At 20 docs: 0.2130 Recall Query 232: 0.1087 At 30 docs: 0.1703 Query 233: 0.5504 At 100 docs: 0.0780 Query 234: 0.0000 At 200 docs: 0.0470 Run UAmsC04EnPo4GiSb Query 235: 0.0115 At 500 docs: 0.0219 Comparison to median by topic Query 236: 0.3934 At 1000 docs: 0.0119 Query 237: 1.0000 +1.0 Query 238: 0.0667 R-Precision (prec. after R Query 239: 0.1945 (=num_rel) docs. retrieved): Query 241: 0.0872 Exact: 0.3399 Query 242: 0.2396 Query 243: 0.1667 Query 244: 0.0769 +0.5 Query 245: 1.0000 Query 246: 0.2000 Query 247: 1.0000 Query 248: 0.4474 Query 249: 0.1532 Query 250: 0.0338 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Amsterdam, Bilingual English to Portuguese, Auto, TD Run UAmsC04EnPo4iSPC Average precision Overall statistics Recall−Precision Values (individual queries): (for 46 queries): 1.0 Query 201: 0.0026 Total number of documents Query 202: 0.7639 over all queries Query 203: 0.2901 Retrieved: 46000 Query 204: 0.5278 Relevant: 678 Query 205: 0.3333 Rel_ret: 508 0.8 Query 206: 0.1875 Query 207: 0.1939 Interpolated Recall - Query 208: 0.0997 Precision Averages: Query 209: 0.0013 at 0.00 0.4099 Query 210: 0.8048 at 0.10 0.3776 0.6 Query 211: 0.9050 at 0.20 0.3612 Query 212: 0.0010 at 0.30 0.3404 Query 213: 0.5947 at 0.40 0.3162 Precision Query 214: 0.0012 at 0.50 0.2946 Query 215: 0.0105 at 0.60 0.2589 0.4 Query 217: 0.0020 at 0.70 0.2172 Query 218: 0.8228 at 0.80 0.2033 Query 219: 0.0000 at 0.90 0.1738 Query 221: 0.4667 at 1.00 0.1560 Query 222: 0.0029 0.2 Query 223: 0.5000 Avg. prec. (non-interpolated) Query 224: 0.0134 for all rel. documents Query 225: 0.1111 0.2755 Query 226: 0.0822 Precision: Query 228: 0.0261 At 5 docs: 0.2870 0.0 Query 229: 0.8122 At 10 docs: 0.2391 0.0 0.2 0.4 0.6 0.8 1.0 Query 230: 0.4797 At 15 docs: 0.2000 Query 231: 0.0000 At 20 docs: 0.1761 Recall Query 232: 0.2492 At 30 docs: 0.1428 Query 233: 0.0007 At 100 docs: 0.0707 Query 234: 0.0000 At 200 docs: 0.0439 Run UAmsC04EnPo4iSPC Query 235: 0.0000 At 500 docs: 0.0208 Comparison to median by topic Query 236: 0.1280 At 1000 docs: 0.0110 Query 237: 1.0000 +1.0 Query 238: 0.0625 R-Precision (prec. after R Query 239: 0.0715 (=num_rel) docs. retrieved): Query 241: 0.0018 Exact: 0.2159 Query 242: 0.2579 Query 243: 0.0909 Query 244: 0.3333 +0.5 Query 245: 0.8667 Query 246: 0.2000 Query 247: 1.0000 Query 248: 0.2395 Query 249: 0.0775 Query 250: 0.0566 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Amsterdam, Bilingual English to Portuguese, Auto, TD Run UAmsC04EnPo4iSWL Average precision Overall statistics Recall−Precision Values (individual queries): (for 46 queries): 1.0 Query 201: 0.0112 Total number of documents Query 202: 0.8235 over all queries Query 203: 0.2158 Retrieved: 46000 Query 204: 0.6443 Relevant: 678 Query 205: 0.3409 Rel_ret: 404 0.8 Query 206: 0.2111 Query 207: 0.0035 Interpolated Recall - Query 208: 0.7209 Precision Averages: Query 209: 0.0037 at 0.00 0.4241 Query 210: 0.7869 at 0.10 0.4191 0.6 Query 211: 0.9109 at 0.20 0.3960 Query 212: 0.0769 at 0.30 0.3882 Query 213: 0.7410 at 0.40 0.3767 Precision Query 214: 0.0171 at 0.50 0.3492 Query 215: 0.0137 at 0.60 0.3054 0.4 Query 217: 0.0125 at 0.70 0.2804 Query 218: 0.8034 at 0.80 0.2503 Query 219: 0.0088 at 0.90 0.2222 Query 221: 0.9484 at 1.00 0.2058 Query 222: 0.0000 0.2 Query 223: 0.5000 Avg. prec. (non-interpolated) Query 224: 0.7500 for all rel. documents Query 225: 0.1667 0.3207 Query 226: 0.9500 Precision: Query 228: 0.0065 At 5 docs: 0.3087 0.0 Query 229: 0.0243 At 10 docs: 0.2370 0.0 0.2 0.4 0.6 0.8 1.0 Query 230: 0.5219 At 15 docs: 0.1986 Query 231: 0.0023 At 20 docs: 0.1707 Recall Query 232: 0.0519 At 30 docs: 0.1406 Query 233: 0.4894 At 100 docs: 0.0602 Query 234: 0.0433 At 200 docs: 0.0347 Run UAmsC04EnPo4iSWL Query 235: 0.0000 At 500 docs: 0.0160 Comparison to median by topic Query 236: 0.1152 At 1000 docs: 0.0088 Query 237: 1.0000 +1.0 Query 238: 0.0400 R-Precision (prec. after R Query 239: 0.1440 (=num_rel) docs. retrieved): Query 241: 0.0114 Exact: 0.2567 Query 242: 0.3126 Query 243: 0.1111 Query 244: 0.2000 +0.5 Query 245: 0.2778 Query 246: 0.2000 Query 247: 1.0000 Query 248: 0.5202 Query 249: 0.0204 Query 250: 0.0000 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Amsterdam, Bilingual English to Portuguese, Auto, TD Run UAmsC04EnPoAll Average precision Overall statistics Recall−Precision Values (individual queries): (for 46 queries): 1.0 Query 201: 0.0110 Total number of documents Query 202: 0.8113 over all queries Query 203: 0.3778 Retrieved: 46000 Query 204: 0.7459 Relevant: 678 Query 205: 0.5000 Rel_ret: 581 0.8 Query 206: 0.6250 Query 207: 0.1296 Interpolated Recall - Query 208: 0.8393 Precision Averages: Query 209: 0.0759 at 0.00 0.6131 Query 210: 0.8600 at 0.10 0.5768 0.6 Query 211: 0.9379 at 0.20 0.5444 Query 212: 0.3782 at 0.30 0.5174 Query 213: 0.8005 at 0.40 0.4853 Precision Query 214: 0.0059 at 0.50 0.4635 Query 215: 0.2500 at 0.60 0.4197 0.4 Query 217: 0.8240 at 0.70 0.3672 Query 218: 0.8337 at 0.80 0.3416 Query 219: 0.0036 at 0.90 0.3056 Query 221: 0.9107 at 1.00 0.2827 Query 222: 0.0047 0.2 Query 223: 0.5000 Avg. prec. (non-interpolated) Query 224: 0.3667 for all rel. documents Query 225: 1.0000 0.4366 Query 226: 0.6917 Precision: Query 228: 0.0960 At 5 docs: 0.4217 0.0 Query 229: 0.7764 At 10 docs: 0.3239 0.0 0.2 0.4 0.6 0.8 1.0 Query 230: 0.5436 At 15 docs: 0.2565 Query 231: 0.0012 At 20 docs: 0.2239 Recall Query 232: 0.2365 At 30 docs: 0.1848 Query 233: 0.5451 At 100 docs: 0.0893 Query 234: 0.0130 At 200 docs: 0.0536 Run UAmsC04EnPoAll Query 235: 0.0032 At 500 docs: 0.0239 Comparison to median by topic Query 236: 0.3981 At 1000 docs: 0.0126 Query 237: 1.0000 +1.0 Query 238: 0.0526 R-Precision (prec. after R Query 239: 0.1781 (=num_rel) docs. retrieved): Query 241: 0.0543 Exact: 0.3656 Query 242: 0.2270 Query 243: 0.1250 Query 244: 0.3333 +0.5 Query 245: 1.0000 Query 246: 0.3333 Query 247: 1.0000 Query 248: 0.5439 Query 249: 0.0976 Query 250: 0.0436 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Université de Neuchâtel, Bilingual English to Portuguese, Auto, TD Run UniNEBpt1 Average precision Overall statistics (individual queries): (for 46 queries): Recall−Precision Values 1.0 Query 201: 0.0350 Total number of documents Query 202: 0.8565 over all queries Query 203: 0.4145 Retrieved: 46000 Query 204: 0.8632 Relevant: 678 Query 205: 0.2333 Rel_ret: 433 0.8 Query 206: 0.7500 Query 207: 0.1651 Interpolated Recall - Query 208: 1.0000 Precision Averages: Query 209: 0.0009 at 0.00 0.5844 Query 210: 0.8767 at 0.10 0.5740 0.6 Query 211: 0.9188 at 0.20 0.5475 Query 212: 0.4273 at 0.30 0.5301 Query 213: 0.7301 at 0.40 0.5240 Precision Query 214: 0.0074 at 0.50 0.4976 Query 215: 0.1111 at 0.60 0.4411 0.4 Query 217: 0.6114 at 0.70 0.4263 Query 218: 0.8305 at 0.80 0.4158 Query 219: 0.0096 at 0.90 0.3992 Query 221: 0.8972 at 1.00 0.3645 Query 222: 0.0272 0.2 Query 223: 1.0000 Avg. prec. (non-interpolated) Query 224: 1.0000 for all rel. documents Query 225: 0.1429 0.4704 Query 226: 1.0000 Precision: Query 228: 0.2856 At 5 docs: 0.4043 0.0 Query 229: 0.0007 At 10 docs: 0.3239 0.0 0.2 0.4 0.6 0.8 1.0 Query 230: 0.4170 At 15 docs: 0.2536 Query 231: 0.0008 At 20 docs: 0.2185 Recall Query 232: 0.1190 At 30 docs: 0.1732 Query 233: 0.8114 At 100 docs: 0.0683 Query 234: 0.3667 At 200 docs: 0.0386 Run UniNEBpt1 Query 235: 0.0021 At 500 docs: 0.0176 Query 236: 1.0000 At 1000 docs: 0.0094 Comparison to median by topic Query 237: 1.0000 +1.0 Query 238: 0.0526 R-Precision (prec. after R Query 239: 0.1524 (=num_rel) docs. retrieved): Query 241: 0.0048 Exact: 0.4352 Query 242: 0.4266 Query 243: 0.1667 Query 244: 0.0061 +0.5 Query 245: 1.0000 Query 246: 1.0000 Query 247: 1.0000 Query 248: 0.6705 Query 249: 0.2289 Query 250: 0.0174 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Université de Neuchâtel, Bilingual English to Portuguese, Auto, TD Run UniNEBpt2 Average precision Overall statistics (individual queries): (for 46 queries): Recall−Precision Values 1.0 Query 201: 0.0333 Total number of documents Query 202: 0.8471 over all queries Query 203: 0.3940 Retrieved: 46000 Query 204: 0.8632 Relevant: 678 Query 205: 0.6111 Rel_ret: 434 0.8 Query 206: 0.7000 Query 207: 0.1943 Interpolated Recall - Query 208: 1.0000 Precision Averages: Query 209: 0.0011 at 0.00 0.5704 Query 210: 0.8767 at 0.10 0.5607 0.6 Query 211: 0.9090 at 0.20 0.5273 Query 212: 0.4133 at 0.30 0.5141 Query 213: 0.7287 at 0.40 0.5052 Precision Query 214: 0.0056 at 0.50 0.4832 Query 215: 0.1000 at 0.60 0.4221 0.4 Query 217: 0.3176 at 0.70 0.4025 Query 218: 0.8324 at 0.80 0.3874 Query 219: 0.0098 at 0.90 0.3759 Query 221: 0.9151 at 1.00 0.3370 Query 222: 0.0203 0.2 Query 223: 1.0000 Avg. prec. (non-interpolated) Query 224: 1.0000 for all rel. documents Query 225: 0.1429 0.4491 Query 226: 1.0000 Precision: Query 228: 0.0859 At 5 docs: 0.3826 0.0 Query 229: 0.0020 At 10 docs: 0.3087 0.0 0.2 0.4 0.6 0.8 1.0 Query 230: 0.4612 At 15 docs: 0.2478 Query 231: 0.0020 At 20 docs: 0.2141 Recall Query 232: 0.1321 At 30 docs: 0.1681 Query 233: 0.8096 At 100 docs: 0.0663 Query 234: 0.3667 At 200 docs: 0.0378 Run UniNEBpt2 Query 235: 0.0000 At 500 docs: 0.0176 Query 236: 0.9167 At 1000 docs: 0.0094 Comparison to median by topic Query 237: 1.0000 +1.0 Query 238: 0.0500 R-Precision (prec. after R Query 239: 0.1517 (=num_rel) docs. retrieved): Query 241: 0.0070 Exact: 0.3963 Query 242: 0.4512 Query 243: 0.1429 Query 244: 0.0112 +0.5 Query 245: 1.0000 Query 246: 0.3333 Query 247: 1.0000 Query 248: 0.6400 Query 249: 0.1767 Query 250: 0.0034 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number JHU/APL, Bilingual English to Russian, Auto, TD Run aplbibgrub Average precision Overall statistics (individual queries): (for 34 queries): Recall−Precision Values 1.0 Query 201: 0.0015 Total number of documents Query 202: 0.0164 over all queries Query 203: 0.0000 Retrieved: 34000 Query 207: 0.0000 Relevant: 123 Query 209: 0.0169 Rel_ret: 81 0.8 Query 210: 0.2358 Query 211: 1.0000 Interpolated Recall - Query 212: 0.0481 Precision Averages: Query 213: 0.2870 at 0.00 0.2516 Query 214: 0.0410 at 0.10 0.2369 0.6 Query 215: 0.0000 at 0.20 0.2267 Query 216: 0.0000 at 0.30 0.2030 Query 218: 0.1667 at 0.40 0.1818 Precision Query 220: 0.0000 at 0.50 0.1663 Query 221: 0.2582 at 0.60 0.0890 0.4 Query 224: 0.5000 at 0.70 0.0771 Query 225: 0.0000 at 0.80 0.0756 Query 226: 0.0033 at 0.90 0.0686 Query 227: 0.0000 at 1.00 0.0680 Query 228: 0.0012 0.2 Query 230: 0.4102 Avg. prec. (non-interpolated) Query 231: 0.0192 for all rel. documents Query 232: 0.0003 0.1407 Query 233: 0.0064 Precision: Query 234: 0.0010 At 5 docs: 0.1059 0.0 Query 235: 0.0014 At 10 docs: 0.0647 0.0 0.2 0.4 0.6 0.8 1.0 Query 237: 0.3750 At 15 docs: 0.0510 Query 238: 0.0135 At 20 docs: 0.0426 Recall Query 239: 0.1097 At 30 docs: 0.0373 Query 241: 0.2107 At 100 docs: 0.0153 Query 242: 0.0312 At 200 docs: 0.0091 Run aplbibgrub Query 244: 1.0000 At 500 docs: 0.0042 Query 245: 0.0279 At 1000 docs: 0.0024 Comparison to median by topic Query 250: 0.0000 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.1505 +0.5 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number UC Berkeley, Bilingual Chinese to Russian, Auto, TD Run BKRUBLCR1 Average precision Overall statistics Recall−Precision Values (individual queries): (for 34 queries): 1.0 Query 201: 0.0000 Total number of documents Query 202: 0.0005 over all queries Query 203: 0.0164 Retrieved: 34000 Query 207: 0.0000 Relevant: 123 Query 209: 0.0368 Rel_ret: 57 0.8 Query 210: 0.6738 Query 211: 0.0476 Interpolated Recall - Query 212: 0.0143 Precision Averages: Query 213: 0.0001 at 0.00 0.1659 Query 214: 0.8667 at 0.10 0.1659 0.6 Query 215: 0.0033 at 0.20 0.1559 Query 216: 0.0000 at 0.30 0.1167 Query 218: 0.0029 at 0.40 0.1137 Precision Query 220: 0.0007 at 0.50 0.1051 Query 221: 0.5833 at 0.60 0.0844 0.4 Query 224: 0.0014 at 0.70 0.0704 Query 225: 0.1328 at 0.80 0.0551 Query 226: 0.0000 at 0.90 0.0540 Query 227: 0.0013 at 1.00 0.0540 Query 228: 0.0030 0.2 Query 230: 0.2474 Avg. prec. (non-interpolated) Query 231: 0.0141 for all rel. documents Query 232: 0.0003 0.0956 Query 233: 0.2173 Precision: Query 234: 0.0000 At 5 docs: 0.0765 0.0 Query 235: 0.0987 At 10 docs: 0.0471 0.0 0.2 0.4 0.6 0.8 1.0 Query 237: 0.0000 At 15 docs: 0.0373 Query 238: 0.0000 At 20 docs: 0.0294 Recall Query 239: 0.0067 At 30 docs: 0.0216 Query 241: 0.0022 At 100 docs: 0.0085 Query 242: 0.0278 At 200 docs: 0.0053 Run BKRUBLCR1 Query 244: 0.2500 At 500 docs: 0.0030 Comparison to median by topic Query 245: 0.0000 At 1000 docs: 0.0017 Query 250: 0.0000 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.0696 +0.5 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number UC Berkeley, Bilingual Chinese to Russian, Auto, TDN Run BKRUBLCR2 Average precision Overall statistics Recall−Precision Values (individual queries): (for 34 queries): 1.0 Query 201: 0.0000 Total number of documents Query 202: 0.0005 over all queries Query 203: 0.0200 Retrieved: 34000 Query 207: 0.0000 Relevant: 123 Query 209: 0.0250 Rel_ret: 68 0.8 Query 210: 0.5513 Query 211: 0.0482 Interpolated Recall - Query 212: 0.0186 Precision Averages: Query 213: 0.0028 at 0.00 0.1924 Query 214: 0.8667 at 0.10 0.1924 0.6 Query 215: 0.0024 at 0.20 0.1822 Query 216: 0.0000 at 0.30 0.1417 Query 218: 0.0011 at 0.40 0.1414 Precision Query 220: 0.0022 at 0.50 0.1215 Query 221: 0.5833 at 0.60 0.1077 0.4 Query 224: 0.0020 at 0.70 0.0921 Query 225: 0.1885 at 0.80 0.0782 Query 226: 0.0000 at 0.90 0.0776 Query 227: 0.0094 at 1.00 0.0776 Query 228: 0.0022 0.2 Query 230: 0.2604 Avg. prec. (non-interpolated) Query 231: 0.0047 for all rel. documents Query 232: 0.0006 0.1197 Query 233: 0.2878 Precision: Query 234: 0.0000 At 5 docs: 0.0706 0.0 Query 235: 0.0419 At 10 docs: 0.0500 0.0 0.2 0.4 0.6 0.8 1.0 Query 237: 0.0365 At 15 docs: 0.0412 Query 238: 0.0189 At 20 docs: 0.0353 Recall Query 239: 0.0244 At 30 docs: 0.0255 Query 241: 0.0026 At 100 docs: 0.0091 Query 242: 0.0667 At 200 docs: 0.0062 Run BKRUBLCR2 Query 244: 1.0000 At 500 docs: 0.0034 Comparison to median by topic Query 245: 0.0010 At 1000 docs: 0.0020 Query 250: 0.0000 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.0990 +0.5 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number UC Berkeley, Bilingual English to Russian, Auto, TDN Run BKRUBLER1 Average precision Overall statistics Recall−Precision Values (individual queries): (for 34 queries): 1.0 Query 201: 0.0010 Total number of documents Query 202: 0.0009 over all queries Query 203: 0.0025 Retrieved: 34000 Query 207: 0.0087 Relevant: 123 0.8 Query 209: 0.0030 Rel_ret: 69 Query 210: 0.3151 Query 211: 0.8333 Interpolated Recall - Query 212: 0.0070 Precision Averages: Query 213: 0.0005 at 0.00 0.2444 Query 214: 0.4623 at 0.10 0.2430 0.6 Query 215: 0.0038 at 0.20 0.2423 Query 216: 0.5000 at 0.30 0.1809 Query 218: 0.0294 at 0.40 0.1563 Precision Query 220: 0.0000 at 0.50 0.1445 Query 221: 0.5833 at 0.60 0.0896 0.4 Query 224: 0.1250 at 0.70 0.0796 Query 225: 0.1027 at 0.80 0.0771 Query 226: 0.0014 at 0.90 0.0764 Query 227: 0.0088 at 1.00 0.0764 Query 228: 0.0027 0.2 Query 230: 0.1511 Avg. prec. (non-interpolated) Query 231: 0.0074 for all rel. documents Query 232: 0.0002 0.1361 Query 233: 0.2416 Precision: Query 234: 0.0000 At 5 docs: 0.0765 0.0 Query 235: 0.1444 At 10 docs: 0.0500 0.0 0.2 0.4 0.6 0.8 1.0 Query 237: 0.0290 At 15 docs: 0.0412 Query 238: 0.0128 At 20 docs: 0.0338 Recall Query 239: 0.0039 At 30 docs: 0.0255 Query 241: 0.0101 At 100 docs: 0.0097 Query 242: 0.0323 At 200 docs: 0.0054 Run BKRUBLER1 Query 244: 1.0000 At 500 docs: 0.0033 Comparison to median by topic Query 245: 0.0019 At 1000 docs: 0.0020 Query 250: 0.0000 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.1127 +0.5 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number UC Berkeley, Bilingual English to Russian, Auto, TDN Run BKRUBLER2 Average precision Overall statistics Recall−Precision Values (individual queries): (for 34 queries): 1.0 Query 201: 0.0288 Total number of documents Query 202: 0.0008 over all queries Query 203: 0.0061 Retrieved: 34000 Query 207: 0.0000 Relevant: 123 0.8 Query 209: 0.0007 Rel_ret: 85 Query 210: 0.0016 Query 211: 1.0000 Interpolated Recall - Query 212: 0.0846 Precision Averages: Query 213: 0.0054 at 0.00 0.2965 Query 214: 0.0050 at 0.10 0.2965 0.6 Query 215: 0.2000 at 0.20 0.2806 Query 216: 0.5000 at 0.30 0.2269 Query 218: 0.0027 at 0.40 0.2205 Precision Query 220: 0.0751 at 0.50 0.1976 Query 221: 0.5222 at 0.60 0.0940 0.4 Query 224: 0.0383 at 0.70 0.0813 Query 225: 0.0052 at 0.80 0.0806 Query 226: 0.0000 at 0.90 0.0802 Query 227: 0.5000 at 1.00 0.0797 Query 228: 0.0016 0.2 Query 230: 0.2160 Avg. prec. (non-interpolated) Query 231: 1.0000 for all rel. documents Query 232: 0.4792 0.1638 Query 233: 0.1171 Precision: Query 234: 0.0000 At 5 docs: 0.1059 0.0 Query 235: 0.2011 At 10 docs: 0.0647 0.0 0.2 0.4 0.6 0.8 1.0 Query 237: 0.0020 At 15 docs: 0.0529 Query 238: 0.0012 At 20 docs: 0.0426 Recall Query 239: 0.4001 At 30 docs: 0.0314 Query 241: 0.0779 At 100 docs: 0.0144 Query 242: 0.0250 At 200 docs: 0.0085 Run BKRUBLER2 Query 244: 0.0714 At 500 docs: 0.0044 Comparison to median by topic Query 245: 0.0014 At 1000 docs: 0.0025 Query 250: 0.0000 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.1609 +0.5 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number UC Berkeley, Bilingual English to Russian, Auto, TD Run BKRUBLER3 Average precision Overall statistics Recall−Precision Values (individual queries): (for 34 queries): 1.0 Query 201: 0.0000 Total number of documents Query 202: 0.3603 over all queries Query 203: 1.0000 Retrieved: 34000 Query 207: 0.0000 Relevant: 123 0.8 Query 209: 0.3088 Rel_ret: 98 Query 210: 0.3958 Query 211: 1.0000 Interpolated Recall - Query 212: 0.2420 Precision Averages: Query 213: 0.3755 at 0.00 0.5158 Query 214: 0.1144 at 0.10 0.5147 0.6 Query 215: 0.3333 at 0.20 0.4951 Query 216: 0.0000 at 0.30 0.4328 Query 218: 0.2500 at 0.40 0.3617 Precision Query 220: 0.0014 at 0.50 0.3470 Query 221: 0.8333 at 0.60 0.2648 0.4 Query 224: 0.5052 at 0.70 0.2268 Query 225: 0.4206 at 0.80 0.2145 Query 226: 0.0025 at 0.90 0.1997 Query 227: 0.0058 at 1.00 0.1997 Query 228: 0.2500 0.2 Query 230: 0.2461 Avg. prec. (non-interpolated) Query 231: 0.3333 for all rel. documents Query 232: 0.0288 0.3291 Query 233: 0.2641 Precision: Query 234: 0.4556 At 5 docs: 0.1824 0.0 Query 235: 0.0012 At 10 docs: 0.1147 0.0 0.2 0.4 0.6 0.8 1.0 Query 237: 0.3500 At 15 docs: 0.0922 Query 238: 1.0000 At 20 docs: 0.0750 Recall Query 239: 0.3188 At 30 docs: 0.0559 Query 241: 0.1066 At 100 docs: 0.0226 Query 242: 0.0189 At 200 docs: 0.0125 Run BKRUBLER3 Query 244: 1.0000 At 500 docs: 0.0054 Comparison to median by topic Query 245: 0.6667 At 1000 docs: 0.0029 Query 250: 0.0000 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.3010 +0.5 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number UC Berkeley, Bilingual English to Russian, Auto, TDN Run BKRUBLER4 Average precision Overall statistics Recall−Precision Values (individual queries): (for 34 queries): 1.0 Query 201: 0.0013 Total number of documents Query 202: 0.3562 over all queries Query 203: 0.0909 Retrieved: 34000 Query 207: 0.0000 Relevant: 123 0.8 Query 209: 0.3929 Rel_ret: 93 Query 210: 0.3574 Query 211: 1.0000 Interpolated Recall - Query 212: 0.0093 Precision Averages: Query 213: 0.3340 at 0.00 0.4575 Query 214: 0.0233 at 0.10 0.4575 0.6 Query 215: 0.2000 at 0.20 0.4493 Query 216: 0.0000 at 0.30 0.4281 Query 218: 0.2500 at 0.40 0.3239 Precision Query 220: 0.0716 at 0.50 0.2932 Query 221: 0.8333 at 0.60 0.1990 0.4 Query 224: 0.1037 at 0.70 0.1907 Query 225: 0.4206 at 0.80 0.1782 Query 226: 0.0030 at 0.90 0.1629 Query 227: 0.5000 at 1.00 0.1629 Query 228: 0.3333 0.2 Query 230: 0.1731 Avg. prec. (non-interpolated) Query 231: 1.0000 for all rel. documents Query 232: 0.1084 0.2850 Query 233: 0.2574 Precision: Query 234: 0.3434 At 5 docs: 0.1824 0.0 Query 235: 0.0004 At 10 docs: 0.1206 0.0 0.2 0.4 0.6 0.8 1.0 Query 237: 0.3333 At 15 docs: 0.0961 Query 238: 0.2500 At 20 docs: 0.0750 Recall Query 239: 0.4583 At 30 docs: 0.0539 Query 241: 0.0869 At 100 docs: 0.0212 Query 242: 0.0303 At 200 docs: 0.0116 Run BKRUBLER4 Query 244: 1.0000 At 500 docs: 0.0052 Comparison to median by topic Query 245: 0.3667 At 1000 docs: 0.0027 Query 250: 0.0000 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.2575 +0.5 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number UC Berkeley, Bilingual English to Russian, Auto, TD Run BKRUBLJR1 Average precision Overall statistics Recall−Precision Values (individual queries): (for 34 queries): 1.0 Query 201: 0.0000 Total number of documents Query 202: 0.0008 over all queries Query 203: 0.0045 Retrieved: 34000 Query 207: 0.0000 Relevant: 123 0.8 Query 209: 0.0058 Rel_ret: 64 Query 210: 0.6738 Query 211: 0.4167 Interpolated Recall - Query 212: 0.5216 Precision Averages: Query 213: 0.0021 at 0.00 0.2036 Query 214: 0.0005 at 0.10 0.2036 0.6 Query 215: 0.0040 at 0.20 0.1888 Query 216: 0.0000 at 0.30 0.1689 Query 218: 0.0057 at 0.40 0.1607 Precision Query 220: 0.0000 at 0.50 0.1288 Query 221: 0.8333 at 0.60 0.0858 0.4 Query 224: 0.0455 at 0.70 0.0808 Query 225: 0.1611 at 0.80 0.0653 Query 226: 0.0179 at 0.90 0.0611 Query 227: 0.0026 at 1.00 0.0611 Query 228: 0.0030 0.2 Query 230: 0.2550 Avg. prec. (non-interpolated) Query 231: 0.0156 for all rel. documents Query 232: 0.0000 0.1166 Query 233: 0.0583 Precision: Query 234: 0.0000 At 5 docs: 0.1000 0.0 Query 235: 0.4012 At 10 docs: 0.0647 0.0 0.2 0.4 0.6 0.8 1.0 Query 237: 0.3750 At 15 docs: 0.0510 Query 238: 0.0059 At 20 docs: 0.0426 Recall Query 239: 0.0869 At 30 docs: 0.0294 Query 241: 0.0027 At 100 docs: 0.0115 Query 242: 0.0556 At 200 docs: 0.0065 Run BKRUBLJR1 Query 244: 0.0078 At 500 docs: 0.0034 Comparison to median by topic Query 245: 0.0000 At 1000 docs: 0.0019 Query 250: 0.0000 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.0853 +0.5 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number UC Berkeley, Bilingual English to Russian, Auto, TDN Run BKRUBLJR2 Average precision Overall statistics Recall−Precision Values (individual queries): (for 34 queries): 1.0 Query 201: 0.0000 Total number of documents Query 202: 0.0020 over all queries Query 203: 0.0024 Retrieved: 34000 Query 207: 0.0000 Relevant: 123 0.8 Query 209: 0.0037 Rel_ret: 67 Query 210: 0.4668 Query 211: 0.4167 Interpolated Recall - Query 212: 0.0648 Precision Averages: Query 213: 0.0021 at 0.00 0.1709 Query 214: 0.0019 at 0.10 0.1709 0.6 Query 215: 0.0028 at 0.20 0.1699 Query 216: 0.0007 at 0.30 0.1249 Query 218: 0.0017 at 0.40 0.1185 Precision Query 220: 0.0016 at 0.50 0.1130 Query 221: 0.5833 at 0.60 0.0898 0.4 Query 224: 0.0714 at 0.70 0.0846 Query 225: 0.0785 at 0.80 0.0726 Query 226: 0.0018 at 0.90 0.0701 Query 227: 0.0028 at 1.00 0.0701 Query 228: 0.0023 0.2 Query 230: 0.1935 Avg. prec. (non-interpolated) Query 231: 0.0043 for all rel. documents Query 232: 0.0006 0.1050 Query 233: 0.0903 Precision: Query 234: 0.0000 At 5 docs: 0.0765 0.0 Query 235: 0.0764 At 10 docs: 0.0500 0.0 0.2 0.4 0.6 0.8 1.0 Query 237: 0.3750 At 15 docs: 0.0373 Query 238: 0.0000 At 20 docs: 0.0309 Recall Query 239: 0.0721 At 30 docs: 0.0255 Query 241: 0.0017 At 100 docs: 0.0103 Query 242: 0.0500 At 200 docs: 0.0060 Run BKRUBLJR2 Query 244: 1.0000 At 500 docs: 0.0032 Comparison to median by topic Query 245: 0.0006 At 1000 docs: 0.0020 Query 250: 0.0000 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.0868 +0.5 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number CLIPS, Bilingual English to Russian, Auto, TDN Run CLIPS04ENRU1 Average precision Overall statistics Recall−Precision Values (individual queries): (for 34 queries): 1.0 Query 201: 0.0004 Total number of documents Query 202: 0.0076 over all queries Query 203: 0.0000 Retrieved: 33001 Query 207: 0.0000 Relevant: 123 Query 209: 0.0231 Rel_ret: 73 0.8 Query 210: 0.4515 Query 211: 0.2429 Interpolated Recall - Query 212: 0.0007 Precision Averages: Query 213: 0.0281 at 0.00 0.1710 Query 214: 0.0000 at 0.10 0.1710 0.6 Query 215: 0.5000 at 0.20 0.1444 Query 216: 0.0078 at 0.30 0.1194 Query 218: 0.0079 at 0.40 0.1150 Precision Query 220: 0.0019 at 0.50 0.1113 Query 221: 0.0814 at 0.60 0.0999 0.4 Query 224: 0.0005 at 0.70 0.0979 Query 225: 0.0000 at 0.80 0.0958 Query 226: 1.0000 at 0.90 0.0937 Query 227: 0.0038 at 1.00 0.0931 Query 228: 0.0294 0.2 Query 230: 0.1554 Avg. prec. (non-interpolated) Query 231: 0.0000 for all rel. documents Query 232: 0.0518 0.1137 Query 233: 0.0284 Precision: Query 234: 0.0000 At 5 docs: 0.0353 0.0 Query 235: 0.0003 At 10 docs: 0.0353 0.0 0.2 0.4 0.6 0.8 1.0 Query 237: 0.0005 At 15 docs: 0.0333 Query 238: 0.0020 At 20 docs: 0.0294 Recall Query 239: 0.0908 At 30 docs: 0.0235 Query 241: 0.0578 At 100 docs: 0.0124 Query 242: 0.0833 At 200 docs: 0.0071 Run CLIPS04ENRU1 Query 244: 0.0060 At 500 docs: 0.0036 Comparison to median by topic Query 245: 0.0015 At 1000 docs: 0.0021 Query 250: 1.0000 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.0768 +0.5 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number CLIPS, Bilingual English to Russian, Auto, TDN Run CLIPS04ENRU2 Average precision Overall statistics Recall−Precision Values (individual queries): (for 34 queries): 1.0 Query 201: 0.0196 Total number of documents Query 202: 0.0092 over all queries Query 203: 0.0010 Retrieved: 33001 Query 207: 0.0000 Relevant: 123 Query 209: 0.0006 Rel_ret: 56 0.8 Query 210: 0.2662 Query 211: 0.2262 Interpolated Recall - Query 212: 0.0002 Precision Averages: Query 213: 0.0092 at 0.00 0.0859 Query 214: 0.0005 at 0.10 0.0859 0.6 Query 215: 0.5000 at 0.20 0.0768 Query 216: 0.0000 at 0.30 0.0468 Query 218: 0.0040 at 0.40 0.0435 Precision Query 220: 0.0022 at 0.50 0.0417 Query 221: 0.0160 at 0.60 0.0401 0.4 Query 224: 0.0000 at 0.70 0.0343 Query 225: 0.0000 at 0.80 0.0336 Query 226: 0.1429 at 0.90 0.0333 Query 227: 0.0000 at 1.00 0.0333 Query 228: 0.0417 0.2 Query 230: 0.0254 Avg. prec. (non-interpolated) Query 231: 0.0013 for all rel. documents Query 232: 0.0207 0.0462 Query 233: 0.0000 Precision: Query 234: 0.0000 At 5 docs: 0.0176 0.0 Query 235: 0.0000 At 10 docs: 0.0294 0.0 0.2 0.4 0.6 0.8 1.0 Query 237: 0.0004 At 15 docs: 0.0216 Query 238: 0.0000 At 20 docs: 0.0191 Recall Query 239: 0.1103 At 30 docs: 0.0157 Query 241: 0.0247 At 100 docs: 0.0071 Query 242: 0.0222 At 200 docs: 0.0044 Run CLIPS04ENRU2 Query 244: 0.0000 At 500 docs: 0.0024 Comparison to median by topic Query 245: 0.0014 At 1000 docs: 0.0016 Query 250: 0.1250 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.0136 +0.5 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number CLIPS, Bilingual French to Russian, Auto, TDN Run CLIPS04FRRU1 Average precision Overall statistics Recall−Precision Values (individual queries): (for 34 queries): 1.0 Query 201: 0.0000 Total number of documents Query 202: 0.0173 over all queries Query 203: 0.0025 Retrieved: 32007 Query 207: 0.0000 Relevant: 123 Query 209: 0.0055 Rel_ret: 43 0.8 Query 210: 0.0179 Query 211: 0.4167 Interpolated Recall - Query 212: 0.0044 Precision Averages: Query 213: 0.0106 at 0.00 0.0847 Query 214: 0.0023 at 0.10 0.0847 0.6 Query 215: 0.5000 at 0.20 0.0847 Query 216: 0.0000 at 0.30 0.0697 Query 218: 0.0016 at 0.40 0.0686 Precision Query 220: 0.0000 at 0.50 0.0683 Query 221: 0.0118 at 0.60 0.0626 0.4 Query 224: 0.0000 at 0.70 0.0449 Query 225: 0.0000 at 0.80 0.0446 Query 226: 0.1429 at 0.90 0.0446 Query 227: 0.0000 at 1.00 0.0446 Query 228: 0.0074 0.2 Query 230: 0.0043 Avg. prec. (non-interpolated) Query 231: 0.0000 for all rel. documents Query 232: 0.0000 0.0612 Query 233: 0.0028 Precision: Query 234: 0.0000 At 5 docs: 0.0353 0.0 Query 235: 0.4200 At 10 docs: 0.0235 0.0 0.2 0.4 0.6 0.8 1.0 Query 237: 0.0000 At 15 docs: 0.0176 Query 238: 0.0000 At 20 docs: 0.0132 Recall Query 239: 0.0000 At 30 docs: 0.0088 Query 241: 0.0052 At 100 docs: 0.0053 Query 242: 0.5000 At 200 docs: 0.0038 Run CLIPS04FRRU1 Query 244: 0.0083 At 500 docs: 0.0022 Comparison to median by topic Query 245: 0.0000 At 1000 docs: 0.0013 Query 250: 0.0000 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.0324 +0.5 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number CLIPS, Bilingual French to Russian, Auto, TDN Run CLIPS04FRRU2 Average precision Overall statistics Recall−Precision Values (individual queries): (for 34 queries): 1.0 Query 201: 0.0000 Total number of documents Query 202: 0.0173 over all queries Query 203: 0.0019 Retrieved: 32007 Query 207: 0.0000 Relevant: 123 Query 209: 0.0055 Rel_ret: 48 0.8 Query 210: 0.0156 Query 211: 0.4167 Interpolated Recall - Query 212: 0.0040 Precision Averages: Query 213: 0.0106 at 0.00 0.0682 Query 214: 0.0023 at 0.10 0.0682 0.6 Query 215: 0.5000 at 0.20 0.0676 Query 216: 0.0000 at 0.30 0.0635 Query 218: 0.0011 at 0.40 0.0626 Precision Query 220: 0.0000 at 0.50 0.0626 Query 221: 0.0093 at 0.60 0.0572 0.4 Query 224: 0.0000 at 0.70 0.0423 Query 225: 0.0000 at 0.80 0.0416 Query 226: 0.0500 at 0.90 0.0416 Query 227: 0.0000 at 1.00 0.0416 Query 228: 0.0074 0.2 Query 230: 0.0024 Avg. prec. (non-interpolated) Query 231: 0.0000 for all rel. documents Query 232: 0.0001 0.0550 Query 233: 0.0077 Precision: Query 234: 0.0000 At 5 docs: 0.0294 0.0 Query 235: 0.3000 At 10 docs: 0.0206 0.0 0.2 0.4 0.6 0.8 1.0 Query 237: 0.0000 At 15 docs: 0.0137 Query 238: 0.0000 At 20 docs: 0.0132 Recall Query 239: 0.0000 At 30 docs: 0.0108 Query 241: 0.0171 At 100 docs: 0.0056 Query 242: 0.5000 At 200 docs: 0.0040 Run CLIPS04FRRU2 Query 244: 0.0000 At 500 docs: 0.0021 Comparison to median by topic Query 245: 0.0000 At 1000 docs: 0.0014 Query 250: 0.0000 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.0265 +0.5 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Dublin City University, Bilingual English to Russian, Auto, TD Run exerussbi04a Average precision Overall statistics Recall−Precision Values (individual queries): (for 34 queries): 1.0 Query 201: 0.0000 Total number of documents Query 202: 0.3912 over all queries Query 203: 1.0000 Retrieved: 34000 Query 207: 0.0000 Relevant: 123 Query 209: 0.8333 Rel_ret: 96 0.8 Query 210: 0.5799 Query 211: 1.0000 Interpolated Recall - Query 212: 0.1487 Precision Averages: Query 213: 0.2327 at 0.00 0.4945 Query 214: 0.0093 at 0.10 0.4945 0.6 Query 215: 1.0000 at 0.20 0.4729 Query 216: 0.0000 at 0.30 0.4192 Query 218: 0.2500 at 0.40 0.3438 Precision Query 220: 0.0045 at 0.50 0.3406 Query 221: 0.2722 at 0.60 0.2582 0.4 Query 224: 0.1308 at 0.70 0.2151 Query 225: 0.3687 at 0.80 0.2112 Query 226: 0.0182 at 0.90 0.2023 Query 227: 0.1250 at 1.00 0.2017 Query 228: 0.0244 0.2 Query 230: 0.2258 Avg. prec. (non-interpolated) Query 231: 1.0000 for all rel. documents Query 232: 0.1167 0.3195 Query 233: 0.2279 Precision: Query 234: 0.5646 At 5 docs: 0.1824 0.0 Query 235: 0.0004 At 10 docs: 0.1059 0.0 0.2 0.4 0.6 0.8 1.0 Query 237: 0.2500 At 15 docs: 0.0765 Query 238: 0.5000 At 20 docs: 0.0632 Recall Query 239: 0.1041 At 30 docs: 0.0490 Query 241: 0.0535 At 100 docs: 0.0200 Query 242: 0.0312 At 200 docs: 0.0110 Run exerussbi04a Query 244: 1.0000 At 500 docs: 0.0052 Comparison to median by topic Query 245: 0.4000 At 1000 docs: 0.0028 Query 250: 0.0000 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.3060 +0.5 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Dublin City University, Bilingual English to Russian, Auto, TD Run exerussbi04amg Average precision Overall statistics (individual queries): (for 34 queries): Recall−Precision Values 1.0 Query 201: 0.0012 Total number of documents Query 202: 0.3864 over all queries Query 203: 1.0000 Retrieved: 34000 Query 207: 0.0000 Relevant: 123 Query 209: 1.0000 Rel_ret: 95 0.8 Query 210: 0.3839 Query 211: 1.0000 Interpolated Recall - Query 212: 0.5256 Precision Averages: Query 213: 0.2287 at 0.00 0.4990 Query 214: 0.0033 at 0.10 0.4990 0.6 Query 215: 1.0000 at 0.20 0.4961 Query 216: 0.0012 at 0.30 0.4121 Query 218: 0.2500 at 0.40 0.3450 Precision Query 220: 0.0062 at 0.50 0.3334 Query 221: 0.5500 at 0.60 0.2399 0.4 Query 224: 0.1667 at 0.70 0.2036 Query 225: 0.2130 at 0.80 0.1985 Query 226: 0.0385 at 0.90 0.1862 Query 227: 0.5000 at 1.00 0.1860 Query 228: 0.0039 0.2 Query 230: 0.1773 Avg. prec. (non-interpolated) Query 231: 1.0000 for all rel. documents Query 232: 0.1140 0.3125 Query 233: 0.1713 Precision: Query 234: 0.0296 At 5 docs: 0.1765 0.0 Query 235: 0.0000 At 10 docs: 0.1088 0.0 0.2 0.4 0.6 0.8 1.0 Query 237: 0.2500 At 15 docs: 0.0784 Query 238: 0.3333 At 20 docs: 0.0676 Recall Query 239: 0.2985 At 30 docs: 0.0529 Query 241: 0.0839 At 100 docs: 0.0197 Query 242: 0.0097 At 200 docs: 0.0110 Run exerussbi04amg Query 244: 0.5000 At 500 docs: 0.0050 Query 245: 0.4000 At 1000 docs: 0.0028 Comparison to median by topic Query 250: 0.0000 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.2923 +0.5 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Dublin City University, Bilingual English to Russian, Auto, TD Run exerussbi04l Average precision Overall statistics Recall−Precision Values (individual queries): (for 34 queries): 1.0 Query 201: 0.0000 Total number of documents Query 202: 0.3820 over all queries Query 203: 1.0000 Retrieved: 34000 Query 207: 0.0000 Relevant: 123 Query 209: 0.5833 Rel_ret: 95 0.8 Query 210: 0.5799 Query 211: 1.0000 Interpolated Recall - Query 212: 0.2616 Precision Averages: Query 213: 0.2377 at 0.00 0.5021 Query 214: 0.0088 at 0.10 0.5021 0.6 Query 215: 1.0000 at 0.20 0.4653 Query 216: 0.0000 at 0.30 0.4049 Query 218: 0.2500 at 0.40 0.3106 Precision Query 220: 0.0028 at 0.50 0.3081 Query 221: 0.2727 at 0.60 0.2294 0.4 Query 224: 0.1310 at 0.70 0.1863 Query 225: 0.5444 at 0.80 0.1827 Query 226: 0.0204 at 0.90 0.1739 Query 227: 0.2500 at 1.00 0.1731 Query 228: 0.0256 0.2 Query 230: 0.2243 Avg. prec. (non-interpolated) Query 231: 0.5000 for all rel. documents Query 232: 0.1093 0.2959 Query 233: 0.2134 Precision: Query 234: 0.5670 At 5 docs: 0.1765 0.0 Query 235: 0.0004 At 10 docs: 0.1088 0.0 0.2 0.4 0.6 0.8 1.0 Query 237: 0.2500 At 15 docs: 0.0765 Query 238: 0.5000 At 20 docs: 0.0632 Recall Query 239: 0.1491 At 30 docs: 0.0480 Query 241: 0.0586 At 100 docs: 0.0200 Query 242: 0.0312 At 200 docs: 0.0113 Run exerussbi04l Query 244: 0.5000 At 500 docs: 0.0051 Comparison to median by topic Query 245: 0.4074 At 1000 docs: 0.0028 Query 250: 0.0000 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.2560 +0.5 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Dublin City University, Bilingual English to Russian, Auto, TD Run exerussbi04q Average precision Overall statistics (individual queries): (for 34 queries): Recall−Precision Values 1.0 Query 201: 0.0000 Total number of documents Query 202: 0.3786 over all queries Query 203: 1.0000 Retrieved: 34000 Query 207: 0.0000 Relevant: 123 Query 209: 0.8333 Rel_ret: 95 0.8 Query 210: 0.5799 Query 211: 1.0000 Interpolated Recall - Query 212: 0.2775 Precision Averages: Query 213: 0.2257 at 0.00 0.4916 Query 214: 0.0063 at 0.10 0.4916 0.6 Query 215: 1.0000 at 0.20 0.4525 Query 216: 0.0000 at 0.30 0.3943 Query 218: 0.2500 at 0.40 0.3311 Precision Query 220: 0.0059 at 0.50 0.3289 Query 221: 0.2738 at 0.60 0.2457 0.4 Query 224: 0.1074 at 0.70 0.2016 Query 225: 0.3889 at 0.80 0.1975 Query 226: 0.0147 at 0.90 0.1895 Query 227: 0.1250 at 1.00 0.1887 Query 228: 0.0357 0.2 Query 230: 0.2278 Avg. prec. (non-interpolated) Query 231: 1.0000 for all rel. documents Query 232: 0.1149 0.3048 Query 233: 0.1932 Precision: Query 234: 0.3955 At 5 docs: 0.1765 0.0 Query 235: 0.0003 At 10 docs: 0.1088 0.0 0.2 0.4 0.6 0.8 1.0 Query 237: 0.2500 At 15 docs: 0.0784 Query 238: 0.5000 At 20 docs: 0.0647 Recall Query 239: 0.1509 At 30 docs: 0.0500 Query 241: 0.0558 At 100 docs: 0.0200 Query 242: 0.0435 At 200 docs: 0.0110 Run exerussbi04q Query 244: 0.5000 At 500 docs: 0.0049 Query 245: 0.4286 At 1000 docs: 0.0028 Comparison to median by topic Query 250: 0.0000 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.2722 +0.5 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Dublin City University, Bilingual English to Russian, Auto, TD Run exerussbi04t Average precision Overall statistics Recall−Precision Values (individual queries): (for 34 queries): 1.0 Query 201: 0.0000 Total number of documents Query 202: 0.3856 over all queries Query 203: 1.0000 Retrieved: 34000 Query 207: 0.0000 Relevant: 123 Query 209: 0.8333 Rel_ret: 96 0.8 Query 210: 0.5833 Query 211: 1.0000 Interpolated Recall - Query 212: 0.2227 Precision Averages: Query 213: 0.2420 at 0.00 0.5180 Query 214: 0.0078 at 0.10 0.5180 0.6 Query 215: 1.0000 at 0.20 0.4954 Query 216: 0.0000 at 0.30 0.4236 Query 218: 0.2500 at 0.40 0.3431 Precision Query 220: 0.0046 at 0.50 0.3404 Query 221: 0.2727 at 0.60 0.2611 0.4 Query 224: 0.1033 at 0.70 0.2048 Query 225: 0.5354 at 0.80 0.2006 Query 226: 0.0154 at 0.90 0.1904 Query 227: 0.1250 at 1.00 0.1897 Query 228: 0.0238 0.2 Query 230: 0.2263 Avg. prec. (non-interpolated) Query 231: 0.5000 for all rel. documents Query 232: 0.1177 0.3210 Query 233: 0.2285 Precision: Query 234: 0.7083 At 5 docs: 0.1824 0.0 Query 235: 0.0005 At 10 docs: 0.1059 0.0 0.2 0.4 0.6 0.8 1.0 Query 237: 0.2500 At 15 docs: 0.0804 Query 238: 0.5000 At 20 docs: 0.0676 Recall Query 239: 0.2612 At 30 docs: 0.0529 Query 241: 0.0529 At 100 docs: 0.0206 Query 242: 0.0455 At 200 docs: 0.0110 Run exerussbi04t Query 244: 1.0000 At 500 docs: 0.0051 Comparison to median by topic Query 245: 0.4167 At 1000 docs: 0.0028 Query 250: 0.0000 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.2830 +0.5 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Alicante, Bilingual English to Russian, Auto, TD Run IRn−BEnR−Dexp Average precision Overall statistics (individual queries): (for 34 queries): Recall−Precision Values 1.0 Query 201: 0.0203 Total number of documents Query 202: 0.3419 over all queries Query 203: 1.0000 Retrieved: 34000 Query 207: 0.0000 Relevant: 123 Query 209: 0.7500 Rel_ret: 111 0.8 Query 210: 0.4237 Query 211: 0.8333 Interpolated Recall - Query 212: 0.5690 Precision Averages: Query 213: 0.2093 at 0.00 0.4529 Query 214: 0.0072 at 0.10 0.4508 0.6 Query 215: 0.3333 at 0.20 0.4403 Query 216: 0.0066 at 0.30 0.4068 Query 218: 0.5833 at 0.40 0.3560 Precision Query 220: 0.0102 at 0.50 0.3533 Query 221: 0.8333 at 0.60 0.2988 0.4 Query 224: 0.2250 at 0.70 0.2874 Query 225: 0.2421 at 0.80 0.2835 Query 226: 0.0128 at 0.90 0.2695 Query 227: 0.0152 at 1.00 0.2658 Query 228: 0.0069 0.2 Query 230: 0.2166 Avg. prec. (non-interpolated) Query 231: 1.0000 for all rel. documents Query 232: 0.0781 0.3357 Query 233: 0.2549 Precision: Query 234: 0.0081 At 5 docs: 0.1882 0.0 Query 235: 0.0069 At 10 docs: 0.1294 0.0 0.2 0.4 0.6 0.8 1.0 Query 237: 0.7929 At 15 docs: 0.0941 Query 238: 1.0000 At 20 docs: 0.0779 Recall Query 239: 0.0929 At 30 docs: 0.0608 Query 241: 0.2269 At 100 docs: 0.0271 Query 242: 0.0159 At 200 docs: 0.0144 Run IRn−BEnR−Dexp Query 244: 1.0000 At 500 docs: 0.0065 Query 245: 0.2963 At 1000 docs: 0.0033 Comparison to median by topic Query 250: 0.0000 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.2835 +0.5 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Alicante, Bilingual English to Russian, Auto, TD Run IRn−BEnR−nexp Average precision Overall statistics (individual queries): (for 34 queries): Recall−Precision Values 1.0 Query 201: 0.0266 Total number of documents Query 202: 0.3478 over all queries Query 203: 1.0000 Retrieved: 34000 Query 207: 0.0000 Relevant: 123 Query 209: 0.8333 Rel_ret: 108 0.8 Query 210: 0.5771 Query 211: 1.0000 Interpolated Recall - Query 212: 0.2704 Precision Averages: Query 213: 0.1415 at 0.00 0.4467 Query 214: 0.0056 at 0.10 0.4467 0.6 Query 215: 0.1429 at 0.20 0.4402 Query 216: 0.0040 at 0.30 0.4066 Query 218: 0.5833 at 0.40 0.3643 Precision Query 220: 0.0095 at 0.50 0.3608 Query 221: 0.6667 at 0.60 0.2895 0.4 Query 224: 0.7500 at 0.70 0.2683 Query 225: 0.2329 at 0.80 0.2563 Query 226: 0.0026 at 0.90 0.2486 Query 227: 0.0385 at 1.00 0.2469 Query 228: 0.0156 0.2 Query 230: 0.1229 Avg. prec. (non-interpolated) Query 231: 0.1429 for all rel. documents Query 232: 0.0364 0.3296 Query 233: 0.2164 Precision: Query 234: 0.0181 At 5 docs: 0.1765 0.0 Query 235: 0.0058 At 10 docs: 0.1206 0.0 0.2 0.4 0.6 0.8 1.0 Query 237: 0.7409 At 15 docs: 0.0882 Query 238: 1.0000 At 20 docs: 0.0676 Recall Query 239: 0.1259 At 30 docs: 0.0559 Query 241: 0.1451 At 100 docs: 0.0232 Query 242: 0.0033 At 200 docs: 0.0129 Run IRn−BEnR−nexp Query 244: 1.0000 At 500 docs: 0.0060 Query 245: 1.0000 At 1000 docs: 0.0032 Comparison to median by topic Query 250: 0.0000 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.2959 +0.5 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Alicante, Bilingual Spanish to Russian, Auto, TD Run IRn−BEsR−Dexp Average precision Overall statistics (individual queries): (for 34 queries): Recall−Precision Values 1.0 Query 201: 0.0139 Total number of documents Query 202: 0.3700 over all queries Query 203: 1.0000 Retrieved: 34000 Query 207: 0.0000 Relevant: 123 Query 209: 0.0792 Rel_ret: 106 0.8 Query 210: 0.4470 Query 211: 0.8333 Interpolated Recall - Query 212: 0.0147 Precision Averages: Query 213: 0.3130 at 0.00 0.4356 Query 214: 0.0068 at 0.10 0.4282 0.6 Query 215: 0.3333 at 0.20 0.4197 Query 216: 0.0022 at 0.30 0.3664 Query 218: 0.5833 at 0.40 0.3293 Precision Query 220: 0.0098 at 0.50 0.3224 Query 221: 0.6429 at 0.60 0.2712 0.4 Query 224: 0.1833 at 0.70 0.2441 Query 225: 0.0833 at 0.80 0.2390 Query 226: 0.0455 at 0.90 0.2352 Query 227: 0.0714 at 1.00 0.2292 Query 228: 0.0060 0.2 Query 230: 0.1649 Avg. prec. (non-interpolated) Query 231: 1.0000 for all rel. documents Query 232: 0.0529 0.3087 Query 233: 0.2673 Precision: Query 234: 0.0010 At 5 docs: 0.1529 0.0 Query 235: 0.0103 At 10 docs: 0.1088 0.0 0.2 0.4 0.6 0.8 1.0 Query 237: 0.8875 At 15 docs: 0.0824 Query 238: 1.0000 At 20 docs: 0.0676 Recall Query 239: 0.1214 At 30 docs: 0.0559 Query 241: 0.1649 At 100 docs: 0.0232 Query 242: 0.0200 At 200 docs: 0.0132 Run IRn−BEsR−Dexp Query 244: 1.0000 At 500 docs: 0.0059 Query 245: 0.7667 At 1000 docs: 0.0031 Comparison to median by topic Query 250: 0.0000 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.2547 +0.5 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Alicante, Bilingual Spanish to Russian, Auto, TD Run IRn−BEsR−nexp Average precision Overall statistics (individual queries): (for 34 queries): Recall−Precision Values 1.0 Query 201: 0.0163 Total number of documents Query 202: 0.3668 over all queries Query 203: 1.0000 Retrieved: 34000 Query 207: 0.0000 Relevant: 123 Query 209: 0.2672 Rel_ret: 101 0.8 Query 210: 0.6917 Query 211: 1.0000 Interpolated Recall - Query 212: 0.0174 Precision Averages: Query 213: 0.1887 at 0.00 0.4106 Query 214: 0.0012 at 0.10 0.4098 0.6 Query 215: 0.1429 at 0.20 0.4042 Query 216: 0.0000 at 0.30 0.3675 Query 218: 0.5833 at 0.40 0.3256 Precision Query 220: 0.0141 at 0.50 0.3182 Query 221: 0.5909 at 0.60 0.2602 0.4 Query 224: 0.2500 at 0.70 0.2546 Query 225: 0.1111 at 0.80 0.2404 Query 226: 0.0208 at 0.90 0.2378 Query 227: 0.0714 at 1.00 0.2349 Query 228: 0.0087 0.2 Query 230: 0.0629 Avg. prec. (non-interpolated) Query 231: 1.0000 for all rel. documents Query 232: 0.0263 0.3044 Query 233: 0.2319 Precision: Query 234: 0.0100 At 5 docs: 0.1588 0.0 Query 235: 0.0053 At 10 docs: 0.1000 0.0 0.2 0.4 0.6 0.8 1.0 Query 237: 0.9500 At 15 docs: 0.0765 Query 238: 0.5000 At 20 docs: 0.0647 Recall Query 239: 0.0844 At 30 docs: 0.0471 Query 241: 0.1379 At 100 docs: 0.0212 Query 242: 0.0000 At 200 docs: 0.0113 Run IRn−BEsR−nexp Query 244: 1.0000 At 500 docs: 0.0055 Query 245: 1.0000 At 1000 docs: 0.0030 Comparison to median by topic Query 250: 0.0000 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.2711 +0.5 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Chicago, Bilingual English to Russian, Auto, T Run UCERBiT1 Average precision Overall statistics Recall−Precision Values (individual queries): (for 34 queries): 1.0 Query 201: 0.0021 Total number of documents Query 202: 0.0014 over all queries Query 203: 0.0014 Retrieved: 34000 Query 207: 0.0036 Relevant: 123 Query 209: 0.0030 Rel_ret: 43 0.8 Query 210: 0.0003 Query 211: 0.0010 Interpolated Recall - Query 212: 0.0071 Precision Averages: Query 213: 0.0033 at 0.00 0.0065 Query 214: 0.0013 at 0.10 0.0065 0.6 Query 215: 0.0000 at 0.20 0.0042 Query 216: 0.0000 at 0.30 0.0040 Query 218: 0.0000 at 0.40 0.0026 Precision Query 220: 0.0000 at 0.50 0.0025 Query 221: 0.0173 at 0.60 0.0011 0.4 Query 224: 0.0000 at 0.70 0.0008 Query 225: 0.0090 at 0.80 0.0008 Query 226: 0.0000 at 0.90 0.0008 Query 227: 0.0026 at 1.00 0.0008 Query 228: 0.0000 0.2 Query 230: 0.0041 Avg. prec. (non-interpolated) Query 231: 0.0000 for all rel. documents Query 232: 0.0004 0.0025 Query 233: 0.0011 Precision: Query 234: 0.0026 At 5 docs: 0.0000 0.0 Query 235: 0.0000 At 10 docs: 0.0000 0.0 0.2 0.4 0.6 0.8 1.0 Query 237: 0.0000 At 15 docs: 0.0000 Query 238: 0.0172 At 20 docs: 0.0000 Recall Query 239: 0.0020 At 30 docs: 0.0020 Query 241: 0.0030 At 100 docs: 0.0015 Query 242: 0.0000 At 200 docs: 0.0015 Run UCERBiT1 Query 244: 0.0000 At 500 docs: 0.0012 Comparison to median by topic Query 245: 0.0006 At 1000 docs: 0.0013 Query 250: 0.0010 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.0000 +0.5 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Hildesheim, Bilingual English to Russian, Auto, TD Run UHIenru1 Average precision Overall statistics Recall−Precision Values (individual queries): (for 34 queries): 1.0 Query 201: 0.0072 Total number of documents Query 202: 0.0099 over all queries Query 203: 1.0000 Retrieved: 34000 Query 207: 0.0000 Relevant: 123 0.8 Query 209: 0.0139 Rel_ret: 77 Query 210: 0.2885 Query 211: 0.1167 Interpolated Recall - Query 212: 0.0002 Precision Averages: Query 213: 0.1914 at 0.00 0.2290 Query 214: 0.0333 at 0.10 0.2290 0.6 Query 215: 1.0000 at 0.20 0.2115 Query 216: 0.0000 at 0.30 0.1702 Query 218: 0.0200 at 0.40 0.1236 Precision Query 220: 0.0026 at 0.50 0.1196 Query 221: 0.0164 at 0.60 0.1001 0.4 Query 224: 0.0092 at 0.70 0.0965 Query 225: 0.1023 at 0.80 0.0965 Query 226: 0.0000 at 0.90 0.0956 Query 227: 0.1667 at 1.00 0.0950 Query 228: 0.0000 0.2 Query 230: 0.3265 Avg. prec. (non-interpolated) Query 231: 0.0047 for all rel. documents Query 232: 0.0021 0.1353 Query 233: 0.0032 Precision: Query 234: 0.1122 At 5 docs: 0.0706 0.0 Query 235: 0.0004 At 10 docs: 0.0500 0.0 0.2 0.4 0.6 0.8 1.0 Query 237: 0.0568 At 15 docs: 0.0392 Query 238: 0.0139 At 20 docs: 0.0324 Recall Query 239: 0.0225 At 30 docs: 0.0245 Query 241: 0.0505 At 100 docs: 0.0115 Query 242: 0.0167 At 200 docs: 0.0071 Run UHIenru1 Query 244: 1.0000 At 500 docs: 0.0038 Comparison to median by topic Query 245: 0.0124 At 1000 docs: 0.0023 Query 250: 0.0000 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.1245 +0.5 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Hildesheim, Bilingual English to Russian, Auto, TD Run UHIenru2 Average precision Overall statistics Recall−Precision Values (individual queries): (for 34 queries): 1.0 Query 201: 0.0088 Total number of documents Query 202: 0.0088 over all queries Query 203: 1.0000 Retrieved: 34000 Query 207: 0.0000 Relevant: 123 0.8 Query 209: 0.0125 Rel_ret: 73 Query 210: 0.2972 Query 211: 0.0662 Interpolated Recall - Query 212: 0.0000 Precision Averages: Query 213: 0.1792 at 0.00 0.2087 Query 214: 0.0133 at 0.10 0.2087 0.6 Query 215: 1.0000 at 0.20 0.1978 Query 216: 0.0000 at 0.30 0.1482 Query 218: 0.0217 at 0.40 0.1179 Precision Query 220: 0.0032 at 0.50 0.1174 Query 221: 0.0091 at 0.60 0.0957 0.4 Query 224: 0.0085 at 0.70 0.0945 Query 225: 0.0880 at 0.80 0.0942 Query 226: 0.0010 at 0.90 0.0935 Query 227: 0.2500 at 1.00 0.0935 Query 228: 0.0015 0.2 Query 230: 0.0640 Avg. prec. (non-interpolated) Query 231: 0.0047 for all rel. documents Query 232: 0.0023 0.1274 Query 233: 0.0046 Precision: Query 234: 0.1667 At 5 docs: 0.0588 0.0 Query 235: 0.0004 At 10 docs: 0.0324 0.0 0.2 0.4 0.6 0.8 1.0 Query 237: 0.0462 At 15 docs: 0.0314 Query 238: 0.0085 At 20 docs: 0.0235 Recall Query 239: 0.0138 At 30 docs: 0.0206 Query 241: 0.0290 At 100 docs: 0.0094 Query 242: 0.0135 At 200 docs: 0.0057 Run UHIenru2 Query 244: 1.0000 At 500 docs: 0.0031 Comparison to median by topic Query 245: 0.0098 At 1000 docs: 0.0021 Query 250: 0.0000 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.1304 +0.5 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Hildesheim, Bilingual English to Russian, Auto, TD Run UHIenru3 Average precision Overall statistics Recall−Precision Values (individual queries): (for 34 queries): 1.0 Query 201: 0.0000 Total number of documents Query 202: 0.0179 over all queries Query 203: 1.0000 Retrieved: 32809 Query 207: 0.0000 Relevant: 123 0.8 Query 209: 0.0185 Rel_ret: 53 Query 210: 0.0098 Query 211: 0.0667 Interpolated Recall - Query 212: 0.0000 Precision Averages: Query 213: 0.0007 at 0.00 0.0677 Query 214: 0.0004 at 0.10 0.0650 0.6 Query 215: 0.0286 at 0.20 0.0644 Query 216: 0.0000 at 0.30 0.0620 Query 218: 0.0385 at 0.40 0.0499 Precision Query 220: 0.0556 at 0.50 0.0497 Query 221: 0.0501 at 0.60 0.0404 0.4 Query 224: 0.0048 at 0.70 0.0385 Query 225: 0.0975 at 0.80 0.0383 Query 226: 0.0000 at 0.90 0.0374 Query 227: 0.0128 at 1.00 0.0374 Query 228: 0.0018 0.2 Query 230: 0.0036 Avg. prec. (non-interpolated) Query 231: 0.0069 for all rel. documents Query 232: 0.0000 0.0484 Query 233: 0.0018 Precision: Query 234: 0.0000 At 5 docs: 0.0118 0.0 Query 235: 0.0000 At 10 docs: 0.0176 0.0 0.2 0.4 0.6 0.8 1.0 Query 237: 0.0667 At 15 docs: 0.0157 Query 238: 0.0054 At 20 docs: 0.0147 Recall Query 239: 0.0000 At 30 docs: 0.0127 Query 241: 0.0326 At 100 docs: 0.0062 Query 242: 0.0000 At 200 docs: 0.0044 Run UHIenru3 Query 244: 0.1111 At 500 docs: 0.0027 Comparison to median by topic Query 245: 0.0131 At 1000 docs: 0.0016 Query 250: 0.0000 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.0309 +0.5 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Université de Neuchâtel, Bilingual English to Russian, Auto, TD Run UniNEBru1 Average precision Overall statistics Recall−Precision Values (individual queries): (for 34 queries): 1.0 Query 201: 0.0118 Total number of documents Query 202: 0.5033 over all queries Query 203: 1.0000 Retrieved: 34000 Query 207: 0.0000 Relevant: 123 0.8 Query 209: 1.0000 Rel_ret: 104 Query 210: 0.4598 Query 211: 0.5833 Interpolated Recall - Query 212: 0.4679 Precision Averages: Query 213: 0.1688 at 0.00 0.4163 Query 214: 0.0287 at 0.10 0.4163 0.6 Query 215: 0.2000 at 0.20 0.4163 Query 216: 0.0067 at 0.30 0.3712 Query 218: 0.2500 at 0.40 0.3291 Precision Query 220: 0.0226 at 0.50 0.3237 Query 221: 0.7000 at 0.60 0.2663 0.4 Query 224: 0.1038 at 0.70 0.2378 Query 225: 0.6429 at 0.80 0.2287 Query 226: 0.0044 at 0.90 0.2246 Query 227: 0.0833 at 1.00 0.2222 Query 228: 0.0066 0.2 Query 230: 0.1775 Avg. prec. (non-interpolated) Query 231: 1.0000 for all rel. documents Query 232: 0.1351 0.3007 Query 233: 0.1677 Precision: Query 234: 0.0237 At 5 docs: 0.1706 0.0 Query 235: 0.0004 At 10 docs: 0.1118 0.0 0.2 0.4 0.6 0.8 1.0 Query 237: 0.1250 At 15 docs: 0.0902 Query 238: 1.0000 At 20 docs: 0.0794 Recall Query 239: 0.0518 At 30 docs: 0.0578 Query 241: 0.1377 At 100 docs: 0.0232 Query 242: 0.0385 At 200 docs: 0.0131 Run UniNEBru1 Query 244: 1.0000 At 500 docs: 0.0058 Comparison to median by topic Query 245: 0.1225 At 1000 docs: 0.0031 Query 250: 0.0000 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.2742 +0.5 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Université de Neuchâtel, Bilingual English to Russian, Auto, TD Run UniNEBru2 Average precision Overall statistics Recall−Precision Values (individual queries): (for 34 queries): 1.0 Query 201: 0.0091 Total number of documents Query 202: 0.4476 over all queries Query 203: 1.0000 Retrieved: 34000 Query 207: 0.0000 Relevant: 123 0.8 Query 209: 1.0000 Rel_ret: 104 Query 210: 0.4781 Query 211: 0.5833 Interpolated Recall - Query 212: 0.2989 Precision Averages: Query 213: 0.1667 at 0.00 0.4190 Query 214: 0.0401 at 0.10 0.4190 0.6 Query 215: 0.2000 at 0.20 0.4190 Query 216: 0.0038 at 0.30 0.3763 Query 218: 0.2500 at 0.40 0.3185 Precision Query 220: 0.0225 at 0.50 0.3093 Query 221: 0.7000 at 0.60 0.2522 0.4 Query 224: 0.1056 at 0.70 0.2282 Query 225: 0.6095 at 0.80 0.2226 Query 226: 0.0031 at 0.90 0.2182 Query 227: 0.0833 at 1.00 0.2162 Query 228: 0.0070 0.2 Query 230: 0.1756 Avg. prec. (non-interpolated) Query 231: 1.0000 for all rel. documents Query 232: 0.1260 0.2962 Query 233: 0.1891 Precision: Query 234: 0.0297 At 5 docs: 0.1647 0.0 Query 235: 0.0008 At 10 docs: 0.1029 0.0 0.2 0.4 0.6 0.8 1.0 Query 237: 0.1250 At 15 docs: 0.0863 Query 238: 1.0000 At 20 docs: 0.0750 Recall Query 239: 0.0468 At 30 docs: 0.0598 Query 241: 0.1141 At 100 docs: 0.0224 Query 242: 0.0417 At 200 docs: 0.0128 Run UniNEBru2 Query 244: 1.0000 At 500 docs: 0.0059 Comparison to median by topic Query 245: 0.2143 At 1000 docs: 0.0031 Query 250: 0.0000 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.2855 +0.5 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number SUNY Buffalo, Monolingual English, Auto, TD Run UBmonoEN01 Average precision Overall statistics Recall−Precision Values (individual queries): (for 42 queries): 1.0 Query 201: 0.2309 Total number of documents Query 202: 0.6479 over all queries Query 204: 0.3942 Retrieved: 42000 Query 205: 0.5881 Relevant: 375 0.8 Query 206: 1.0000 Rel_ret: 361 Query 207: 0.8126 Query 208: 1.0000 Interpolated Recall - Query 209: 0.0827 Precision Averages: Query 210: 0.2000 at 0.00 0.7444 Query 211: 1.0000 at 0.10 0.6559 0.6 Query 212: 0.2884 at 0.20 0.6534 Query 213: 0.1855 at 0.30 0.5828 Query 214: 0.5881 at 0.40 0.5611 Precision Query 215: 0.0667 at 0.50 0.5355 Query 216: 0.7292 at 0.60 0.5138 0.4 Query 217: 0.1534 at 0.70 0.4650 Query 218: 0.9124 at 0.80 0.4269 Query 219: 0.0023 at 0.90 0.3885 Query 221: 0.5833 at 1.00 0.3682 Query 222: 0.1052 0.2 Query 223: 0.4098 Avg. prec. (non-interpolated) Query 224: 0.8156 for all rel. documents Query 226: 0.2657 0.5167 Query 228: 0.0213 Precision: Query 229: 0.7000 At 5 docs: 0.4095 0.0 Query 230: 0.7326 At 10 docs: 0.3048 0.0 0.2 0.4 0.6 0.8 1.0 Query 231: 0.3333 At 15 docs: 0.2444 Query 232: 0.1368 At 20 docs: 0.2107 Recall Query 233: 0.8424 At 30 docs: 0.1667 Query 235: 0.2958 At 100 docs: 0.0690 Query 236: 0.7000 At 200 docs: 0.0382 Run UBmonoEN01 Query 237: 1.0000 At 500 docs: 0.0165 Comparison to median by topic Query 238: 0.3096 At 1000 docs: 0.0086 Query 239: 0.1123 +1.0 Query 240: 0.9056 R-Precision (prec. after R Query 241: 0.0052 (=num_rel) docs. retrieved): Query 242: 0.6811 Exact: 0.4608 Query 245: 0.8270 Query 246: 1.0000 Query 247: 1.0000 +0.5 Query 248: 1.0000 Query 249: 0.0383 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number JHU/APL, Monolingual Finnish, Auto, TD Run aplmofia Average precision Overall statistics (individual queries): (for 45 queries): Recall−Precision Values 1.0 Query 201: 0.1104 Total number of documents Query 202: 0.9449 over all queries Query 203: 0.3175 Retrieved: 45000 Query 204: 0.9573 Relevant: 413 Query 205: 0.8556 Rel_ret: 395 0.8 Query 207: 0.3007 Query 208: 0.8199 Interpolated Recall - Query 209: 0.0000 Precision Averages: Query 210: 0.0667 at 0.00 0.6821 Query 211: 0.9875 at 0.10 0.6762 0.6 Query 212: 0.4341 at 0.20 0.6434 Query 213: 0.7178 at 0.30 0.6130 Query 214: 0.6667 at 0.40 0.5984 Precision Query 215: 1.0000 at 0.50 0.5639 Query 216: 0.0042 at 0.60 0.5452 0.4 Query 217: 0.6879 at 0.70 0.4809 Query 218: 0.9217 at 0.80 0.4558 Query 219: 0.8082 at 0.90 0.4054 Query 220: 0.0455 at 1.00 0.3824 Query 221: 0.6978 0.2 Query 222: 0.1254 Avg. prec. (non-interpolated) Query 223: 0.1335 for all rel. documents Query 224: 1.0000 0.5393 Query 225: 0.8762 Precision: Query 226: 1.0000 At 5 docs: 0.4489 0.0 Query 228: 0.0224 At 10 docs: 0.3756 0.0 0.2 0.4 0.6 0.8 1.0 Query 229: 0.0007 At 15 docs: 0.3126 Query 230: 0.4451 At 20 docs: 0.2600 Recall Query 232: 0.0000 At 30 docs: 0.1919 Query 233: 0.6548 At 100 docs: 0.0713 Query 234: 0.4565 At 200 docs: 0.0406 Run aplmofia Query 235: 0.5709 At 500 docs: 0.0171 Query 236: 0.9167 At 1000 docs: 0.0088 Comparison to median by topic Query 237: 1.0000 +1.0 Query 238: 1.0000 R-Precision (prec. after R Query 239: 0.4023 (=num_rel) docs. retrieved): Query 241: 0.1452 Exact: 0.4724 Query 242: 0.2917 Query 243: 0.4022 Query 244: 0.5000 +0.5 Query 245: 1.0000 Query 246: 0.0833 Query 248: 0.8444 Query 249: 0.0521 Query 250: 1.0000 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number JHU/APL, Monolingual Finnish, Auto, TD Run aplmofib Average precision Overall statistics (individual queries): (for 45 queries): Recall−Precision Values 1.0 Query 201: 0.1158 Total number of documents Query 202: 0.9628 over all queries Query 203: 0.6250 Retrieved: 45000 Query 204: 0.9452 Relevant: 413 Query 205: 0.8357 Rel_ret: 394 0.8 Query 207: 0.2475 Query 208: 0.8288 Interpolated Recall - Query 209: 0.0000 Precision Averages: Query 210: 0.0370 at 0.00 0.7011 Query 211: 0.9870 at 0.10 0.6909 0.6 Query 212: 0.3961 at 0.20 0.6694 Query 213: 0.6708 at 0.30 0.6356 Query 214: 0.3889 at 0.40 0.5834 Precision Query 215: 1.0000 at 0.50 0.5609 Query 216: 0.0009 at 0.60 0.5338 0.4 Query 217: 0.5789 at 0.70 0.4791 Query 218: 0.9519 at 0.80 0.4568 Query 219: 0.7983 at 0.90 0.4158 Query 220: 0.0265 at 1.00 0.3893 Query 221: 0.7454 0.2 Query 222: 0.1323 Avg. prec. (non-interpolated) Query 223: 0.1303 for all rel. documents Query 224: 1.0000 0.5443 Query 225: 0.9029 Precision: Query 226: 0.9822 At 5 docs: 0.4489 0.0 Query 228: 0.0197 At 10 docs: 0.3622 0.0 0.2 0.4 0.6 0.8 1.0 Query 229: 0.0011 At 15 docs: 0.2978 Query 230: 0.4881 At 20 docs: 0.2522 Recall Query 232: 0.0000 At 30 docs: 0.1896 Query 233: 0.7004 At 100 docs: 0.0716 Query 234: 0.3629 At 200 docs: 0.0397 Run aplmofib Query 235: 0.3998 At 500 docs: 0.0171 Query 236: 0.9167 At 1000 docs: 0.0088 Comparison to median by topic Query 237: 1.0000 +1.0 Query 238: 1.0000 R-Precision (prec. after R Query 239: 0.4346 (=num_rel) docs. retrieved): Query 241: 0.1386 Exact: 0.4698 Query 242: 0.8333 Query 243: 0.4052 Query 244: 1.0000 +0.5 Query 245: 0.5000 Query 246: 0.1111 Query 248: 0.8583 Query 249: 0.0334 Query 250: 1.0000 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number JHU/APL, Monolingual Finnish, Auto, TD Run aplmofic Average precision Overall statistics (individual queries): (for 45 queries): Recall−Precision Values 1.0 Query 201: 0.1031 Total number of documents Query 202: 0.9314 over all queries Query 203: 0.7778 Retrieved: 45000 Query 204: 0.9499 Relevant: 413 Query 205: 0.8357 Rel_ret: 392 0.8 Query 207: 0.3329 Query 208: 0.8141 Interpolated Recall - Query 209: 0.0000 Precision Averages: Query 210: 0.0476 at 0.00 0.6765 Query 211: 0.9833 at 0.10 0.6609 0.6 Query 212: 0.4302 at 0.20 0.6193 Query 213: 0.6486 at 0.30 0.6066 Query 214: 0.3889 at 0.40 0.5852 Precision Query 215: 1.0000 at 0.50 0.5676 Query 216: 0.0000 at 0.60 0.5396 0.4 Query 217: 0.5962 at 0.70 0.4738 Query 218: 1.0000 at 0.80 0.4524 Query 219: 0.7666 at 0.90 0.4046 Query 220: 0.0134 at 1.00 0.3809 Query 221: 0.6787 0.2 Query 222: 0.1425 Avg. prec. (non-interpolated) Query 223: 0.1305 for all rel. documents Query 224: 1.0000 0.5336 Query 225: 0.8762 Precision: Query 226: 1.0000 At 5 docs: 0.4311 0.0 Query 228: 0.0192 At 10 docs: 0.3489 0.0 0.2 0.4 0.6 0.8 1.0 Query 229: 0.0077 At 15 docs: 0.2993 Query 230: 0.2701 At 20 docs: 0.2478 Recall Query 232: 0.0000 At 30 docs: 0.1852 Query 233: 0.6944 At 100 docs: 0.0704 Query 234: 0.0130 At 200 docs: 0.0393 Run aplmofic Query 235: 0.5232 At 500 docs: 0.0169 Query 236: 0.9167 At 1000 docs: 0.0087 Comparison to median by topic Query 237: 1.0000 +1.0 Query 238: 1.0000 R-Precision (prec. after R Query 239: 0.3856 (=num_rel) docs. retrieved): Query 241: 0.1550 Exact: 0.4711 Query 242: 0.8333 Query 243: 0.3441 Query 244: 1.0000 +0.5 Query 245: 0.5000 Query 246: 0.0714 Query 248: 0.8048 Query 249: 0.0275 Query 250: 1.0000 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number CLIPS, Monolingual Finnish, Auto, TDN Run CLIPS04MNFI1 Average precision Overall statistics Recall−Precision Values (individual queries): (for 45 queries): 1.0 Query 201: 0.2036 Total number of documents Query 202: 0.8234 over all queries Query 203: 0.5889 Retrieved: 45000 Query 204: 0.9801 Relevant: 413 Query 205: 0.5317 Rel_ret: 406 0.8 Query 207: 0.2374 Query 208: 0.8380 Interpolated Recall - Query 209: 0.0000 Precision Averages: Query 210: 0.2500 at 0.00 0.6993 Query 211: 0.9688 at 0.10 0.6804 0.6 Query 212: 0.4547 at 0.20 0.6726 Query 213: 0.8076 at 0.30 0.6529 Query 214: 0.5000 at 0.40 0.6017 Precision Query 215: 0.1429 at 0.50 0.5742 Query 216: 0.2598 at 0.60 0.5168 0.4 Query 217: 0.6375 at 0.70 0.4538 Query 218: 0.9909 at 0.80 0.4278 Query 219: 0.6467 at 0.90 0.3871 Query 220: 0.1770 at 1.00 0.3540 Query 221: 0.6579 0.2 Query 222: 0.0767 Avg. prec. (non-interpolated) Query 223: 0.1569 for all rel. documents Query 224: 1.0000 0.5349 Query 225: 1.0000 Precision: Query 226: 0.8692 At 5 docs: 0.4578 0.0 Query 228: 0.0071 At 10 docs: 0.3711 0.0 0.2 0.4 0.6 0.8 1.0 Query 229: 0.2100 At 15 docs: 0.3126 Query 230: 0.6519 At 20 docs: 0.2700 Recall Query 232: 0.0625 At 30 docs: 0.2015 Query 233: 0.6036 At 100 docs: 0.0749 Query 234: 0.4891 At 200 docs: 0.0413 Run CLIPS04MNFI1 Query 235: 0.6430 At 500 docs: 0.0177 Comparison to median by topic Query 236: 0.9167 At 1000 docs: 0.0090 Query 237: 1.0000 +1.0 Query 238: 0.7917 R-Precision (prec. after R Query 239: 0.2638 (=num_rel) docs. retrieved): Query 241: 0.3469 Exact: 0.4786 Query 242: 1.0000 Query 243: 0.0343 Query 244: 1.0000 +0.5 Query 245: 0.5000 Query 246: 0.0769 Query 248: 0.6433 Query 249: 0.0320 Query 250: 1.0000 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Dublin City University, Monolingual Finnish, Auto, TD Run exefinmono04a Average precision Overall statistics Recall−Precision Values (individual queries): (for 45 queries): 1.0 Query 201: 0.1137 Total number of documents Query 202: 0.9945 over all queries Query 203: 0.4667 Retrieved: 41625 Query 204: 0.8707 Relevant: 413 Query 205: 0.7309 Rel_ret: 304 0.8 Query 207: 0.1347 Query 208: 0.7600 Interpolated Recall - Query 209: 0.0000 Precision Averages: Query 210: 0.0159 at 0.00 0.5637 Query 211: 0.9758 at 0.10 0.5390 0.6 Query 212: 0.1824 at 0.20 0.5264 Query 213: 0.7777 at 0.30 0.5047 Query 214: 0.0000 at 0.40 0.4746 Precision Query 215: 0.1111 at 0.50 0.4406 Query 216: 0.0000 at 0.60 0.4185 0.4 Query 217: 0.6856 at 0.70 0.3659 Query 218: 0.9174 at 0.80 0.3536 Query 219: 0.0297 at 0.90 0.3092 Query 220: 0.0464 at 1.00 0.2815 Query 221: 0.7962 0.2 Query 222: 0.1253 Avg. prec. (non-interpolated) Query 223: 0.1090 for all rel. documents Query 224: 1.0000 0.4252 Query 225: 0.9667 Precision: Query 226: 0.3732 At 5 docs: 0.3689 0.0 Query 228: 0.0000 At 10 docs: 0.2978 0.0 0.2 0.4 0.6 0.8 1.0 Query 229: 0.0000 At 15 docs: 0.2415 Query 230: 0.1513 At 20 docs: 0.1989 Recall Query 232: 0.0000 At 30 docs: 0.1489 Query 233: 0.4902 At 100 docs: 0.0538 Query 234: 0.4788 At 200 docs: 0.0296 Run exefinmono04a Query 235: 0.0028 At 500 docs: 0.0131 Comparison to median by topic Query 236: 0.9167 At 1000 docs: 0.0068 Query 237: 1.0000 +1.0 Query 238: 0.7556 R-Precision (prec. after R Query 239: 0.0008 (=num_rel) docs. retrieved): Query 241: 0.1132 Exact: 0.3895 Query 242: 0.5000 Query 243: 0.2680 Query 244: 1.0000 +0.5 Query 245: 0.5000 Query 246: 0.1667 Query 248: 0.5248 Query 249: 0.0839 Query 250: 1.0000 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Dublin City University, Monolingual Finnish, Auto, TD Run exefinmono04l Average precision Overall statistics Recall−Precision Values (individual queries): (for 45 queries): 1.0 Query 201: 0.1566 Total number of documents Query 202: 0.9788 over all queries Query 203: 0.6667 Retrieved: 42195 Query 204: 0.9466 Relevant: 413 Query 205: 0.6595 Rel_ret: 311 0.8 Query 207: 0.1347 Query 208: 0.8032 Interpolated Recall - Query 209: 0.0000 Precision Averages: Query 210: 0.0189 at 0.00 0.6034 Query 211: 0.9725 at 0.10 0.5709 0.6 Query 212: 0.1576 at 0.20 0.5371 Query 213: 0.8018 at 0.30 0.5125 Query 214: 0.0000 at 0.40 0.4670 Precision Query 215: 0.1111 at 0.50 0.4414 Query 216: 0.0000 at 0.60 0.4152 0.4 Query 217: 0.6966 at 0.70 0.3647 Query 218: 0.9488 at 0.80 0.3554 Query 219: 0.1958 at 0.90 0.3138 Query 220: 0.0197 at 1.00 0.2862 Query 221: 0.7117 0.2 Query 222: 0.1153 Avg. prec. (non-interpolated) Query 223: 0.0872 for all rel. documents Query 224: 1.0000 0.4324 Query 225: 0.9667 Precision: Query 226: 0.3783 At 5 docs: 0.3822 0.0 Query 228: 0.0000 At 10 docs: 0.3111 0.0 0.2 0.4 0.6 0.8 1.0 Query 229: 0.0000 At 15 docs: 0.2533 Query 230: 0.1338 At 20 docs: 0.2056 Recall Query 232: 0.0000 At 30 docs: 0.1533 Query 233: 0.5204 At 100 docs: 0.0567 Query 234: 0.5039 At 200 docs: 0.0309 Run exefinmono04l Query 235: 0.0556 At 500 docs: 0.0133 Comparison to median by topic Query 236: 0.9167 At 1000 docs: 0.0069 Query 237: 1.0000 +1.0 Query 238: 0.7556 R-Precision (prec. after R Query 239: 0.0006 (=num_rel) docs. retrieved): Query 241: 0.1149 Exact: 0.3880 Query 242: 0.5000 Query 243: 0.2715 Query 244: 1.0000 +0.5 Query 245: 0.5000 Query 246: 0.1429 Query 248: 0.3650 Query 249: 0.1477 Query 250: 1.0000 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Dublin City University, Monolingual Finnish, Auto, TD Run exefinmono04q Average precision Overall statistics (individual queries): (for 45 queries): Recall−Precision Values 1.0 Query 201: 0.1040 Total number of documents Query 202: 0.9746 over all queries Query 203: 0.8667 Retrieved: 43506 Query 204: 0.8517 Relevant: 413 Query 205: 0.6583 Rel_ret: 327 0.8 Query 207: 0.1345 Query 208: 0.8177 Interpolated Recall - Query 209: 0.0011 Precision Averages: Query 210: 0.0102 at 0.00 0.5942 Query 211: 0.9753 at 0.10 0.5756 0.6 Query 212: 0.1976 at 0.20 0.5585 Query 213: 0.7870 at 0.30 0.5419 Query 214: 0.0000 at 0.40 0.5123 Precision Query 215: 0.1000 at 0.50 0.4778 Query 216: 0.0000 at 0.60 0.4388 0.4 Query 217: 0.7028 at 0.70 0.3741 Query 218: 0.9188 at 0.80 0.3605 Query 219: 0.3054 at 0.90 0.3161 Query 220: 0.0512 at 1.00 0.2910 Query 221: 0.7783 0.2 Query 222: 0.1152 Avg. prec. (non-interpolated) Query 223: 0.1358 for all rel. documents Query 224: 1.0000 0.4489 Query 225: 0.9667 Precision: Query 226: 0.2864 At 5 docs: 0.3911 0.0 Query 228: 0.0000 At 10 docs: 0.3067 0.0 0.2 0.4 0.6 0.8 1.0 Query 229: 0.0000 At 15 docs: 0.2504 Query 230: 0.1078 At 20 docs: 0.2122 Recall Query 232: 0.0000 At 30 docs: 0.1563 Query 233: 0.5732 At 100 docs: 0.0578 Query 234: 0.4906 At 200 docs: 0.0320 Run exefinmono04q Query 235: 0.0030 At 500 docs: 0.0141 Query 236: 0.9167 At 1000 docs: 0.0073 Comparison to median by topic Query 237: 1.0000 +1.0 Query 238: 0.8667 R-Precision (prec. after R Query 239: 0.0004 (=num_rel) docs. retrieved): Query 241: 0.2081 Exact: 0.3976 Query 242: 0.7500 Query 243: 0.3033 Query 244: 1.0000 +0.5 Query 245: 0.5000 Query 246: 0.1250 Query 248: 0.4969 Query 249: 0.1214 Query 250: 1.0000 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Dublin City University, Monolingual Finnish, Auto, TD Run exefinmono04t Average precision Overall statistics Recall−Precision Values (individual queries): (for 45 queries): 1.0 Query 201: 0.1038 Total number of documents Query 202: 1.0000 over all queries Query 203: 0.4667 Retrieved: 44293 Query 204: 0.9053 Relevant: 413 Query 205: 0.6754 Rel_ret: 333 0.8 Query 207: 0.1357 Query 208: 0.8177 Interpolated Recall - Query 209: 0.0011 Precision Averages: Query 210: 0.0108 at 0.00 0.5966 Query 211: 0.9758 at 0.10 0.5841 0.6 Query 212: 0.1918 at 0.20 0.5460 Query 213: 0.7786 at 0.30 0.5329 Query 214: 0.0000 at 0.40 0.5058 Precision Query 215: 0.1429 at 0.50 0.4824 Query 216: 0.0000 at 0.60 0.4321 0.4 Query 217: 0.7279 at 0.70 0.3780 Query 218: 0.9667 at 0.80 0.3628 Query 219: 0.2751 at 0.90 0.3234 Query 220: 0.0747 at 1.00 0.2952 Query 221: 0.7783 0.2 Query 222: 0.1161 Avg. prec. (non-interpolated) Query 223: 0.1467 for all rel. documents Query 224: 1.0000 0.4481 Query 225: 0.9667 Precision: Query 226: 0.2958 At 5 docs: 0.3822 0.0 Query 228: 0.0000 At 10 docs: 0.3089 0.0 0.2 0.4 0.6 0.8 1.0 Query 229: 0.0000 At 15 docs: 0.2578 Query 230: 0.3016 At 20 docs: 0.2111 Recall Query 232: 0.0000 At 30 docs: 0.1578 Query 233: 0.5743 At 100 docs: 0.0573 Query 234: 0.4803 At 200 docs: 0.0321 Run exefinmono04t Query 235: 0.1315 At 500 docs: 0.0143 Comparison to median by topic Query 236: 0.9167 At 1000 docs: 0.0074 Query 237: 1.0000 +1.0 Query 238: 0.8667 R-Precision (prec. after R Query 239: 0.0003 (=num_rel) docs. retrieved): Query 241: 0.1208 Exact: 0.4041 Query 242: 0.7000 Query 243: 0.2839 Query 244: 1.0000 +0.5 Query 245: 0.5000 Query 246: 0.1250 Query 248: 0.5367 Query 249: 0.0744 Query 250: 1.0000 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Hummingbird, Monolingual Finnish, Auto, T Run humFI04t Average precision Overall statistics Recall−Precision Values (individual queries): (for 45 queries): 1.0 Query 201: 0.1319 Total number of documents Query 202: 0.8002 over all queries Query 203: 0.9167 Retrieved: 41042 Query 204: 0.9239 Relevant: 413 Query 205: 0.4348 Rel_ret: 401 0.8 Query 207: 0.5846 Query 208: 0.5191 Interpolated Recall - Query 209: 0.0000 Precision Averages: Query 210: 1.0000 at 0.00 0.7776 Query 211: 0.9875 at 0.10 0.7290 0.6 Query 212: 0.4640 at 0.20 0.6941 Query 213: 0.6958 at 0.30 0.6613 Query 214: 0.5000 at 0.40 0.6064 Precision Query 215: 0.0909 at 0.50 0.5907 Query 216: 0.5500 at 0.60 0.5274 0.4 Query 217: 0.7609 at 0.70 0.4597 Query 218: 0.9204 at 0.80 0.4425 Query 219: 0.4351 at 0.90 0.4076 Query 220: 0.0151 at 1.00 0.3549 Query 221: 0.8111 0.2 Query 222: 0.1307 Avg. prec. (non-interpolated) Query 223: 0.0302 for all rel. documents Query 224: 1.0000 0.5559 Query 225: 0.9667 Precision: Query 226: 0.9169 At 5 docs: 0.4533 0.0 Query 228: 0.0000 At 10 docs: 0.3556 0.0 0.2 0.4 0.6 0.8 1.0 Query 229: 0.3103 At 15 docs: 0.2948 Query 230: 0.6528 At 20 docs: 0.2522 Recall Query 232: 0.0048 At 30 docs: 0.1881 Query 233: 0.5414 At 100 docs: 0.0713 Query 234: 0.6294 At 200 docs: 0.0397 Run humFI04t Query 235: 0.9409 At 500 docs: 0.0175 Comparison to median by topic Query 236: 0.9167 At 1000 docs: 0.0089 Query 237: 1.0000 +1.0 Query 238: 0.2079 R-Precision (prec. after R Query 239: 0.2406 (=num_rel) docs. retrieved): Query 241: 0.1358 Exact: 0.4828 Query 242: 0.7500 Query 243: 0.2354 Query 244: 1.0000 +0.5 Query 245: 1.0000 Query 246: 0.0022 Query 248: 0.8433 Query 249: 0.0157 Query 250: 1.0000 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Hummingbird, Monolingual Finnish, Auto, TD Run humFI04td Average precision Overall statistics Recall−Precision Values (individual queries): (for 45 queries): 1.0 Query 201: 0.1059 Total number of documents Query 202: 0.8594 over all queries Query 203: 1.0000 Retrieved: 45000 Query 204: 0.9238 Relevant: 413 Query 205: 0.7986 Rel_ret: 410 0.8 Query 207: 0.3658 Query 208: 0.8012 Interpolated Recall - Query 209: 0.0000 Precision Averages: Query 210: 1.0000 at 0.00 0.7762 Query 211: 0.9951 at 0.10 0.7414 0.6 Query 212: 0.4103 at 0.20 0.7006 Query 213: 0.7659 at 0.30 0.6834 Query 214: 0.4444 at 0.40 0.6267 Precision Query 215: 0.0345 at 0.50 0.6154 Query 216: 0.6429 at 0.60 0.5805 0.4 Query 217: 0.7784 at 0.70 0.5369 Query 218: 0.9909 at 0.80 0.5079 Query 219: 0.4603 at 0.90 0.4510 Query 220: 0.0404 at 1.00 0.4220 Query 221: 0.9667 0.2 Query 222: 0.2514 Avg. prec. (non-interpolated) Query 223: 0.0888 for all rel. documents Query 224: 1.0000 0.5927 Query 225: 0.9667 Precision: Query 226: 0.9492 At 5 docs: 0.4933 0.0 Query 228: 0.0092 At 10 docs: 0.3800 0.0 0.2 0.4 0.6 0.8 1.0 Query 229: 0.3070 At 15 docs: 0.3126 Query 230: 0.8750 At 20 docs: 0.2678 Recall Query 232: 0.0018 At 30 docs: 0.1970 Query 233: 0.5519 At 100 docs: 0.0742 Query 234: 0.5087 At 200 docs: 0.0400 Run humFI04td Query 235: 0.8755 At 500 docs: 0.0178 Comparison to median by topic Query 236: 0.8667 At 1000 docs: 0.0091 Query 237: 1.0000 +1.0 Query 238: 1.0000 R-Precision (prec. after R Query 239: 0.2180 (=num_rel) docs. retrieved): Query 241: 0.3230 Exact: 0.5308 Query 242: 1.0000 Query 243: 0.3291 Query 244: 1.0000 +0.5 Query 245: 0.5000 Query 246: 0.0385 Query 248: 0.5442 Query 249: 0.0804 Query 250: 1.0000 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Hummingbird, Monolingual Finnish, Auto, TD Run humFI04tde Average precision Overall statistics Recall−Precision Values (individual queries): (for 45 queries): 1.0 Query 201: 0.1639 Total number of documents Query 202: 0.9285 over all queries Query 203: 0.9167 Retrieved: 45000 Query 204: 0.9694 Relevant: 413 Query 205: 0.8722 Rel_ret: 411 0.8 Query 207: 0.3739 Query 208: 0.7843 Interpolated Recall - Query 209: 0.0139 Precision Averages: Query 210: 1.0000 at 0.00 0.7966 Query 211: 0.9951 at 0.10 0.7747 0.6 Query 212: 0.4907 at 0.20 0.7388 Query 213: 0.8183 at 0.30 0.7245 Query 214: 0.4667 at 0.40 0.6806 Precision Query 215: 0.2000 at 0.50 0.6613 Query 216: 0.6429 at 0.60 0.6257 0.4 Query 217: 0.7496 at 0.70 0.5890 Query 218: 0.9909 at 0.80 0.5470 Query 219: 0.6317 at 0.90 0.4859 Query 220: 0.0792 at 1.00 0.4706 Query 221: 1.0000 0.2 Query 222: 0.2778 Avg. prec. (non-interpolated) Query 223: 0.1390 for all rel. documents Query 224: 1.0000 0.6367 Query 225: 1.0000 Precision: Query 226: 0.9822 At 5 docs: 0.5511 0.0 Query 228: 0.0078 At 10 docs: 0.4222 0.0 0.2 0.4 0.6 0.8 1.0 Query 229: 0.5310 At 15 docs: 0.3467 Query 230: 0.9167 At 20 docs: 0.2900 Recall Query 232: 0.0014 At 30 docs: 0.2119 Query 233: 0.6873 At 100 docs: 0.0782 Query 234: 0.7664 At 200 docs: 0.0431 Run humFI04tde Query 235: 0.8973 At 500 docs: 0.0181 Comparison to median by topic Query 236: 0.9167 At 1000 docs: 0.0091 Query 237: 1.0000 +1.0 Query 238: 1.0000 R-Precision (prec. after R Query 239: 0.4576 (=num_rel) docs. retrieved): Query 241: 0.3958 Exact: 0.5667 Query 242: 1.0000 Query 243: 0.3041 Query 244: 1.0000 +0.5 Query 245: 0.5000 Query 246: 0.1111 Query 248: 0.5867 Query 249: 0.0864 Query 250: 1.0000 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Padua, Monolingual Finnish, Auto, TD Run IMSMFIN Average precision Overall statistics Recall−Precision Values (individual queries): (for 45 queries): 1.0 Query 201: 0.0001 Total number of documents Query 202: 0.9066 over all queries Query 203: 0.7222 Retrieved: 42506 Query 204: 0.1494 Relevant: 413 0.8 Query 205: 0.4013 Rel_ret: 258 Query 207: 0.0024 Query 208: 0.8337 Interpolated Recall - Query 209: 0.0000 Precision Averages: Query 210: 0.0278 at 0.00 0.6121 Query 211: 0.9115 at 0.10 0.5732 0.6 Query 212: 0.2271 at 0.20 0.4952 Query 213: 0.6857 at 0.30 0.4476 Query 214: 0.0000 at 0.40 0.3920 Precision Query 215: 0.1429 at 0.50 0.3784 Query 216: 0.0007 at 0.60 0.3528 0.4 Query 217: 0.5789 at 0.70 0.3411 Query 218: 0.9909 at 0.80 0.3327 Query 219: 0.1589 at 0.90 0.3052 Query 220: 0.1303 at 1.00 0.2844 Query 221: 0.3787 0.2 Query 222: 0.1349 Avg. prec. (non-interpolated) Query 223: 0.1201 for all rel. documents Query 224: 1.0000 0.3962 Query 225: 0.7683 Precision: Query 226: 0.0462 At 5 docs: 0.3556 0.0 Query 228: 0.0000 At 10 docs: 0.2578 0.0 0.2 0.4 0.6 0.8 1.0 Query 229: 0.0000 At 15 docs: 0.2089 Query 230: 0.6845 At 20 docs: 0.1767 Recall Query 232: 0.0000 At 30 docs: 0.1252 Query 233: 0.3169 At 100 docs: 0.0471 Query 234: 0.1762 At 200 docs: 0.0252 Run IMSMFIN Query 235: 0.0459 At 500 docs: 0.0108 Comparison to median by topic Query 236: 1.0000 At 1000 docs: 0.0057 Query 237: 1.0000 +1.0 Query 238: 1.0000 R-Precision (prec. after R Query 239: 0.0602 (=num_rel) docs. retrieved): Query 241: 0.0477 Exact: 0.3612 Query 242: 1.0000 Query 243: 0.4517 Query 244: 0.3333 +0.5 Query 245: 1.0000 Query 246: 0.0385 Query 248: 0.8100 Query 249: 0.0475 Query 250: 0.5000 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Padua, Monolingual Finnish, Auto, TD Run IMSMFIP Average precision Overall statistics Recall−Precision Values (individual queries): (for 45 queries): 1.0 Query 201: 0.1306 Total number of documents Query 202: 0.8569 over all queries Query 203: 0.9167 Retrieved: 45000 Query 204: 0.7557 Relevant: 413 0.8 Query 205: 0.6898 Rel_ret: 346 Query 207: 0.0158 Query 208: 0.7876 Interpolated Recall - Query 209: 0.0000 Precision Averages: Query 210: 0.0476 at 0.00 0.6632 Query 211: 0.9438 at 0.10 0.6157 0.6 Query 212: 0.2565 at 0.20 0.5649 Query 213: 0.6452 at 0.30 0.5391 Query 214: 0.0000 at 0.40 0.5090 Precision Query 215: 0.1000 at 0.50 0.4644 Query 216: 0.0007 at 0.60 0.4286 0.4 Query 217: 0.6016 at 0.70 0.3926 Query 218: 0.9833 at 0.80 0.3747 Query 219: 0.4101 at 0.90 0.3428 Query 220: 0.0955 at 1.00 0.3237 Query 221: 0.3016 0.2 Query 222: 0.1643 Avg. prec. (non-interpolated) Query 223: 0.1020 for all rel. documents Query 224: 1.0000 0.4631 Query 225: 0.7862 Precision: Query 226: 0.2291 At 5 docs: 0.4133 0.0 Query 228: 0.0000 At 10 docs: 0.2956 0.0 0.2 0.4 0.6 0.8 1.0 Query 229: 0.0000 At 15 docs: 0.2504 Query 230: 0.6361 At 20 docs: 0.2111 Recall Query 232: 0.0000 At 30 docs: 0.1578 Query 233: 0.3610 At 100 docs: 0.0611 Query 234: 0.5018 At 200 docs: 0.0340 Run IMSMFIP Query 235: 0.1363 At 500 docs: 0.0145 Comparison to median by topic Query 236: 0.9167 At 1000 docs: 0.0077 Query 237: 1.0000 +1.0 Query 238: 1.0000 R-Precision (prec. after R Query 239: 0.1680 (=num_rel) docs. retrieved): Query 241: 0.1205 Exact: 0.4371 Query 242: 0.7500 Query 243: 0.2212 Query 244: 1.0000 +0.5 Query 245: 1.0000 Query 246: 0.1250 Query 248: 0.8529 Query 249: 0.2275 Query 250: 1.0000 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Padua, Monolingual Finnish, Auto, TD Run IMSMFIPqe Average precision Overall statistics (individual queries): (for 45 queries): Recall−Precision Values 1.0 Query 201: 0.0373 Total number of documents Query 202: 0.9316 over all queries Query 203: 0.4111 Retrieved: 45000 Query 204: 0.3439 Relevant: 413 Query 205: 0.8093 Rel_ret: 325 0.8 Query 207: 0.0117 Query 208: 0.6431 Interpolated Recall - Query 209: 0.3333 Precision Averages: Query 210: 0.0204 at 0.00 0.6033 Query 211: 0.9241 at 0.10 0.5657 0.6 Query 212: 0.0419 at 0.20 0.5429 Query 213: 0.6393 at 0.30 0.5182 Query 214: 0.0000 at 0.40 0.4969 Precision Query 215: 0.0047 at 0.50 0.4695 Query 216: 0.0000 at 0.60 0.4395 0.4 Query 217: 0.6389 at 0.70 0.4106 Query 218: 0.9310 at 0.80 0.3919 Query 219: 0.8482 at 0.90 0.3244 Query 220: 0.0024 at 1.00 0.3194 Query 221: 0.4724 0.2 Query 222: 0.0980 Avg. prec. (non-interpolated) Query 223: 0.0873 for all rel. documents Query 224: 1.0000 0.4525 Query 225: 0.9429 Precision: Query 226: 0.6213 At 5 docs: 0.3956 0.0 Query 228: 0.0000 At 10 docs: 0.2778 0.0 0.2 0.4 0.6 0.8 1.0 Query 229: 0.0000 At 15 docs: 0.2370 Query 230: 0.9167 At 20 docs: 0.1900 Recall Query 232: 0.0000 At 30 docs: 0.1370 Query 233: 0.4924 At 100 docs: 0.0500 Query 234: 0.2683 At 200 docs: 0.0280 Run IMSMFIPqe Query 235: 0.0096 At 500 docs: 0.0134 Query 236: 1.0000 At 1000 docs: 0.0072 Comparison to median by topic Query 237: 1.0000 +1.0 Query 238: 1.0000 R-Precision (prec. after R Query 239: 0.1518 (=num_rel) docs. retrieved): Query 241: 0.0244 Exact: 0.4157 Query 242: 1.0000 Query 243: 0.1387 Query 244: 0.5000 +0.5 Query 245: 1.0000 Query 246: 0.0667 Query 248: 0.9429 Query 249: 0.0574 Query 250: 1.0000 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Padua, Monolingual Finnish, Auto, TD Run IMSMFIUa65 Average precision Overall statistics Recall−Precision Values (individual queries): (for 45 queries): 1.0 Query 201: 0.0263 Total number of documents Query 202: 0.8957 over all queries Query 203: 0.6111 Retrieved: 45000 Query 204: 0.3080 Relevant: 413 Query 205: 0.5146 Rel_ret: 305 0.8 Query 207: 0.0106 Query 208: 0.8034 Interpolated Recall - Query 209: 0.0000 Precision Averages: Query 210: 0.2000 at 0.00 0.5954 Query 211: 0.9780 at 0.10 0.5501 0.6 Query 212: 0.2750 at 0.20 0.5229 Query 213: 0.7477 at 0.30 0.4623 Query 214: 0.0000 at 0.40 0.4222 Precision Query 215: 0.1429 at 0.50 0.3982 Query 216: 0.0006 at 0.60 0.3733 0.4 Query 217: 0.5916 at 0.70 0.3445 Query 218: 1.0000 at 0.80 0.3360 Query 219: 0.0786 at 0.90 0.3141 Query 220: 0.0391 at 1.00 0.2988 Query 221: 0.3832 0.2 Query 222: 0.0934 Avg. prec. (non-interpolated) Query 223: 0.1195 for all rel. documents Query 224: 1.0000 0.4070 Query 225: 0.7862 Precision: Query 226: 0.0283 At 5 docs: 0.3689 0.0 Query 228: 0.0000 At 10 docs: 0.2733 0.0 0.2 0.4 0.6 0.8 1.0 Query 229: 0.0000 At 15 docs: 0.2193 Query 230: 0.8875 At 20 docs: 0.1889 Recall Query 232: 0.0000 At 30 docs: 0.1430 Query 233: 0.2791 At 100 docs: 0.0547 Query 234: 0.3428 At 200 docs: 0.0298 Run IMSMFIUa65 Query 235: 0.0382 At 500 docs: 0.0130 Comparison to median by topic Query 236: 1.0000 At 1000 docs: 0.0068 Query 237: 1.0000 +1.0 Query 238: 0.9167 R-Precision (prec. after R Query 239: 0.0869 (=num_rel) docs. retrieved): Query 241: 0.3645 Exact: 0.3675 Query 242: 1.0000 Query 243: 0.2635 Query 244: 1.0000 +0.5 Query 245: 0.5000 Query 246: 0.0588 Query 248: 0.7862 Query 249: 0.0313 Query 250: 0.1250 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Padua, Monolingual Finnish, Auto, TD Run IMSMFIUd65 Average precision Overall statistics Recall−Precision Values (individual queries): (for 45 queries): 1.0 Query 201: 0.0143 Total number of documents Query 202: 0.8861 over all queries Query 203: 0.8333 Retrieved: 45000 Query 204: 0.1534 Relevant: 413 Query 205: 0.3950 Rel_ret: 295 0.8 Query 207: 0.0018 Query 208: 0.8044 Interpolated Recall - Query 209: 0.0000 Precision Averages: Query 210: 0.0625 at 0.00 0.5842 Query 211: 0.9690 at 0.10 0.5346 0.6 Query 212: 0.1968 at 0.20 0.4859 Query 213: 0.7497 at 0.30 0.4534 Query 214: 0.0000 at 0.40 0.4074 Precision Query 215: 0.1667 at 0.50 0.3848 Query 216: 0.0007 at 0.60 0.3657 0.4 Query 217: 0.5675 at 0.70 0.3369 Query 218: 1.0000 at 0.80 0.3337 Query 219: 0.1506 at 0.90 0.3096 Query 220: 0.0463 at 1.00 0.3008 Query 221: 0.3806 0.2 Query 222: 0.1101 Avg. prec. (non-interpolated) Query 223: 0.1043 for all rel. documents Query 224: 1.0000 0.3956 Query 225: 0.7683 Precision: Query 226: 0.0444 At 5 docs: 0.3422 0.0 Query 228: 0.0000 At 10 docs: 0.2600 0.0 0.2 0.4 0.6 0.8 1.0 Query 229: 0.0000 At 15 docs: 0.2089 Query 230: 0.5333 At 20 docs: 0.1756 Recall Query 232: 0.0000 At 30 docs: 0.1311 Query 233: 0.4143 At 100 docs: 0.0493 Query 234: 0.1667 At 200 docs: 0.0266 Run IMSMFIUd65 Query 235: 0.0421 At 500 docs: 0.0119 Comparison to median by topic Query 236: 1.0000 At 1000 docs: 0.0066 Query 237: 1.0000 +1.0 Query 238: 0.9167 R-Precision (prec. after R Query 239: 0.0657 (=num_rel) docs. retrieved): Query 241: 0.0566 Exact: 0.3479 Query 242: 0.4167 Query 243: 0.3037 Query 244: 1.0000 +0.5 Query 245: 0.5000 Query 246: 0.1111 Query 248: 0.8350 Query 249: 0.0335 Query 250: 1.0000 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Alicante, Monolingual Finnish, Auto, TD Run IRn−MF−Dexp Average precision Overall statistics (individual queries): (for 45 queries): Recall−Precision Values 1.0 Query 201: 0.0923 Total number of documents Query 202: 0.9274 over all queries Query 203: 0.4778 Retrieved: 45000 Query 204: 0.8660 Relevant: 413 Query 205: 0.3774 Rel_ret: 390 0.8 Query 207: 0.2509 Query 208: 0.6320 Interpolated Recall - Query 209: 0.0000 Precision Averages: Query 210: 0.0588 at 0.00 0.6849 Query 211: 1.0000 at 0.10 0.6546 0.6 Query 212: 0.4007 at 0.20 0.5673 Query 213: 0.7947 at 0.30 0.5547 Query 214: 0.0222 at 0.40 0.5327 Precision Query 215: 0.1429 at 0.50 0.5236 Query 216: 0.0045 at 0.60 0.5030 0.4 Query 217: 0.7148 at 0.70 0.4679 Query 218: 0.9587 at 0.80 0.4337 Query 219: 0.4358 at 0.90 0.3635 Query 220: 0.0236 at 1.00 0.3227 Query 221: 0.8529 0.2 Query 222: 0.3511 Avg. prec. (non-interpolated) Query 223: 0.1636 for all rel. documents Query 224: 1.0000 0.4914 Query 225: 1.0000 Precision: Query 226: 0.4742 At 5 docs: 0.4533 0.0 Query 228: 0.0000 At 10 docs: 0.3511 0.0 0.2 0.4 0.6 0.8 1.0 Query 229: 0.2780 At 15 docs: 0.2963 Query 230: 0.5561 At 20 docs: 0.2567 Recall Query 232: 0.0000 At 30 docs: 0.1874 Query 233: 0.6786 At 100 docs: 0.0700 Query 234: 0.6457 At 200 docs: 0.0379 Run IRn−MF−Dexp Query 235: 0.8472 At 500 docs: 0.0168 Query 236: 0.8056 At 1000 docs: 0.0087 Comparison to median by topic Query 237: 1.0000 +1.0 Query 238: 0.4429 R-Precision (prec. after R Query 239: 0.2835 (=num_rel) docs. retrieved): Query 241: 0.0594 Exact: 0.4464 Query 242: 1.0000 Query 243: 0.3175 Query 244: 1.0000 +0.5 Query 245: 1.0000 Query 246: 0.0370 Query 248: 0.5311 Query 249: 0.1097 Query 250: 0.5000 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Alicante, Monolingual Finnish, Auto, TD Run IRn−MF−nexp Average precision Overall statistics (individual queries): (for 45 queries): Recall−Precision Values 1.0 Query 201: 0.0820 Total number of documents Query 202: 0.8888 over all queries Query 203: 0.7000 Retrieved: 45000 Query 204: 0.7558 Relevant: 413 Query 205: 0.5223 Rel_ret: 384 0.8 Query 207: 0.2874 Query 208: 0.5910 Interpolated Recall - Query 209: 0.0000 Precision Averages: Query 210: 0.0500 at 0.00 0.6528 Query 211: 1.0000 at 0.10 0.6212 0.6 Query 212: 0.3533 at 0.20 0.5597 Query 213: 0.6982 at 0.30 0.5564 Query 214: 0.0516 at 0.40 0.4904 Precision Query 215: 0.1667 at 0.50 0.4792 Query 216: 0.0031 at 0.60 0.4412 0.4 Query 217: 0.5938 at 0.70 0.3940 Query 218: 0.9909 at 0.80 0.3770 Query 219: 0.2676 at 0.90 0.3170 Query 220: 0.0324 at 1.00 0.2946 Query 221: 0.5191 0.2 Query 222: 0.1799 Avg. prec. (non-interpolated) Query 223: 0.0780 for all rel. documents Query 224: 1.0000 0.4533 Query 225: 0.9667 Precision: Query 226: 0.2940 At 5 docs: 0.4044 0.0 Query 228: 0.0003 At 10 docs: 0.3222 0.0 0.2 0.4 0.6 0.8 1.0 Query 229: 0.2197 At 15 docs: 0.2696 Query 230: 0.8304 At 20 docs: 0.2311 Recall Query 232: 0.0000 At 30 docs: 0.1770 Query 233: 0.6159 At 100 docs: 0.0669 Query 234: 0.5132 At 200 docs: 0.0367 Run IRn−MF−nexp Query 235: 0.7580 At 500 docs: 0.0164 Query 236: 0.8056 At 1000 docs: 0.0085 Comparison to median by topic Query 237: 1.0000 +1.0 Query 238: 0.3869 R-Precision (prec. after R Query 239: 0.1621 (=num_rel) docs. retrieved): Query 241: 0.0523 Exact: 0.3997 Query 242: 0.5833 Query 243: 0.2749 Query 244: 1.0000 +0.5 Query 245: 1.0000 Query 246: 0.0133 Query 248: 0.5033 Query 249: 0.1081 Query 250: 0.5000 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Alicante, Monolingual Finnish, Auto, TD Run IRn−MF−Pexp Average precision Overall statistics (individual queries): (for 45 queries): Recall−Precision Values 1.0 Query 201: 0.0977 Total number of documents Query 202: 0.9109 over all queries Query 203: 0.4778 Retrieved: 45000 Query 204: 0.8660 Relevant: 413 Query 205: 0.3774 Rel_ret: 391 0.8 Query 207: 0.2509 Query 208: 0.6690 Interpolated Recall - Query 209: 0.0000 Precision Averages: Query 210: 0.0455 at 0.00 0.6782 Query 211: 1.0000 at 0.10 0.6563 0.6 Query 212: 0.4007 at 0.20 0.5778 Query 213: 0.7947 at 0.30 0.5590 Query 214: 0.0230 at 0.40 0.5282 Precision Query 215: 0.2000 at 0.50 0.5152 Query 216: 0.0026 at 0.60 0.4978 0.4 Query 217: 0.7224 at 0.70 0.4645 Query 218: 0.9587 at 0.80 0.4317 Query 219: 0.4358 at 0.90 0.3643 Query 220: 0.0172 at 1.00 0.3233 Query 221: 0.8529 0.2 Query 222: 0.3413 Avg. prec. (non-interpolated) Query 223: 0.1498 for all rel. documents Query 224: 1.0000 0.4908 Query 225: 1.0000 Precision: Query 226: 0.4847 At 5 docs: 0.4533 0.0 Query 228: 0.0000 At 10 docs: 0.3511 0.0 0.2 0.4 0.6 0.8 1.0 Query 229: 0.2404 At 15 docs: 0.2963 Query 230: 0.5701 At 20 docs: 0.2522 Recall Query 232: 0.0000 At 30 docs: 0.1874 Query 233: 0.6786 At 100 docs: 0.0696 Query 234: 0.6457 At 200 docs: 0.0379 Run IRn−MF−Pexp Query 235: 0.8472 At 500 docs: 0.0168 Query 236: 0.8056 At 1000 docs: 0.0087 Comparison to median by topic Query 237: 1.0000 +1.0 Query 238: 0.4206 R-Precision (prec. after R Query 239: 0.2589 (=num_rel) docs. retrieved): Query 241: 0.0594 Exact: 0.4517 Query 242: 1.0000 Query 243: 0.3044 Query 244: 1.0000 +0.5 Query 245: 1.0000 Query 246: 0.0370 Query 248: 0.5311 Query 249: 0.1097 Query 250: 0.5000 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Thomson Legal, Monolingual Finnish, Auto, TD Run tlrfi1 Average precision Overall statistics Recall−Precision Values (individual queries): (for 45 queries): 1.0 Query 201: 0.0231 Total number of documents Query 202: 0.7765 over all queries Query 203: 1.0000 Retrieved: 45000 Query 204: 0.9186 Relevant: 413 Query 205: 0.8833 Rel_ret: 389 0.8 Query 207: 0.3981 Query 208: 0.7273 Interpolated Recall - Query 209: 0.0000 Precision Averages: Query 210: 0.5000 at 0.00 0.7457 Query 211: 1.0000 at 0.10 0.7179 0.6 Query 212: 0.4497 at 0.20 0.6708 Query 213: 0.7928 at 0.30 0.6262 Query 214: 0.2063 at 0.40 0.6116 Precision Query 215: 0.0769 at 0.50 0.5958 Query 216: 0.5588 at 0.60 0.5445 0.4 Query 217: 0.6291 at 0.70 0.5016 Query 218: 1.0000 at 0.80 0.4732 Query 219: 0.5049 at 0.90 0.4021 Query 220: 0.0643 at 1.00 0.3839 Query 221: 0.6676 0.2 Query 222: 0.1860 Avg. prec. (non-interpolated) Query 223: 0.0716 for all rel. documents Query 224: 1.0000 0.5551 Query 225: 0.9429 Precision: Query 226: 0.6164 At 5 docs: 0.4533 0.0 Query 228: 0.0015 At 10 docs: 0.3756 0.0 0.2 0.4 0.6 0.8 1.0 Query 229: 0.2684 At 15 docs: 0.3156 Query 230: 0.8750 At 20 docs: 0.2744 Recall Query 232: 0.0016 At 30 docs: 0.1978 Query 233: 0.6560 At 100 docs: 0.0731 Query 234: 0.3332 At 200 docs: 0.0392 Run tlrfi1 Query 235: 0.8250 At 500 docs: 0.0165 Comparison to median by topic Query 236: 0.9167 At 1000 docs: 0.0086 Query 237: 1.0000 +1.0 Query 238: 0.9167 R-Precision (prec. after R Query 239: 0.3167 (=num_rel) docs. retrieved): Query 241: 0.3018 Exact: 0.4994 Query 242: 1.0000 Query 243: 0.4392 Query 244: 1.0000 +0.5 Query 245: 0.5000 Query 246: 0.0244 Query 248: 0.4969 Query 249: 0.1106 Query 250: 1.0000 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Thomson Legal, Monolingual Finnish, Auto, TD Run tlrfi2 Average precision Overall statistics Recall−Precision Values (individual queries): (for 45 queries): 1.0 Query 201: 0.0475 Total number of documents Query 202: 0.7683 over all queries Query 203: 1.0000 Retrieved: 45000 Query 204: 0.9389 Relevant: 413 Query 205: 0.8833 Rel_ret: 383 0.8 Query 207: 0.3981 Query 208: 0.7273 Interpolated Recall - Query 209: 0.0000 Precision Averages: Query 210: 0.5000 at 0.00 0.7621 Query 211: 1.0000 at 0.10 0.7122 0.6 Query 212: 0.4497 at 0.20 0.6625 Query 213: 0.7928 at 0.30 0.6266 Query 214: 0.2063 at 0.40 0.6125 Precision Query 215: 0.0769 at 0.50 0.5941 Query 216: 0.5588 at 0.60 0.5446 0.4 Query 217: 0.6291 at 0.70 0.5040 Query 218: 1.0000 at 0.80 0.4762 Query 219: 0.5193 at 0.90 0.4057 Query 220: 0.0643 at 1.00 0.3846 Query 221: 0.6676 0.2 Query 222: 0.1860 Avg. prec. (non-interpolated) Query 223: 0.0716 for all rel. documents Query 224: 1.0000 0.5562 Query 225: 0.9429 Precision: Query 226: 0.6164 At 5 docs: 0.4578 0.0 Query 228: 0.0015 At 10 docs: 0.3733 0.0 0.2 0.4 0.6 0.8 1.0 Query 229: 0.2684 At 15 docs: 0.3111 Query 230: 0.8750 At 20 docs: 0.2744 Recall Query 232: 0.0027 At 30 docs: 0.1993 Query 233: 0.6560 At 100 docs: 0.0733 Query 234: 0.4184 At 200 docs: 0.0393 Run tlrfi2 Query 235: 0.8250 At 500 docs: 0.0165 Comparison to median by topic Query 236: 0.9167 At 1000 docs: 0.0085 Query 237: 1.0000 +1.0 Query 238: 0.9167 R-Precision (prec. after R Query 239: 0.3167 (=num_rel) docs. retrieved): Query 241: 0.2317 Exact: 0.5027 Query 242: 1.0000 Query 243: 0.4392 Query 244: 1.0000 +0.5 Query 245: 0.5000 Query 246: 0.0233 Query 248: 0.5367 Query 249: 0.0550 Query 250: 1.0000 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Amsterdam, Monolingual Finnish, Auto, TD Run UAmsC04FiFi4GiSb Average precision Overall statistics Recall−Precision Values (individual queries): (for 45 queries): 1.0 Query 201: 0.0868 Total number of documents Query 202: 0.9231 over all queries Query 203: 0.4206 Retrieved: 45000 Query 204: 0.9478 Relevant: 413 Query 205: 0.8307 Rel_ret: 379 0.8 Query 207: 0.1980 Query 208: 0.7994 Interpolated Recall - Query 209: 0.0000 Precision Averages: Query 210: 0.0526 at 0.00 0.6180 Query 211: 0.9306 at 0.10 0.6048 0.6 Query 212: 0.3205 at 0.20 0.5736 Query 213: 0.8554 at 0.30 0.5642 Query 214: 0.0812 at 0.40 0.5251 Precision Query 215: 0.2500 at 0.50 0.5060 Query 216: 0.0014 at 0.60 0.4902 0.4 Query 217: 0.6783 at 0.70 0.4285 Query 218: 1.0000 at 0.80 0.4019 Query 219: 0.7265 at 0.90 0.3305 Query 220: 0.0455 at 1.00 0.2842 Query 221: 0.8000 0.2 Query 222: 0.1872 Avg. prec. (non-interpolated) Query 223: 0.2040 for all rel. documents Query 224: 0.2500 0.4787 Query 225: 0.7962 Precision: Query 226: 0.9822 At 5 docs: 0.4267 0.0 Query 228: 0.0055 At 10 docs: 0.3600 0.0 0.2 0.4 0.6 0.8 1.0 Query 229: 0.0017 At 15 docs: 0.3067 Query 230: 0.7095 At 20 docs: 0.2489 Recall Query 232: 0.0013 At 30 docs: 0.1837 Query 233: 0.5577 At 100 docs: 0.0691 Query 234: 0.6921 At 200 docs: 0.0379 Run UAmsC04FiFi4GiSb Query 235: 0.4361 At 500 docs: 0.0165 Comparison to median by topic Query 236: 0.9167 At 1000 docs: 0.0084 Query 237: 0.9500 +1.0 Query 238: 0.7917 R-Precision (prec. after R Query 239: 0.1804 (=num_rel) docs. retrieved): Query 241: 0.1871 Exact: 0.4208 Query 242: 0.4167 Query 243: 0.3162 Query 244: 0.0476 +0.5 Query 245: 1.0000 Query 246: 0.0345 Query 248: 0.9250 Query 249: 0.0028 Query 250: 1.0000 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Amsterdam, Monolingual Finnish, Auto, TD Run UAmsC04FiFi4GiWd Average precision Overall statistics Recall−Precision Values (individual queries): (for 45 queries): 1.0 Query 201: 0.0577 Total number of documents Query 202: 0.9255 over all queries Query 203: 0.4111 Retrieved: 45000 Query 204: 0.8439 Relevant: 413 Query 205: 0.8502 Rel_ret: 378 0.8 Query 207: 0.1724 Query 208: 0.8097 Interpolated Recall - Query 209: 0.0000 Precision Averages: Query 210: 0.0625 at 0.00 0.6568 Query 211: 0.9255 at 0.10 0.6494 0.6 Query 212: 0.3460 at 0.20 0.6189 Query 213: 0.8374 at 0.30 0.5963 Query 214: 0.3939 at 0.40 0.5473 Precision Query 215: 0.1667 at 0.50 0.5258 Query 216: 0.0023 at 0.60 0.5002 0.4 Query 217: 0.6733 at 0.70 0.4416 Query 218: 1.0000 at 0.80 0.4099 Query 219: 0.6454 at 0.90 0.3340 Query 220: 0.0406 at 1.00 0.3007 Query 221: 0.9000 0.2 Query 222: 0.1394 Avg. prec. (non-interpolated) Query 223: 0.1716 for all rel. documents Query 224: 0.5000 0.5007 Query 225: 0.9429 Precision: Query 226: 0.9752 At 5 docs: 0.4489 0.0 Query 228: 0.0094 At 10 docs: 0.3622 0.0 0.2 0.4 0.6 0.8 1.0 Query 229: 0.0669 At 15 docs: 0.3022 Query 230: 0.6679 At 20 docs: 0.2467 Recall Query 232: 0.0000 At 30 docs: 0.1830 Query 233: 0.5749 At 100 docs: 0.0669 Query 234: 0.5509 At 200 docs: 0.0369 Run UAmsC04FiFi4GiWd Query 235: 0.5116 At 500 docs: 0.0163 Comparison to median by topic Query 236: 0.8056 At 1000 docs: 0.0084 Query 237: 1.0000 +1.0 Query 238: 0.7576 R-Precision (prec. after R Query 239: 0.1667 (=num_rel) docs. retrieved): Query 241: 0.1605 Exact: 0.4357 Query 242: 0.7500 Query 243: 0.6138 Query 244: 0.1429 +0.5 Query 245: 1.0000 Query 246: 0.0294 Query 248: 0.9250 Query 249: 0.0060 Query 250: 1.0000 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Amsterdam, Monolingual Finnish, Auto, TD Run UAmsC04FiFiAll Average precision Overall statistics Recall−Precision Values (individual queries): (for 45 queries): 1.0 Query 201: 0.0881 Total number of documents Query 202: 0.9437 over all queries Query 203: 0.6667 Retrieved: 45000 Query 204: 0.9242 Relevant: 413 Query 205: 0.8000 Rel_ret: 393 0.8 Query 207: 0.1709 Query 208: 0.8167 Interpolated Recall - Query 209: 0.0000 Precision Averages: Query 210: 0.0556 at 0.00 0.6591 Query 211: 0.9342 at 0.10 0.6480 0.6 Query 212: 0.3460 at 0.20 0.6232 Query 213: 0.8402 at 0.30 0.6192 Query 214: 0.1035 at 0.40 0.5739 Precision Query 215: 0.2000 at 0.50 0.5553 Query 216: 0.0042 at 0.60 0.5257 0.4 Query 217: 0.7577 at 0.70 0.4561 Query 218: 1.0000 at 0.80 0.4321 Query 219: 0.6928 at 0.90 0.3662 Query 220: 0.0750 at 1.00 0.3313 Query 221: 0.7878 0.2 Query 222: 0.1264 Avg. prec. (non-interpolated) Query 223: 0.1955 for all rel. documents Query 224: 1.0000 0.5203 Query 225: 0.9029 Precision: Query 226: 0.9752 At 5 docs: 0.4667 0.0 Query 228: 0.0141 At 10 docs: 0.3667 0.0 0.2 0.4 0.6 0.8 1.0 Query 229: 0.0236 At 15 docs: 0.2993 Query 230: 0.8304 At 20 docs: 0.2444 Recall Query 232: 0.0000 At 30 docs: 0.1785 Query 233: 0.5718 At 100 docs: 0.0691 Query 234: 0.5935 At 200 docs: 0.0383 Run UAmsC04FiFiAll Query 235: 0.5084 At 500 docs: 0.0168 Comparison to median by topic Query 236: 0.9167 At 1000 docs: 0.0087 Query 237: 1.0000 +1.0 Query 238: 0.8667 R-Precision (prec. after R Query 239: 0.1485 (=num_rel) docs. retrieved): Query 241: 0.1820 Exact: 0.4632 Query 242: 0.5833 Query 243: 0.4583 Query 244: 0.3333 +0.5 Query 245: 1.0000 Query 246: 0.0294 Query 248: 0.9429 Query 249: 0.0048 Query 250: 1.0000 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number SUNY Buffalo, Monolingual Finnish, Auto, TD Run UBmonoFI01 Average precision Overall statistics Recall−Precision Values (individual queries): (for 45 queries): 1.0 Query 201: 0.0663 Total number of documents Query 202: 0.9199 over all queries Query 203: 1.0000 Retrieved: 43659 Query 204: 0.8713 Relevant: 413 0.8 Query 205: 0.7633 Rel_ret: 318 Query 207: 0.0929 Query 208: 0.7382 Interpolated Recall - Query 209: 0.0000 Precision Averages: Query 210: 0.0625 at 0.00 0.6263 Query 211: 1.0000 at 0.10 0.5840 0.6 Query 212: 0.1913 at 0.20 0.5494 Query 213: 0.6603 at 0.30 0.5357 Query 214: 0.0000 at 0.40 0.4996 Precision Query 215: 0.0526 at 0.50 0.4800 Query 216: 0.0000 at 0.60 0.4604 0.4 Query 217: 0.7329 at 0.70 0.4038 Query 218: 0.8656 at 0.80 0.3827 Query 219: 0.5395 at 0.90 0.3427 Query 220: 0.0000 at 1.00 0.3319 Query 221: 0.1743 0.2 Query 222: 0.0452 Avg. prec. (non-interpolated) Query 223: 0.1328 for all rel. documents Query 224: 1.0000 0.4599 Query 225: 0.7862 Precision: Query 226: 0.3114 At 5 docs: 0.3956 0.0 Query 228: 0.0000 At 10 docs: 0.3067 0.0 0.2 0.4 0.6 0.8 1.0 Query 229: 0.0000 At 15 docs: 0.2563 Query 230: 1.0000 At 20 docs: 0.2189 Recall Query 232: 0.0000 At 30 docs: 0.1541 Query 233: 0.4351 At 100 docs: 0.0562 Query 234: 0.5039 At 200 docs: 0.0310 Run UBmonoFI01 Query 235: 0.1841 At 500 docs: 0.0136 Comparison to median by topic Query 236: 0.9167 At 1000 docs: 0.0071 Query 237: 1.0000 +1.0 Query 238: 0.7222 R-Precision (prec. after R Query 239: 0.0921 (=num_rel) docs. retrieved): Query 241: 0.0154 Exact: 0.4545 Query 242: 0.7500 Query 243: 0.4128 Query 244: 1.0000 +0.5 Query 245: 1.0000 Query 246: 0.0667 Query 248: 0.5867 Query 249: 0.0027 Query 250: 1.0000 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Hildesheim, Monolingual Finnish, Auto, TD Run UHIfi1 Average precision Overall statistics Recall−Precision Values (individual queries): (for 45 queries): 1.0 Query 201: 0.1466 Total number of documents Query 202: 0.8313 over all queries Query 203: 0.8667 Retrieved: 45000 Query 204: 0.9288 Relevant: 413 Query 205: 0.6202 Rel_ret: 349 0.8 Query 207: 0.0041 Query 208: 0.8142 Interpolated Recall - Query 209: 0.0000 Precision Averages: Query 210: 0.0500 at 0.00 0.6536 Query 211: 0.9474 at 0.10 0.6207 0.6 Query 212: 0.2611 at 0.20 0.5785 Query 213: 0.6817 at 0.30 0.5575 Query 214: 0.0000 at 0.40 0.5114 Precision Query 215: 0.1000 at 0.50 0.4855 Query 216: 0.0009 at 0.60 0.4450 0.4 Query 217: 0.6217 at 0.70 0.3898 Query 218: 0.9909 at 0.80 0.3766 Query 219: 0.6047 at 0.90 0.3455 Query 220: 0.0952 at 1.00 0.3233 Query 221: 0.3543 0.2 Query 222: 0.1551 Avg. prec. (non-interpolated) Query 223: 0.1792 for all rel. documents Query 224: 1.0000 0.4699 Query 225: 0.7862 Precision: Query 226: 0.2822 At 5 docs: 0.3956 0.0 Query 228: 0.0000 At 10 docs: 0.3067 0.0 0.2 0.4 0.6 0.8 1.0 Query 229: 0.0000 At 15 docs: 0.2637 Query 230: 0.3882 At 20 docs: 0.2244 Recall Query 232: 0.0000 At 30 docs: 0.1704 Query 233: 0.3944 At 100 docs: 0.0633 Query 234: 0.5310 At 200 docs: 0.0346 Run UHIfi1 Query 235: 0.2140 At 500 docs: 0.0151 Comparison to median by topic Query 236: 1.0000 At 1000 docs: 0.0078 Query 237: 1.0000 +1.0 Query 238: 0.7556 R-Precision (prec. after R Query 239: 0.1525 (=num_rel) docs. retrieved): Query 241: 0.1336 Exact: 0.4341 Query 242: 0.7500 Query 243: 0.2147 Query 244: 1.0000 +0.5 Query 245: 1.0000 Query 246: 0.0345 Query 248: 0.8583 Query 249: 0.3987 Query 250: 1.0000 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Hildesheim, Monolingual Finnish, Auto, TD Run UHIfi2 Average precision Overall statistics Recall−Precision Values (individual queries): (for 45 queries): 1.0 Query 201: 0.1456 Total number of documents Query 202: 0.9323 over all queries Query 203: 0.9167 Retrieved: 44199 Query 204: 0.9531 Relevant: 413 Query 205: 0.5963 Rel_ret: 367 0.8 Query 207: 0.1159 Query 208: 0.7920 Interpolated Recall - Query 209: 0.0000 Precision Averages: Query 210: 0.0769 at 0.00 0.6448 Query 211: 0.9659 at 0.10 0.6190 0.6 Query 212: 0.4002 at 0.20 0.5942 Query 213: 0.7228 at 0.30 0.5825 Query 214: 0.0000 at 0.40 0.5459 Precision Query 215: 0.2500 at 0.50 0.5258 Query 216: 0.0008 at 0.60 0.5063 0.4 Query 217: 0.7108 at 0.70 0.4528 Query 218: 0.9625 at 0.80 0.4311 Query 219: 0.7827 at 0.90 0.3774 Query 220: 0.0394 at 1.00 0.3477 Query 221: 0.7683 0.2 Query 222: 0.2083 Avg. prec. (non-interpolated) Query 223: 0.1732 for all rel. documents Query 224: 0.5000 0.5042 Query 225: 0.9429 Precision: Query 226: 0.3644 At 5 docs: 0.4444 0.0 Query 228: 0.0000 At 10 docs: 0.3511 0.0 0.2 0.4 0.6 0.8 1.0 Query 229: 0.0000 At 15 docs: 0.2933 Query 230: 0.3849 At 20 docs: 0.2422 Recall Query 232: 0.0000 At 30 docs: 0.1830 Query 233: 0.3036 At 100 docs: 0.0689 Query 234: 0.5543 At 200 docs: 0.0373 Run UHIfi2 Query 235: 0.4601 At 500 docs: 0.0160 Comparison to median by topic Query 236: 0.9167 At 1000 docs: 0.0082 Query 237: 1.0000 +1.0 Query 238: 1.0000 R-Precision (prec. after R Query 239: 0.2818 (=num_rel) docs. retrieved): Query 241: 0.1155 Exact: 0.4601 Query 242: 1.0000 Query 243: 0.2482 Query 244: 1.0000 +0.5 Query 245: 1.0000 Query 246: 0.0455 Query 248: 0.9429 Query 249: 0.1158 Query 250: 1.0000 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Université de Neuchâtel, Monolingual Finnish, Auto, TD Run UniNEfi1 Average precision Overall statistics Recall−Precision Values (individual queries): (for 45 queries): 1.0 Query 201: 0.0719 Total number of documents Query 202: 0.9157 over all queries Query 203: 0.5012 Retrieved: 45000 Query 204: 0.9672 Relevant: 413 0.8 Query 205: 0.9103 Rel_ret: 397 Query 207: 0.1242 Query 208: 0.8539 Interpolated Recall - Query 209: 0.0094 Precision Averages: Query 210: 0.5000 at 0.00 0.6590 Query 211: 0.9813 at 0.10 0.6432 0.6 Query 212: 0.2414 at 0.20 0.6170 Query 213: 0.6426 at 0.30 0.6070 Query 214: 0.5556 at 0.40 0.5342 Precision Query 215: 0.0200 at 0.50 0.5104 Query 216: 0.0471 at 0.60 0.4861 0.4 Query 217: 0.4126 at 0.70 0.4267 Query 218: 0.9909 at 0.80 0.3972 Query 219: 0.8352 at 0.90 0.3483 Query 220: 0.0000 at 1.00 0.3201 Query 221: 0.1850 0.2 Query 222: 0.2262 Avg. prec. (non-interpolated) Query 223: 0.1934 for all rel. documents Query 224: 1.0000 0.4967 Query 225: 1.0000 Precision: Query 226: 0.3148 At 5 docs: 0.4444 0.0 Query 228: 0.0135 At 10 docs: 0.3422 0.0 0.2 0.4 0.6 0.8 1.0 Query 229: 0.0519 At 15 docs: 0.2859 Query 230: 0.5563 At 20 docs: 0.2378 Recall Query 232: 0.0011 At 30 docs: 0.1785 Query 233: 0.6988 At 100 docs: 0.0644 Query 234: 0.6416 At 200 docs: 0.0343 Run UniNEfi1 Query 235: 0.7286 At 500 docs: 0.0144 Comparison to median by topic Query 236: 0.9167 At 1000 docs: 0.0088 Query 237: 1.0000 +1.0 Query 238: 1.0000 R-Precision (prec. after R Query 239: 0.3757 (=num_rel) docs. retrieved): Query 241: 0.0724 Exact: 0.4453 Query 242: 1.0000 Query 243: 0.0667 Query 244: 0.5000 +0.5 Query 245: 0.5000 Query 246: 0.0345 Query 248: 0.6595 Query 249: 0.0321 Query 250: 1.0000 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Université de Neuchâtel, Monolingual Finnish, Auto, TD Run UniNEfi2 Average precision Overall statistics Recall−Precision Values (individual queries): (for 45 queries): 1.0 Query 201: 0.0918 Total number of documents Query 202: 0.9208 over all queries Query 203: 0.7556 Retrieved: 45000 Query 204: 0.9651 Relevant: 413 0.8 Query 205: 0.9167 Rel_ret: 404 Query 207: 0.1990 Query 208: 0.7843 Interpolated Recall - Query 209: 0.0078 Precision Averages: Query 210: 0.3333 at 0.00 0.6622 Query 211: 0.9822 at 0.10 0.6577 0.6 Query 212: 0.3492 at 0.20 0.6395 Query 213: 0.6509 at 0.30 0.6231 Query 214: 0.5556 at 0.40 0.5834 Precision Query 215: 0.0233 at 0.50 0.5696 Query 216: 0.0345 at 0.60 0.5594 0.4 Query 217: 0.7668 at 0.70 0.5184 Query 218: 0.9909 at 0.80 0.4787 Query 219: 0.8323 at 0.90 0.4139 Query 220: 0.0037 at 1.00 0.3832 Query 221: 0.3470 0.2 Query 222: 0.2165 Avg. prec. (non-interpolated) Query 223: 0.1976 for all rel. documents Query 224: 1.0000 0.5453 Query 225: 1.0000 Precision: Query 226: 0.9103 At 5 docs: 0.4711 0.0 Query 228: 0.0085 At 10 docs: 0.3600 0.0 0.2 0.4 0.6 0.8 1.0 Query 229: 0.0934 At 15 docs: 0.3111 Query 230: 0.5269 At 20 docs: 0.2589 Recall Query 232: 0.0012 At 30 docs: 0.1970 Query 233: 0.7131 At 100 docs: 0.0729 Query 234: 0.6854 At 200 docs: 0.0401 Run UniNEfi2 Query 235: 0.7538 At 500 docs: 0.0174 Comparison to median by topic Query 236: 0.9167 At 1000 docs: 0.0090 Query 237: 1.0000 +1.0 Query 238: 1.0000 R-Precision (prec. after R Query 239: 0.4109 (=num_rel) docs. retrieved): Query 241: 0.0953 Exact: 0.5009 Query 242: 1.0000 Query 243: 0.2790 Query 244: 0.5000 +0.5 Query 245: 1.0000 Query 246: 0.0357 Query 248: 0.6595 Query 249: 0.0224 Query 250: 1.0000 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Université de Neuchâtel, Monolingual Finnish, Auto, TDN Run UniNEfi3 Average precision Overall statistics Recall−Precision Values (individual queries): (for 45 queries): 1.0 Query 201: 0.1138 Total number of documents Query 202: 0.9157 over all queries Query 203: 0.6667 Retrieved: 45000 Query 204: 0.9646 Relevant: 413 0.8 Query 205: 0.8093 Rel_ret: 405 Query 207: 0.2020 Query 208: 0.7890 Interpolated Recall - Query 209: 0.0054 Precision Averages: Query 210: 0.0909 at 0.00 0.6913 Query 211: 0.9881 at 0.10 0.6728 0.6 Query 212: 0.4500 at 0.20 0.6648 Query 213: 0.7957 at 0.30 0.6345 Query 214: 0.4667 at 0.40 0.5916 Precision Query 215: 0.0081 at 0.50 0.5838 Query 216: 0.1314 at 0.60 0.5500 0.4 Query 217: 0.6999 at 0.70 0.5117 Query 218: 1.0000 at 0.80 0.4562 Query 219: 0.7661 at 0.90 0.3958 Query 220: 0.2579 at 1.00 0.3764 Query 221: 0.6176 0.2 Query 222: 0.1463 Avg. prec. (non-interpolated) Query 223: 0.1843 for all rel. documents Query 224: 1.0000 0.5454 Query 225: 1.0000 Precision: Query 226: 0.8388 At 5 docs: 0.4756 0.0 Query 228: 0.0595 At 10 docs: 0.3867 0.0 0.2 0.4 0.6 0.8 1.0 Query 229: 0.4125 At 15 docs: 0.3274 Query 230: 0.5521 At 20 docs: 0.2711 Recall Query 232: 0.0175 At 30 docs: 0.2000 Query 233: 0.7455 At 100 docs: 0.0747 Query 234: 0.7218 At 200 docs: 0.0417 Run UniNEfi3 Query 235: 0.7534 At 500 docs: 0.0176 Comparison to median by topic Query 236: 0.9167 At 1000 docs: 0.0090 Query 237: 1.0000 +1.0 Query 238: 1.0000 R-Precision (prec. after R Query 239: 0.3018 (=num_rel) docs. retrieved): Query 241: 0.1084 Exact: 0.4887 Query 242: 1.0000 Query 243: 0.2996 Query 244: 0.5000 +0.5 Query 245: 0.5000 Query 246: 0.0370 Query 248: 0.6862 Query 249: 0.0247 Query 250: 1.0000 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number JHU/APL, Monolingual French, Auto, TD Run aplmofra Average precision Overall statistics (individual queries): (for 49 queries): Recall−Precision Values 1.0 Query 201: 0.2999 Total number of documents Query 202: 0.5789 over all queries Query 203: 0.5675 Retrieved: 49000 Query 204: 0.7926 Relevant: 915 Query 205: 0.5793 Rel_ret: 888 0.8 Query 206: 0.4066 Query 207: 0.3427 Interpolated Recall - Query 208: 0.6792 Precision Averages: Query 209: 0.0569 at 0.00 0.6062 Query 210: 0.0904 at 0.10 0.5825 0.6 Query 211: 0.8876 at 0.20 0.5552 Query 212: 0.4281 at 0.30 0.5101 Query 213: 0.7902 at 0.40 0.4786 Precision Query 214: 0.1085 at 0.50 0.4604 Query 215: 0.3024 at 0.60 0.4319 0.4 Query 216: 0.0543 at 0.70 0.3851 Query 217: 0.4147 at 0.80 0.3377 Query 218: 0.9151 at 0.90 0.2981 Query 219: 0.0507 at 1.00 0.2347 Query 220: 0.0170 0.2 Query 221: 0.5807 Avg. prec. (non-interpolated) Query 222: 0.1507 for all rel. documents Query 223: 0.0216 0.4283 Query 224: 0.9056 Precision: Query 225: 0.0179 At 5 docs: 0.4367 0.0 Query 226: 0.2500 At 10 docs: 0.4020 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.5002 At 15 docs: 0.3619 Query 229: 0.4518 At 20 docs: 0.3337 Recall Query 230: 0.9124 At 30 docs: 0.2891 Query 231: 0.2924 At 100 docs: 0.1396 Query 232: 0.0850 At 200 docs: 0.0788 Run aplmofra Query 233: 0.5934 At 500 docs: 0.0350 Query 234: 0.2011 At 1000 docs: 0.0181 Comparison to median by topic Query 235: 0.7890 +1.0 Query 236: 0.9698 R-Precision (prec. after R Query 237: 0.8735 (=num_rel) docs. retrieved): Query 238: 0.3963 Exact: 0.4016 Query 239: 0.0727 Query 240: 1.0000 Query 241: 0.0018 +0.5 Query 242: 0.3476 Query 243: 0.5309 Query 244: 0.1111 Query 245: 0.7763 Query 246: 0.1217 Query 247: 0.9909 Query 248: 0.6149 0.0 Query 249: 0.0333 Query 250: 0.0327 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number JHU/APL, Monolingual French, Auto, TD Run aplmofrb Average precision Overall statistics (individual queries): (for 49 queries): Recall−Precision Values 1.0 Query 201: 0.3651 Total number of documents Query 202: 0.6434 over all queries Query 203: 0.5447 Retrieved: 49000 Query 204: 0.8262 Relevant: 915 Query 205: 0.5924 Rel_ret: 891 0.8 Query 206: 0.3764 Query 207: 0.3146 Interpolated Recall - Query 208: 0.6792 Precision Averages: Query 209: 0.0477 at 0.00 0.6380 Query 210: 0.0951 at 0.10 0.6009 0.6 Query 211: 0.8882 at 0.20 0.5752 Query 212: 0.3245 at 0.30 0.5362 Query 213: 0.7334 at 0.40 0.5080 Precision Query 214: 0.1048 at 0.50 0.4901 Query 215: 0.1265 at 0.60 0.4607 0.4 Query 216: 0.0703 at 0.70 0.4146 Query 217: 0.4019 at 0.80 0.3790 Query 218: 0.9039 at 0.90 0.3351 Query 219: 0.1000 at 1.00 0.2732 Query 220: 0.0206 0.2 Query 221: 0.5162 Avg. prec. (non-interpolated) Query 222: 0.0823 for all rel. documents Query 223: 0.0198 0.4581 Query 224: 0.9484 Precision: Query 225: 0.0227 At 5 docs: 0.4571 0.0 Query 226: 1.0000 At 10 docs: 0.3857 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.5347 At 15 docs: 0.3578 Query 229: 0.4974 At 20 docs: 0.3357 Recall Query 230: 0.9114 At 30 docs: 0.2905 Query 231: 0.3594 At 100 docs: 0.1400 Query 232: 0.1105 At 200 docs: 0.0789 Run aplmofrb Query 233: 0.5674 At 500 docs: 0.0349 Query 234: 0.3925 At 1000 docs: 0.0182 Comparison to median by topic Query 235: 0.8050 +1.0 Query 236: 0.9809 R-Precision (prec. after R Query 237: 0.8895 (=num_rel) docs. retrieved): Query 238: 0.3637 Exact: 0.4289 Query 239: 0.1029 Query 240: 1.0000 Query 241: 0.0050 +0.5 Query 242: 0.3423 Query 243: 0.5487 Query 244: 0.5000 Query 245: 0.8500 Query 246: 0.2406 Query 247: 1.0000 Query 248: 0.6295 0.0 Query 249: 0.0256 Query 250: 0.0413 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number JHU/APL, Monolingual French, Auto, TD Run aplmofrc Average precision Overall statistics (individual queries): (for 49 queries): Recall−Precision Values 1.0 Query 201: 0.3140 Total number of documents Query 202: 0.6075 over all queries Query 203: 0.5449 Retrieved: 49000 Query 204: 0.8001 Relevant: 915 Query 205: 0.5852 Rel_ret: 810 0.8 Query 206: 0.3730 Query 207: 0.3209 Interpolated Recall - Query 208: 0.6792 Precision Averages: Query 209: 0.0168 at 0.00 0.5989 Query 210: 0.0922 at 0.10 0.5709 0.6 Query 211: 0.8761 at 0.20 0.5466 Query 212: 0.2671 at 0.30 0.5100 Query 213: 0.7255 at 0.40 0.4702 Precision Query 214: 0.1321 at 0.50 0.4435 Query 215: 0.2533 at 0.60 0.4178 0.4 Query 216: 0.0445 at 0.70 0.3847 Query 217: 0.4262 at 0.80 0.3404 Query 218: 0.8863 at 0.90 0.3016 Query 219: 0.0362 at 1.00 0.2408 Query 220: 0.0172 0.2 Query 221: 0.4700 Avg. prec. (non-interpolated) Query 222: 0.1422 for all rel. documents Query 223: 0.0203 0.4249 Query 224: 0.9306 Precision: Query 225: 0.0200 At 5 docs: 0.4286 0.0 Query 226: 0.5000 At 10 docs: 0.3694 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.4784 At 15 docs: 0.3415 Query 229: 0.4311 At 20 docs: 0.3184 Recall Query 230: 0.9377 At 30 docs: 0.2782 Query 231: 0.3258 At 100 docs: 0.1339 Query 232: 0.0007 At 200 docs: 0.0760 Run aplmofrc Query 233: 0.5508 At 500 docs: 0.0320 Query 234: 0.0034 At 1000 docs: 0.0165 Comparison to median by topic Query 235: 0.8190 +1.0 Query 236: 0.9698 R-Precision (prec. after R Query 237: 0.8907 (=num_rel) docs. retrieved): Query 238: 0.3586 Exact: 0.3812 Query 239: 0.0325 Query 240: 1.0000 Query 241: 0.0042 +0.5 Query 242: 0.3265 Query 243: 0.5371 Query 244: 0.5000 Query 245: 0.7572 Query 246: 0.2127 Query 247: 0.9909 Query 248: 0.5822 0.0 Query 249: 0.0256 Query 250: 0.0057 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number CLIPS, Monolingual French, Auto, TDN Run CLIPS04MNFR1 Average precision Overall statistics Recall−Precision Values (individual queries): (for 49 queries): 1.0 Query 201: 0.1737 Total number of documents Query 202: 0.6059 over all queries Query 203: 0.3415 Retrieved: 49000 Query 204: 0.8320 Relevant: 915 Query 205: 0.4995 Rel_ret: 875 0.8 Query 206: 0.3464 Query 207: 0.0837 Interpolated Recall - Query 208: 0.8042 Precision Averages: Query 209: 0.1453 at 0.00 0.7218 Query 210: 0.1938 at 0.10 0.6394 0.6 Query 211: 0.7769 at 0.20 0.5961 Query 212: 0.3222 at 0.30 0.5398 Query 213: 0.8111 at 0.40 0.4736 Precision Query 214: 0.0272 at 0.50 0.4382 Query 215: 0.0925 at 0.60 0.4041 0.4 Query 216: 0.0919 at 0.70 0.3809 Query 217: 0.3340 at 0.80 0.3462 Query 218: 0.9506 at 0.90 0.2979 Query 219: 0.0063 at 1.00 0.2093 Query 220: 0.3599 0.2 Query 221: 0.4063 Avg. prec. (non-interpolated) Query 222: 0.1198 for all rel. documents Query 223: 0.0242 0.4443 Query 224: 1.0000 Precision: Query 225: 0.1667 At 5 docs: 0.4653 0.0 Query 226: 0.1667 At 10 docs: 0.4061 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.3567 At 15 docs: 0.3510 Query 229: 0.2974 At 20 docs: 0.3194 Recall Query 230: 0.8955 At 30 docs: 0.2728 Query 231: 0.7933 At 100 docs: 0.1408 Query 232: 0.5265 At 200 docs: 0.0818 Run CLIPS04MNFR1 Query 233: 0.6172 At 500 docs: 0.0348 Comparison to median by topic Query 234: 0.4611 At 1000 docs: 0.0179 Query 235: 0.8774 +1.0 Query 236: 1.0000 R-Precision (prec. after R Query 237: 0.8870 (=num_rel) docs. retrieved): Query 238: 0.4429 Exact: 0.4172 Query 239: 0.1050 Query 240: 1.0000 Query 241: 0.0177 +0.5 Query 242: 0.4510 Query 243: 0.5391 Query 244: 0.0000 Query 245: 0.8409 Query 246: 0.1030 Query 247: 0.9714 Query 248: 0.8045 0.0 Query 249: 0.0182 Query 250: 0.0826 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Dublin City University, Monolingual French, Auto, TD Run exefrmono04a Average precision Overall statistics Recall−Precision Values (individual queries): (for 49 queries): 1.0 Query 201: 0.3421 Total number of documents Query 202: 0.7313 over all queries Query 203: 0.3183 Retrieved: 49000 Query 204: 0.7999 Relevant: 915 0.8 Query 205: 0.2325 Rel_ret: 843 Query 206: 0.3927 Query 207: 0.1538 Interpolated Recall - Query 208: 0.8042 Precision Averages: Query 209: 0.0010 at 0.00 0.6009 Query 210: 0.0927 at 0.10 0.5712 0.6 Query 211: 0.8649 at 0.20 0.5526 Query 212: 0.4084 at 0.30 0.4907 Query 213: 0.7559 at 0.40 0.4728 Precision Query 214: 0.0002 at 0.50 0.4404 Query 215: 0.0448 at 0.60 0.4199 0.4 Query 216: 0.0024 at 0.70 0.3920 Query 217: 0.5037 at 0.80 0.3458 Query 218: 0.9252 at 0.90 0.2748 Query 219: 0.2529 at 1.00 0.2127 Query 220: 0.1326 0.2 Query 221: 0.5203 Avg. prec. (non-interpolated) Query 222: 0.0200 for all rel. documents Query 223: 0.0207 0.4236 Query 224: 0.8770 Precision: Query 225: 0.0076 At 5 docs: 0.4286 0.0 Query 226: 1.0000 At 10 docs: 0.3633 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.5726 At 15 docs: 0.3347 Query 229: 0.5147 At 20 docs: 0.2949 Recall Query 230: 0.8155 At 30 docs: 0.2619 Query 231: 0.5657 At 100 docs: 0.1308 Query 232: 0.0711 At 200 docs: 0.0739 Run exefrmono04a Query 233: 0.4963 At 500 docs: 0.0326 Comparison to median by topic Query 234: 0.0076 At 1000 docs: 0.0172 Query 235: 0.8626 +1.0 Query 236: 0.9540 R-Precision (prec. after R Query 237: 0.7872 (=num_rel) docs. retrieved): Query 238: 0.3960 Exact: 0.3900 Query 239: 0.0176 Query 240: 1.0000 Query 241: 0.0001 +0.5 Query 242: 0.1646 Query 243: 0.5256 Query 244: 0.0047 Query 245: 0.8409 Query 246: 0.1319 Query 247: 0.9833 0.0 Query 248: 0.7548 Query 249: 0.0357 Query 250: 0.0499 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Dublin City University, Monolingual French, Auto, TD Run exefrmono04q Average precision Overall statistics (individual queries): (for 49 queries): Recall−Precision Values 1.0 Query 201: 0.4130 Total number of documents Query 202: 0.7442 over all queries Query 203: 0.3183 Retrieved: 49000 Query 204: 0.8476 Relevant: 915 Query 205: 0.2537 Rel_ret: 849 0.8 Query 206: 0.4086 Query 207: 0.2152 Interpolated Recall - Query 208: 0.8042 Precision Averages: Query 209: 0.0009 at 0.00 0.6009 Query 210: 0.0922 at 0.10 0.5741 0.6 Query 211: 0.8595 at 0.20 0.5444 Query 212: 0.3853 at 0.30 0.4896 Query 213: 0.7571 at 0.40 0.4611 Precision Query 214: 0.0142 at 0.50 0.4275 Query 215: 0.0420 at 0.60 0.4107 0.4 Query 216: 0.0041 at 0.70 0.3750 Query 217: 0.5631 at 0.80 0.3284 Query 218: 0.9131 at 0.90 0.2600 Query 219: 0.2143 at 1.00 0.2038 Query 220: 0.1673 0.2 Query 221: 0.5239 Avg. prec. (non-interpolated) Query 222: 0.0188 for all rel. documents Query 223: 0.0189 0.4143 Query 224: 0.8626 Precision: Query 225: 0.0091 At 5 docs: 0.4367 0.0 Query 226: 0.3333 At 10 docs: 0.3653 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.4263 At 15 docs: 0.3388 Query 229: 0.5234 At 20 docs: 0.3051 Recall Query 230: 0.8148 At 30 docs: 0.2599 Query 231: 0.5705 At 100 docs: 0.1292 Query 232: 0.0622 At 200 docs: 0.0724 Run exefrmono04q Query 233: 0.5011 At 500 docs: 0.0326 Query 234: 0.0075 At 1000 docs: 0.0173 Comparison to median by topic Query 235: 0.8626 +1.0 Query 236: 0.9415 R-Precision (prec. after R Query 237: 0.7924 (=num_rel) docs. retrieved): Query 238: 0.4561 Exact: 0.3706 Query 239: 0.0217 Query 240: 1.0000 Query 241: 0.0001 +0.5 Query 242: 0.2006 Query 243: 0.4373 Query 244: 0.0050 Query 245: 0.8750 Query 246: 0.1771 Query 247: 0.9809 Query 248: 0.7793 0.0 Query 249: 0.0294 Query 250: 0.0521 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Dublin City University, Monolingual French, Auto, TD Run exefrmono04t Average precision Overall statistics Recall−Precision Values (individual queries): (for 49 queries): 1.0 Query 201: 0.3817 Total number of documents Query 202: 0.7242 over all queries Query 203: 0.3154 Retrieved: 49000 Query 204: 0.7862 Relevant: 915 0.8 Query 205: 0.2459 Rel_ret: 844 Query 206: 0.3959 Query 207: 0.2020 Interpolated Recall - Query 208: 0.8042 Precision Averages: Query 209: 0.0010 at 0.00 0.5978 Query 210: 0.0920 at 0.10 0.5612 0.6 Query 211: 0.8489 at 0.20 0.5337 Query 212: 0.3914 at 0.30 0.4814 Query 213: 0.7437 at 0.40 0.4558 Precision Query 214: 0.0002 at 0.50 0.4226 Query 215: 0.0377 at 0.60 0.3999 0.4 Query 216: 0.0040 at 0.70 0.3762 Query 217: 0.5270 at 0.80 0.3261 Query 218: 0.9197 at 0.90 0.2587 Query 219: 0.2666 at 1.00 0.1981 Query 220: 0.1638 0.2 Query 221: 0.5551 Avg. prec. (non-interpolated) Query 222: 0.0203 for all rel. documents Query 223: 0.0183 0.4097 Query 224: 0.9242 Precision: Query 225: 0.0079 At 5 docs: 0.4286 0.0 Query 226: 0.1667 At 10 docs: 0.3612 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.5833 At 15 docs: 0.3265 Query 229: 0.5016 At 20 docs: 0.2980 Recall Query 230: 0.8078 At 30 docs: 0.2578 Query 231: 0.5705 At 100 docs: 0.1288 Query 232: 0.0613 At 200 docs: 0.0738 Run exefrmono04t Query 233: 0.4551 At 500 docs: 0.0323 Comparison to median by topic Query 234: 0.0074 At 1000 docs: 0.0172 Query 235: 0.8825 +1.0 Query 236: 0.9327 R-Precision (prec. after R Query 237: 0.7923 (=num_rel) docs. retrieved): Query 238: 0.3960 Exact: 0.3729 Query 239: 0.0140 Query 240: 1.0000 Query 241: 0.0001 +0.5 Query 242: 0.1828 Query 243: 0.5279 Query 244: 0.0051 Query 245: 0.8333 Query 246: 0.1711 Query 247: 0.9909 0.0 Query 248: 0.7314 Query 249: 0.0345 Query 250: 0.0512 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Dublin City University, Monolingual French, Auto, TD Run exefrmonosys04a Average precision Overall statistics (individual queries): (for 49 queries): Recall−Precision Values 1.0 Query 201: 0.3647 Total number of documents Query 202: 0.6327 over all queries Query 203: 0.4882 Retrieved: 49000 Query 204: 0.7502 Relevant: 915 Query 205: 0.1332 Rel_ret: 774 0.8 Query 206: 0.3746 Query 207: 0.2784 Interpolated Recall - Query 208: 0.8042 Precision Averages: Query 209: 0.0634 at 0.00 0.5973 Query 210: 0.0786 at 0.10 0.5422 0.6 Query 211: 0.8092 at 0.20 0.5070 Query 212: 0.1147 at 0.30 0.4610 Query 213: 0.8699 at 0.40 0.4201 Precision Query 214: 0.0013 at 0.50 0.4019 Query 215: 0.0427 at 0.60 0.3868 0.4 Query 216: 0.0596 at 0.70 0.3454 Query 217: 0.3875 at 0.80 0.3130 Query 218: 0.9155 at 0.90 0.2736 Query 219: 0.5404 at 1.00 0.2059 Query 220: 0.0103 0.2 Query 221: 0.7446 Avg. prec. (non-interpolated) Query 222: 0.0039 for all rel. documents Query 223: 0.0469 0.3929 Query 224: 0.6453 Precision: Query 225: 0.3333 At 5 docs: 0.4000 0.0 Query 226: 0.5000 At 10 docs: 0.3469 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.0012 At 15 docs: 0.3170 Query 229: 0.2233 At 20 docs: 0.2857 Recall Query 230: 0.9005 At 30 docs: 0.2463 Query 231: 0.1668 At 100 docs: 0.1257 Query 232: 0.0060 At 200 docs: 0.0705 Run exefrmonosys04a Query 233: 0.3553 At 500 docs: 0.0302 Query 234: 0.1004 At 1000 docs: 0.0158 Comparison to median by topic Query 235: 0.6808 +1.0 Query 236: 0.8822 R-Precision (prec. after R Query 237: 0.9310 (=num_rel) docs. retrieved): Query 238: 0.4442 Exact: 0.3425 Query 239: 0.0907 Query 240: 1.0000 Query 241: 0.0031 +0.5 Query 242: 0.3020 Query 243: 0.6541 Query 244: 0.0051 Query 245: 0.8929 Query 246: 0.1015 Query 247: 0.9909 Query 248: 0.4915 0.0 Query 249: 0.0179 Query 250: 0.0154 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Daedalus, Monolingual French, Auto, TD Run frav7 Average precision Overall statistics Recall−Precision Values (individual queries): (for 49 queries): 1.0 Query 201: 0.2962 Total number of documents Query 202: 0.6803 over all queries Query 203: 0.4764 Retrieved: 49000 Query 204: 0.8487 Relevant: 915 0.8 Query 205: 0.5378 Rel_ret: 854 Query 206: 0.4926 Query 207: 0.2742 Interpolated Recall - Query 208: 0.8875 Precision Averages: Query 209: 0.2224 at 0.00 0.7169 Query 210: 0.1389 at 0.10 0.6420 0.6 Query 211: 0.8450 at 0.20 0.5897 Query 212: 0.3678 at 0.30 0.5381 Query 213: 0.8213 at 0.40 0.4984 Precision Query 214: 0.0639 at 0.50 0.4757 Query 215: 0.1032 at 0.60 0.4553 0.4 Query 216: 0.1008 at 0.70 0.4096 Query 217: 0.4297 at 0.80 0.3665 Query 218: 0.9145 at 0.90 0.3089 Query 219: 0.3201 at 1.00 0.2378 Query 220: 0.3213 0.2 Query 221: 0.4090 Avg. prec. (non-interpolated) Query 222: 0.1157 for all rel. documents Query 223: 0.0180 0.4624 Query 224: 0.9762 Precision: Query 225: 0.0189 At 5 docs: 0.4653 0.0 Query 226: 1.0000 At 10 docs: 0.4102 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.3344 At 15 docs: 0.3660 Query 229: 0.3933 At 20 docs: 0.3184 Recall Query 230: 0.9090 At 30 docs: 0.2762 Query 231: 0.6503 At 100 docs: 0.1390 Query 232: 0.0526 At 200 docs: 0.0786 Run frav7 Query 233: 0.4718 At 500 docs: 0.0337 Comparison to median by topic Query 234: 0.2341 At 1000 docs: 0.0174 Query 235: 0.8524 +1.0 Query 236: 0.9264 R-Precision (prec. after R Query 237: 0.9119 (=num_rel) docs. retrieved): Query 238: 0.4217 Exact: 0.4294 Query 239: 0.1402 Query 240: 1.0000 Query 241: 0.0106 +0.5 Query 242: 0.3096 Query 243: 0.4582 Query 244: 0.0192 Query 245: 0.9167 Query 246: 0.2127 Query 247: 0.9263 0.0 Query 248: 0.7212 Query 249: 0.0192 Query 250: 0.0846 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Daedalus, Monolingual French, Auto, TD Run frav8 Average precision Overall statistics Recall−Precision Values (individual queries): (for 49 queries): 1.0 Query 201: 0.2918 Total number of documents Query 202: 0.6775 over all queries Query 203: 0.4442 Retrieved: 49000 Query 204: 0.8301 Relevant: 915 0.8 Query 205: 0.5314 Rel_ret: 855 Query 206: 0.4934 Query 207: 0.2752 Interpolated Recall - Query 208: 0.8875 Precision Averages: Query 209: 0.2133 at 0.00 0.7113 Query 210: 0.1376 at 0.10 0.6424 0.6 Query 211: 0.8401 at 0.20 0.5868 Query 212: 0.3650 at 0.30 0.5367 Query 213: 0.8255 at 0.40 0.4950 Precision Query 214: 0.0623 at 0.50 0.4717 Query 215: 0.1034 at 0.60 0.4454 0.4 Query 216: 0.1484 at 0.70 0.4065 Query 217: 0.4301 at 0.80 0.3656 Query 218: 0.9204 at 0.90 0.3067 Query 219: 0.3262 at 1.00 0.2371 Query 220: 0.3026 0.2 Query 221: 0.4125 Avg. prec. (non-interpolated) Query 222: 0.1063 for all rel. documents Query 223: 0.0181 0.4589 Query 224: 0.9762 Precision: Query 225: 0.0227 At 5 docs: 0.4612 0.0 Query 226: 1.0000 At 10 docs: 0.4143 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.3250 At 15 docs: 0.3578 Query 229: 0.3439 At 20 docs: 0.3194 Recall Query 230: 0.9119 At 30 docs: 0.2701 Query 231: 0.6532 At 100 docs: 0.1392 Query 232: 0.0454 At 200 docs: 0.0782 Run frav8 Query 233: 0.4762 At 500 docs: 0.0336 Comparison to median by topic Query 234: 0.1813 At 1000 docs: 0.0174 Query 235: 0.8383 +1.0 Query 236: 0.9332 R-Precision (prec. after R Query 237: 0.9119 (=num_rel) docs. retrieved): Query 238: 0.4217 Exact: 0.4301 Query 239: 0.1316 Query 240: 1.0000 Query 241: 0.0112 +0.5 Query 242: 0.3173 Query 243: 0.4492 Query 244: 0.0263 Query 245: 0.9167 Query 246: 0.2117 Query 247: 0.9263 0.0 Query 248: 0.7058 Query 249: 0.0217 Query 250: 0.0858 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Daedalus, Monolingual French, Auto, TD Run frcomb1s201 Average precision Overall statistics Recall−Precision Values (individual queries): (for 49 queries): 1.0 Query 201: 0.3191 Total number of documents Query 202: 0.6619 over all queries Query 203: 0.4885 Retrieved: 49000 Query 204: 0.8820 Relevant: 915 Query 205: 0.5701 Rel_ret: 860 0.8 Query 206: 0.4918 Query 207: 0.2588 Interpolated Recall - Query 208: 0.8875 Precision Averages: Query 209: 0.2412 at 0.00 0.7111 Query 210: 0.1207 at 0.10 0.6578 0.6 Query 211: 0.8528 at 0.20 0.6048 Query 212: 0.3843 at 0.30 0.5506 Query 213: 0.8168 at 0.40 0.4943 Precision Query 214: 0.0241 at 0.50 0.4816 Query 215: 0.0962 at 0.60 0.4513 0.4 Query 216: 0.0491 at 0.70 0.4074 Query 217: 0.4102 at 0.80 0.3704 Query 218: 0.8993 at 0.90 0.3185 Query 219: 0.3356 at 1.00 0.2459 Query 220: 0.3135 0.2 Query 221: 0.4532 Avg. prec. (non-interpolated) Query 222: 0.0840 for all rel. documents Query 223: 0.0148 0.4673 Query 224: 1.0000 Precision: Query 225: 0.0120 At 5 docs: 0.4694 0.0 Query 226: 1.0000 At 10 docs: 0.3980 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.3318 At 15 docs: 0.3592 Query 229: 0.4810 At 20 docs: 0.3245 Recall Query 230: 0.8982 At 30 docs: 0.2762 Query 231: 0.6032 At 100 docs: 0.1398 Query 232: 0.0815 At 200 docs: 0.0789 Run frcomb1s201 Query 233: 0.4456 At 500 docs: 0.0336 Comparison to median by topic Query 234: 0.4471 At 1000 docs: 0.0176 Query 235: 0.8889 +1.0 Query 236: 0.9452 R-Precision (prec. after R Query 237: 0.8985 (=num_rel) docs. retrieved): Query 238: 0.4319 Exact: 0.4288 Query 239: 0.0970 Query 240: 1.0000 Query 241: 0.0181 +0.5 Query 242: 0.2962 Query 243: 0.4337 Query 244: 0.0072 Query 245: 0.9167 Query 246: 0.2078 Query 247: 0.9430 Query 248: 0.7584 0.0 Query 249: 0.0118 Query 250: 0.0888 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Daedalus, Monolingual French, Auto, TD Run frcomb2s201 Average precision Overall statistics Recall−Precision Values (individual queries): (for 49 queries): 1.0 Query 201: 0.3240 Total number of documents Query 202: 0.6497 over all queries Query 203: 0.4755 Retrieved: 49000 Query 204: 0.8811 Relevant: 915 Query 205: 0.6005 Rel_ret: 853 0.8 Query 206: 0.4803 Query 207: 0.2537 Interpolated Recall - Query 208: 0.8875 Precision Averages: Query 209: 0.2587 at 0.00 0.7100 Query 210: 0.1185 at 0.10 0.6501 0.6 Query 211: 0.8514 at 0.20 0.6083 Query 212: 0.3702 at 0.30 0.5446 Query 213: 0.8174 at 0.40 0.4993 Precision Query 214: 0.0225 at 0.50 0.4807 Query 215: 0.0961 at 0.60 0.4511 0.4 Query 216: 0.0371 at 0.70 0.4048 Query 217: 0.4098 at 0.80 0.3702 Query 218: 0.9046 at 0.90 0.3216 Query 219: 0.3267 at 1.00 0.2477 Query 220: 0.2857 0.2 Query 221: 0.4442 Avg. prec. (non-interpolated) Query 222: 0.1153 for all rel. documents Query 223: 0.0133 0.4670 Query 224: 1.0000 Precision: Query 225: 0.0123 At 5 docs: 0.4735 0.0 Query 226: 1.0000 At 10 docs: 0.4041 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.3381 At 15 docs: 0.3565 Query 229: 0.4628 At 20 docs: 0.3214 Recall Query 230: 0.8980 At 30 docs: 0.2755 Query 231: 0.6722 At 100 docs: 0.1392 Query 232: 0.0692 At 200 docs: 0.0785 Run frcomb2s201 Query 233: 0.4427 At 500 docs: 0.0333 Comparison to median by topic Query 234: 0.5263 At 1000 docs: 0.0174 Query 235: 0.8965 +1.0 Query 236: 0.9387 R-Precision (prec. after R Query 237: 0.9119 (=num_rel) docs. retrieved): Query 238: 0.4264 Exact: 0.4332 Query 239: 0.0941 Query 240: 1.0000 Query 241: 0.0046 +0.5 Query 242: 0.2406 Query 243: 0.4284 Query 244: 0.0081 Query 245: 0.9167 Query 246: 0.2042 Query 247: 0.9188 Query 248: 0.7449 0.0 Query 249: 0.0135 Query 250: 0.0913 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Hummingbird, Monolingual French, Auto, T Run humFR04t Average precision Overall statistics Recall−Precision Values (individual queries): (for 49 queries): 1.0 Query 201: 0.0713 Total number of documents Query 202: 0.5722 over all queries Query 203: 0.3347 Retrieved: 44387 Query 204: 0.7272 Relevant: 915 Query 205: 0.6427 Rel_ret: 852 0.8 Query 206: 0.1424 Query 207: 0.3462 Interpolated Recall - Query 208: 0.2710 Precision Averages: Query 209: 0.1582 at 0.00 0.6733 Query 210: 0.2957 at 0.10 0.6107 0.6 Query 211: 0.8351 at 0.20 0.5661 Query 212: 0.3985 at 0.30 0.5088 Query 213: 0.7298 at 0.40 0.4598 Precision Query 214: 0.0489 at 0.50 0.4376 Query 215: 0.0842 at 0.60 0.4058 0.4 Query 216: 0.0442 at 0.70 0.3676 Query 217: 0.4419 at 0.80 0.3239 Query 218: 0.9043 at 0.90 0.2669 Query 219: 0.3182 at 1.00 0.1827 Query 220: 0.3026 0.2 Query 221: 0.3113 Avg. prec. (non-interpolated) Query 222: 0.0151 for all rel. documents Query 223: 0.0084 0.4205 Query 224: 0.9333 Precision: Query 225: 0.0476 At 5 docs: 0.4408 0.0 Query 226: 1.0000 At 10 docs: 0.3735 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.2162 At 15 docs: 0.3333 Query 229: 0.4729 At 20 docs: 0.3122 Recall Query 230: 0.9058 At 30 docs: 0.2694 Query 231: 0.6967 At 100 docs: 0.1310 Query 232: 0.2552 At 200 docs: 0.0760 Run humFR04t Query 233: 0.4559 At 500 docs: 0.0330 Comparison to median by topic Query 234: 0.4859 At 1000 docs: 0.0174 Query 235: 0.8306 +1.0 Query 236: 1.0000 R-Precision (prec. after R Query 237: 0.9066 (=num_rel) docs. retrieved): Query 238: 0.2017 Exact: 0.3912 Query 239: 0.0445 Query 240: 1.0000 Query 241: 0.1446 +0.5 Query 242: 0.1153 Query 243: 0.4949 Query 244: 0.0000 Query 245: 0.7519 Query 246: 0.0657 Query 247: 0.6979 Query 248: 0.7981 0.0 Query 249: 0.0036 Query 250: 0.0752 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Hummingbird, Monolingual French, Auto, TD Run humFR04td Average precision Overall statistics Recall−Precision Values (individual queries): (for 49 queries): 1.0 Query 201: 0.1954 Total number of documents Query 202: 0.6385 over all queries Query 203: 0.4272 Retrieved: 49000 Query 204: 0.8551 Relevant: 915 Query 205: 0.5867 Rel_ret: 852 0.8 Query 206: 0.4716 Query 207: 0.3462 Interpolated Recall - Query 208: 0.8875 Precision Averages: Query 209: 0.3366 at 0.00 0.7007 Query 210: 0.1511 at 0.10 0.6527 0.6 Query 211: 0.8430 at 0.20 0.6249 Query 212: 0.3471 at 0.30 0.5519 Query 213: 0.8032 at 0.40 0.4915 Precision Query 214: 0.0843 at 0.50 0.4737 Query 215: 0.0707 at 0.60 0.4479 0.4 Query 216: 0.0829 at 0.70 0.4049 Query 217: 0.4416 at 0.80 0.3479 Query 218: 0.9049 at 0.90 0.2960 Query 219: 0.2556 at 1.00 0.2210 Query 220: 0.2970 0.2 Query 221: 0.4568 Avg. prec. (non-interpolated) Query 222: 0.0876 for all rel. documents Query 223: 0.0160 0.4584 Query 224: 1.0000 Precision: Query 225: 0.0303 At 5 docs: 0.4816 0.0 Query 226: 1.0000 At 10 docs: 0.3980 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.3060 At 15 docs: 0.3442 Query 229: 0.4729 At 20 docs: 0.3184 Recall Query 230: 0.9197 At 30 docs: 0.2748 Query 231: 0.5042 At 100 docs: 0.1363 Query 232: 0.0264 At 200 docs: 0.0777 Run humFR04td Query 233: 0.4252 At 500 docs: 0.0332 Comparison to median by topic Query 234: 0.4133 At 1000 docs: 0.0174 Query 235: 0.8445 +1.0 Query 236: 0.8376 R-Precision (prec. after R Query 237: 0.9110 (=num_rel) docs. retrieved): Query 238: 0.4632 Exact: 0.4249 Query 239: 0.1110 Query 240: 1.0000 Query 241: 0.0304 +0.5 Query 242: 0.2982 Query 243: 0.5567 Query 244: 0.0109 Query 245: 0.7575 Query 246: 0.1213 Query 247: 0.9622 Query 248: 0.7219 0.0 Query 249: 0.0233 Query 250: 0.1282 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Hummingbird, Monolingual French, Auto, TD Run humFR04tde Average precision Overall statistics Recall−Precision Values (individual queries): (for 49 queries): 1.0 Query 201: 0.2486 Total number of documents Query 202: 0.6488 over all queries Query 203: 0.5525 Retrieved: 49000 Query 204: 0.7257 Relevant: 915 Query 205: 0.5881 Rel_ret: 853 0.8 Query 206: 0.6171 Query 207: 0.3805 Interpolated Recall - Query 208: 0.8875 Precision Averages: Query 209: 0.3544 at 0.00 0.7107 Query 210: 0.1003 at 0.10 0.6752 0.6 Query 211: 0.8953 at 0.20 0.6498 Query 212: 0.3561 at 0.30 0.5964 Query 213: 0.8579 at 0.40 0.5435 Precision Query 214: 0.1441 at 0.50 0.5238 Query 215: 0.0702 at 0.60 0.4851 0.4 Query 216: 0.0597 at 0.70 0.4356 Query 217: 0.4448 at 0.80 0.3856 Query 218: 0.9163 at 0.90 0.3406 Query 219: 0.5798 at 1.00 0.2659 Query 220: 0.2007 0.2 Query 221: 0.5144 Avg. prec. (non-interpolated) Query 222: 0.0949 for all rel. documents Query 223: 0.0195 0.4926 Query 224: 1.0000 Precision: Query 225: 0.0189 At 5 docs: 0.5143 0.0 Query 226: 1.0000 At 10 docs: 0.4306 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.5017 At 15 docs: 0.3810 Query 229: 0.4932 At 20 docs: 0.3520 Recall Query 230: 0.9122 At 30 docs: 0.2966 Query 231: 0.7683 At 100 docs: 0.1437 Query 232: 0.0454 At 200 docs: 0.0794 Run humFR04tde Query 233: 0.3719 At 500 docs: 0.0335 Comparison to median by topic Query 234: 0.4474 At 1000 docs: 0.0174 Query 235: 0.8524 +1.0 Query 236: 0.9332 R-Precision (prec. after R Query 237: 0.9000 (=num_rel) docs. retrieved): Query 238: 0.4550 Exact: 0.4583 Query 239: 0.1357 Query 240: 1.0000 Query 241: 0.0648 +0.5 Query 242: 0.1892 Query 243: 0.6489 Query 244: 0.0076 Query 245: 0.7692 Query 246: 0.2176 Query 247: 0.9909 Query 248: 0.8487 0.0 Query 249: 0.0189 Query 250: 0.2879 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Padua, Monolingual French, Auto, TD Run IMSMFRN Average precision Overall statistics Recall−Precision Values (individual queries): (for 49 queries): 1.0 Query 201: 0.1270 Total number of documents Query 202: 0.5620 over all queries Query 203: 0.3357 Retrieved: 49000 Query 204: 0.5992 Relevant: 915 0.8 Query 205: 0.2401 Rel_ret: 763 Query 206: 0.3156 Query 207: 0.1076 Interpolated Recall - Query 208: 0.6792 Precision Averages: Query 209: 0.1461 at 0.00 0.6171 Query 210: 0.3041 at 0.10 0.5575 0.6 Query 211: 0.7411 at 0.20 0.5174 Query 212: 0.2922 at 0.30 0.4625 Query 213: 0.5040 at 0.40 0.4325 Precision Query 214: 0.0617 at 0.50 0.4072 Query 215: 0.0608 at 0.60 0.3668 0.4 Query 216: 0.2978 at 0.70 0.3341 Query 217: 0.4868 at 0.80 0.2939 Query 218: 0.9117 at 0.90 0.2490 Query 219: 0.0340 at 1.00 0.1992 Query 220: 0.1023 0.2 Query 221: 0.2953 Avg. prec. (non-interpolated) Query 222: 0.0261 for all rel. documents Query 223: 0.0174 0.3864 Query 224: 0.9762 Precision: Query 225: 0.0769 At 5 docs: 0.4245 0.0 Query 226: 1.0000 At 10 docs: 0.3612 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.3001 At 15 docs: 0.3184 Query 229: 0.0472 At 20 docs: 0.2755 Recall Query 230: 0.9450 At 30 docs: 0.2272 Query 231: 0.3979 At 100 docs: 0.1180 Query 232: 0.0050 At 200 docs: 0.0688 Run IMSMFRN Query 233: 0.3919 At 500 docs: 0.0292 Comparison to median by topic Query 234: 0.1136 At 1000 docs: 0.0156 Query 235: 0.6494 +1.0 Query 236: 1.0000 R-Precision (prec. after R Query 237: 0.9643 (=num_rel) docs. retrieved): Query 238: 0.3116 Exact: 0.3864 Query 239: 0.0518 Query 240: 1.0000 Query 241: 0.0013 +0.5 Query 242: 0.2470 Query 243: 0.4881 Query 244: 0.0909 Query 245: 0.7628 Query 246: 0.1071 Query 247: 0.9809 0.0 Query 248: 0.6822 Query 249: 0.0323 Query 250: 0.0614 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Padua, Monolingual French, Auto, TD Run IMSMFRP Average precision Overall statistics Recall−Precision Values (individual queries): (for 49 queries): 1.0 Query 201: 0.1309 Total number of documents Query 202: 0.5888 over all queries Query 203: 0.4272 Retrieved: 49000 Query 204: 0.8135 Relevant: 915 0.8 Query 205: 0.4190 Rel_ret: 832 Query 206: 0.3117 Query 207: 0.2397 Interpolated Recall - Query 208: 0.6792 Precision Averages: Query 209: 0.3472 at 0.00 0.6914 Query 210: 0.3580 at 0.10 0.6128 0.6 Query 211: 0.7624 at 0.20 0.5763 Query 212: 0.2642 at 0.30 0.5166 Query 213: 0.7121 at 0.40 0.4469 Precision Query 214: 0.0758 at 0.50 0.4218 Query 215: 0.0551 at 0.60 0.4035 0.4 Query 216: 0.0363 at 0.70 0.3711 Query 217: 0.5322 at 0.80 0.3332 Query 218: 0.9072 at 0.90 0.2855 Query 219: 0.2271 at 1.00 0.2261 Query 220: 0.1439 0.2 Query 221: 0.4128 Avg. prec. (non-interpolated) Query 222: 0.0366 for all rel. documents Query 223: 0.0187 0.4253 Query 224: 0.9762 Precision: Query 225: 0.0227 At 5 docs: 0.4367 0.0 Query 226: 1.0000 At 10 docs: 0.3673 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.3469 At 15 docs: 0.3170 Query 229: 0.3754 At 20 docs: 0.2918 Recall Query 230: 0.8980 At 30 docs: 0.2510 Query 231: 0.3663 At 100 docs: 0.1300 Query 232: 0.0236 At 200 docs: 0.0744 Run IMSMFRP Query 233: 0.2654 At 500 docs: 0.0322 Comparison to median by topic Query 234: 0.3596 At 1000 docs: 0.0170 Query 235: 0.6829 +1.0 Query 236: 1.0000 R-Precision (prec. after R Query 237: 0.9610 (=num_rel) docs. retrieved): Query 238: 0.3186 Exact: 0.3871 Query 239: 0.0814 Query 240: 1.0000 Query 241: 0.0112 +0.5 Query 242: 0.1084 Query 243: 0.5930 Query 244: 0.0185 Query 245: 0.9167 Query 246: 0.1129 Query 247: 0.9769 0.0 Query 248: 0.7441 Query 249: 0.0303 Query 250: 0.1524 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Padua, Monolingual French, Auto, TD Run IMSMFRPqe Average precision Overall statistics (individual queries): (for 49 queries): Recall−Precision Values 1.0 Query 201: 0.1967 Total number of documents Query 202: 0.6728 over all queries Query 203: 0.4818 Retrieved: 49000 Query 204: 0.3041 Relevant: 915 Query 205: 0.3174 Rel_ret: 707 0.8 Query 206: 0.5225 Query 207: 0.0236 Interpolated Recall - Query 208: 0.1585 Precision Averages: Query 209: 0.1047 at 0.00 0.6661 Query 210: 0.0619 at 0.10 0.6091 0.6 Query 211: 0.6980 at 0.20 0.5422 Query 212: 0.0447 at 0.30 0.4847 Query 213: 0.5635 at 0.40 0.4503 Precision Query 214: 0.3581 at 0.50 0.4094 Query 215: 0.0123 at 0.60 0.3585 0.4 Query 216: 0.0007 at 0.70 0.2530 Query 217: 0.2046 at 0.80 0.2102 Query 218: 0.8002 at 0.90 0.1609 Query 219: 0.7533 at 1.00 0.1323 Query 220: 0.0004 0.2 Query 221: 0.5411 Avg. prec. (non-interpolated) Query 222: 0.0006 for all rel. documents Query 223: 0.0036 0.3775 Query 224: 0.9762 Precision: Query 225: 0.5000 At 5 docs: 0.4694 0.0 Query 226: 1.0000 At 10 docs: 0.3735 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.6309 At 15 docs: 0.2980 Query 229: 0.1582 At 20 docs: 0.2541 Recall Query 230: 0.6191 At 30 docs: 0.2082 Query 231: 0.2061 At 100 docs: 0.0984 Query 232: 0.0277 At 200 docs: 0.0562 Run IMSMFRPqe Query 233: 0.0927 At 500 docs: 0.0264 Query 234: 0.6667 At 1000 docs: 0.0144 Comparison to median by topic Query 235: 0.6727 +1.0 Query 236: 1.0000 R-Precision (prec. after R Query 237: 0.5632 (=num_rel) docs. retrieved): Query 238: 0.2141 Exact: 0.3558 Query 239: 0.0534 Query 240: 1.0000 Query 241: 0.0027 +0.5 Query 242: 0.1666 Query 243: 0.1586 Query 244: 0.5000 Query 245: 0.7525 Query 246: 0.0864 Query 247: 0.8817 Query 248: 0.2623 0.0 Query 249: 0.0072 Query 250: 0.4751 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Padua, Monolingual French, Auto, TD Run IMSMFRUd65 Average precision Overall statistics Recall−Precision Values (individual queries): (for 49 queries): 1.0 Query 201: 0.1479 Total number of documents Query 202: 0.5741 over all queries Query 203: 0.3023 Retrieved: 49000 Query 204: 0.7672 Relevant: 915 Query 205: 0.3778 Rel_ret: 809 0.8 Query 206: 0.3302 Query 207: 0.1446 Interpolated Recall - Query 208: 0.6792 Precision Averages: Query 209: 0.2227 at 0.00 0.6857 Query 210: 0.5635 at 0.10 0.5950 0.6 Query 211: 0.7282 at 0.20 0.5406 Query 212: 0.2376 at 0.30 0.4922 Query 213: 0.7210 at 0.40 0.4501 Precision Query 214: 0.0782 at 0.50 0.4228 Query 215: 0.0662 at 0.60 0.3938 0.4 Query 216: 0.0455 at 0.70 0.3567 Query 217: 0.5154 at 0.80 0.3228 Query 218: 0.9205 at 0.90 0.2788 Query 219: 0.1435 at 1.00 0.2240 Query 220: 0.2391 0.2 Query 221: 0.3345 Avg. prec. (non-interpolated) Query 222: 0.0230 for all rel. documents Query 223: 0.0201 0.4153 Query 224: 0.9762 Precision: Query 225: 0.0357 At 5 docs: 0.4490 0.0 Query 226: 1.0000 At 10 docs: 0.3653 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.3394 At 15 docs: 0.3252 Query 229: 0.3675 At 20 docs: 0.2959 Recall Query 230: 0.9332 At 30 docs: 0.2524 Query 231: 0.3194 At 100 docs: 0.1276 Query 232: 0.0183 At 200 docs: 0.0731 Run IMSMFRUd65 Query 233: 0.4027 At 500 docs: 0.0316 Comparison to median by topic Query 234: 0.0921 At 1000 docs: 0.0165 Query 235: 0.6688 +1.0 Query 236: 1.0000 R-Precision (prec. after R Query 237: 0.9520 (=num_rel) docs. retrieved): Query 238: 0.2888 Exact: 0.3955 Query 239: 0.1049 Query 240: 1.0000 Query 241: 0.0017 +0.5 Query 242: 0.1240 Query 243: 0.5484 Query 244: 0.0244 Query 245: 0.8929 Query 246: 0.1364 Query 247: 0.9669 Query 248: 0.7788 0.0 Query 249: 0.0400 Query 250: 0.1534 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Alicante, Monolingual French, Auto, TD Run IRn−MFr−Dexp Average precision Overall statistics (individual queries): (for 49 queries): Recall−Precision Values 1.0 Query 201: 0.1282 Total number of documents Query 202: 0.5485 over all queries Query 203: 0.5513 Retrieved: 49000 Query 204: 0.7944 Relevant: 915 Query 205: 0.5386 Rel_ret: 842 0.8 Query 206: 0.2259 Query 207: 0.2887 Interpolated Recall - Query 208: 0.5208 Precision Averages: Query 209: 0.1941 at 0.00 0.6517 Query 210: 0.1274 at 0.10 0.5885 0.6 Query 211: 0.7975 at 0.20 0.5353 Query 212: 0.3102 at 0.30 0.4899 Query 213: 0.7000 at 0.40 0.4585 Precision Query 214: 0.0373 at 0.50 0.4355 Query 215: 0.0781 at 0.60 0.4141 0.4 Query 216: 0.0078 at 0.70 0.3734 Query 217: 0.3079 at 0.80 0.3423 Query 218: 0.8935 at 0.90 0.2942 Query 219: 0.0358 at 1.00 0.2278 Query 220: 0.0222 0.2 Query 221: 0.6081 Avg. prec. (non-interpolated) Query 222: 0.0192 for all rel. documents Query 223: 0.0125 0.4217 Query 224: 1.0000 Precision: Query 225: 0.0175 At 5 docs: 0.4163 0.0 Query 226: 1.0000 At 10 docs: 0.3612 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.3878 At 15 docs: 0.3211 Query 229: 0.4508 At 20 docs: 0.3010 Recall Query 230: 0.8922 At 30 docs: 0.2537 Query 231: 0.3909 At 100 docs: 0.1339 Query 232: 0.0148 At 200 docs: 0.0763 Run IRn−MFr−Dexp Query 233: 0.4311 At 500 docs: 0.0331 Query 234: 0.2831 At 1000 docs: 0.0172 Comparison to median by topic Query 235: 0.7774 +1.0 Query 236: 0.9698 R-Precision (prec. after R Query 237: 0.8808 (=num_rel) docs. retrieved): Query 238: 0.3608 Exact: 0.3969 Query 239: 0.1710 Query 240: 1.0000 Query 241: 0.0290 +0.5 Query 242: 0.3125 Query 243: 0.4112 Query 244: 0.0100 Query 245: 1.0000 Query 246: 0.0944 Query 247: 0.9714 Query 248: 0.6636 0.0 Query 249: 0.3333 Query 250: 0.0628 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Alicante, Monolingual French, Auto, TD Run IRn−MFr−nexp Average precision Overall statistics (individual queries): (for 49 queries): Recall−Precision Values 1.0 Query 201: 0.1340 Total number of documents Query 202: 0.6507 over all queries Query 203: 0.4620 Retrieved: 49000 Query 204: 0.9036 Relevant: 915 Query 205: 0.6249 Rel_ret: 829 0.8 Query 206: 0.3072 Query 207: 0.3100 Interpolated Recall - Query 208: 0.4891 Precision Averages: Query 209: 0.0419 at 0.00 0.6797 Query 210: 0.4000 at 0.10 0.6192 0.6 Query 211: 0.7514 at 0.20 0.5218 Query 212: 0.3340 at 0.30 0.4663 Query 213: 0.6733 at 0.40 0.4356 Precision Query 214: 0.0448 at 0.50 0.4251 Query 215: 0.0650 at 0.60 0.3885 0.4 Query 216: 0.0131 at 0.70 0.3546 Query 217: 0.3446 at 0.80 0.3228 Query 218: 0.8962 at 0.90 0.2661 Query 219: 0.2234 at 1.00 0.1928 Query 220: 0.0187 0.2 Query 221: 0.3824 Avg. prec. (non-interpolated) Query 222: 0.0299 for all rel. documents Query 223: 0.0046 0.4086 Query 224: 0.9762 Precision: Query 225: 0.0130 At 5 docs: 0.4531 0.0 Query 226: 0.5000 At 10 docs: 0.3612 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.2559 At 15 docs: 0.3143 Query 229: 0.3752 At 20 docs: 0.2929 Recall Query 230: 0.9037 At 30 docs: 0.2497 Query 231: 0.3073 At 100 docs: 0.1308 Query 232: 0.0170 At 200 docs: 0.0757 Run IRn−MFr−nexp Query 233: 0.3286 At 500 docs: 0.0324 Query 234: 0.2353 At 1000 docs: 0.0169 Comparison to median by topic Query 235: 0.7519 +1.0 Query 236: 0.8029 R-Precision (prec. after R Query 237: 0.9162 (=num_rel) docs. retrieved): Query 238: 0.3491 Exact: 0.3941 Query 239: 0.2069 Query 240: 1.0000 Query 241: 0.0371 +0.5 Query 242: 0.3400 Query 243: 0.4302 Query 244: 0.0250 Query 245: 1.0000 Query 246: 0.1156 Query 247: 0.9556 Query 248: 0.6852 0.0 Query 249: 0.2500 Query 250: 0.1386 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Alicante, Monolingual French, Auto, TD Run IRn−MFr−Pexp Average precision Overall statistics (individual queries): (for 49 queries): Recall−Precision Values 1.0 Query 201: 0.1282 Total number of documents Query 202: 0.5485 over all queries Query 203: 0.5513 Retrieved: 49000 Query 204: 0.7944 Relevant: 915 Query 205: 0.5386 Rel_ret: 836 0.8 Query 206: 0.2259 Query 207: 0.4075 Interpolated Recall - Query 208: 0.5208 Precision Averages: Query 209: 0.1767 at 0.00 0.6733 Query 210: 0.1274 at 0.10 0.6147 0.6 Query 211: 0.7975 at 0.20 0.5331 Query 212: 0.3288 at 0.30 0.4944 Query 213: 0.7046 at 0.40 0.4558 Precision Query 214: 0.0401 at 0.50 0.4347 Query 215: 0.0708 at 0.60 0.4152 0.4 Query 216: 0.0079 at 0.70 0.3777 Query 217: 0.3079 at 0.80 0.3442 Query 218: 0.8935 at 0.90 0.3026 Query 219: 0.0248 at 1.00 0.2281 Query 220: 0.0107 0.2 Query 221: 0.6081 Avg. prec. (non-interpolated) Query 222: 0.0274 for all rel. documents Query 223: 0.0118 0.4251 Query 224: 1.0000 Precision: Query 225: 0.0175 At 5 docs: 0.4204 0.0 Query 226: 1.0000 At 10 docs: 0.3694 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.3913 At 15 docs: 0.3211 Query 229: 0.4508 At 20 docs: 0.2990 Recall Query 230: 0.9060 At 30 docs: 0.2531 Query 231: 0.3909 At 100 docs: 0.1333 Query 232: 0.0102 At 200 docs: 0.0759 Run IRn−MFr−Pexp Query 233: 0.4537 At 500 docs: 0.0331 Query 234: 0.4128 At 1000 docs: 0.0171 Comparison to median by topic Query 235: 0.6826 +1.0 Query 236: 0.9698 R-Precision (prec. after R Query 237: 0.8808 (=num_rel) docs. retrieved): Query 238: 0.3608 Exact: 0.3978 Query 239: 0.1710 Query 240: 1.0000 Query 241: 0.0338 +0.5 Query 242: 0.3125 Query 243: 0.4112 Query 244: 0.0097 Query 245: 1.0000 Query 246: 0.0944 Query 247: 0.9556 Query 248: 0.6636 0.0 Query 249: 0.3333 Query 250: 0.0648 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number ILTG, Monolingual French, Auto, TDN Run ltrcmonofr1 Average precision Overall statistics Recall−Precision Values (individual queries): (for 49 queries): 1.0 Query 201: 0.2541 Total number of documents Query 202: 0.5812 over all queries Query 203: 0.4195 Retrieved: 49000 Query 204: 0.3014 Relevant: 915 Query 205: 0.4249 Rel_ret: 703 0.8 Query 206: 0.1685 Query 207: 0.1137 Interpolated Recall - Query 208: 0.4863 Precision Averages: Query 209: 0.0700 at 0.00 0.5947 Query 210: 0.1352 at 0.10 0.5530 0.6 Query 211: 0.7753 at 0.20 0.4798 Query 212: 0.0665 at 0.30 0.4101 Query 213: 0.4411 at 0.40 0.3710 Precision Query 214: 0.1350 at 0.50 0.3452 Query 215: 0.0982 at 0.60 0.3220 0.4 Query 216: 0.0081 at 0.70 0.2878 Query 217: 0.1529 at 0.80 0.2420 Query 218: 0.8491 at 0.90 0.1802 Query 219: 0.1638 at 1.00 0.1280 Query 220: 0.0543 0.2 Query 221: 0.4384 Avg. prec. (non-interpolated) Query 222: 0.0682 for all rel. documents Query 223: 0.0041 0.3434 Query 224: 1.0000 Precision: Query 225: 0.2000 At 5 docs: 0.3959 0.0 Query 226: 1.0000 At 10 docs: 0.3265 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.1160 At 15 docs: 0.2871 Query 229: 0.0030 At 20 docs: 0.2571 Recall Query 230: 0.9097 At 30 docs: 0.2265 Query 231: 0.3999 At 100 docs: 0.1061 Query 232: 0.0000 At 200 docs: 0.0598 Run ltrcmonofr1 Query 233: 0.5745 At 500 docs: 0.0268 Comparison to median by topic Query 234: 0.0081 At 1000 docs: 0.0143 Query 235: 0.1362 +1.0 Query 236: 1.0000 R-Precision (prec. after R Query 237: 0.5511 (=num_rel) docs. retrieved): Query 238: 0.2926 Exact: 0.3489 Query 239: 0.0156 Query 240: 1.0000 Query 241: 0.0005 +0.5 Query 242: 0.5250 Query 243: 0.3601 Query 244: 0.0024 Query 245: 0.7500 Query 246: 0.1786 Query 247: 0.7877 Query 248: 0.6850 0.0 Query 249: 0.1111 Query 250: 0.0092 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number ILTG, Monolingual French, Auto, TDN Run ltrcmonofr2 Average precision Overall statistics Recall−Precision Values (individual queries): (for 49 queries): 1.0 Query 201: 0.2156 Total number of documents Query 202: 0.5472 over all queries Query 203: 0.3717 Retrieved: 49000 Query 204: 0.1194 Relevant: 915 Query 205: 0.3135 Rel_ret: 665 0.8 Query 206: 0.2683 Query 207: 0.1629 Interpolated Recall - Query 208: 0.6042 Precision Averages: Query 209: 0.0627 at 0.00 0.5713 Query 210: 0.0775 at 0.10 0.4816 0.6 Query 211: 0.8229 at 0.20 0.4099 Query 212: 0.1257 at 0.30 0.3679 Query 213: 0.1991 at 0.40 0.3336 Precision Query 214: 0.0362 at 0.50 0.2970 Query 215: 0.0935 at 0.60 0.2528 0.4 Query 216: 0.1269 at 0.70 0.2028 Query 217: 0.0523 at 0.80 0.1553 Query 218: 0.6750 at 0.90 0.0959 Query 219: 0.0736 at 1.00 0.0160 Query 220: 0.0634 0.2 Query 221: 0.4942 Avg. prec. (non-interpolated) Query 222: 0.1003 for all rel. documents Query 223: 0.0059 0.2754 Query 224: 0.7708 Precision: Query 225: 0.0196 At 5 docs: 0.3429 0.0 Query 226: 0.0000 At 10 docs: 0.2837 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.1179 At 15 docs: 0.2544 Query 229: 0.0148 At 20 docs: 0.2296 Recall Query 230: 0.8836 At 30 docs: 0.2014 Query 231: 0.5306 At 100 docs: 0.0990 Query 232: 0.0011 At 200 docs: 0.0562 Run ltrcmonofr2 Query 233: 0.5457 At 500 docs: 0.0255 Comparison to median by topic Query 234: 0.0004 At 1000 docs: 0.0136 Query 235: 0.1712 +1.0 Query 236: 0.8818 R-Precision (prec. after R Query 237: 0.4151 (=num_rel) docs. retrieved): Query 238: 0.4181 Exact: 0.2770 Query 239: 0.0296 Query 240: 0.0000 Query 241: 0.0011 +0.5 Query 242: 0.7220 Query 243: 0.5581 Query 244: 0.0000 Query 245: 0.5112 Query 246: 0.2475 Query 247: 0.5116 Query 248: 0.4474 0.0 Query 249: 0.0204 Query 250: 0.0626 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number ILTG, Monolingual French, Auto, TDN Run ltrcmonofr3 Average precision Overall statistics Recall−Precision Values (individual queries): (for 49 queries): 1.0 Query 201: 0.0969 Total number of documents Query 202: 0.5940 over all queries Query 203: 0.2202 Retrieved: 49000 Query 204: 0.3250 Relevant: 915 Query 205: 0.3066 Rel_ret: 728 0.8 Query 206: 0.2581 Query 207: 0.2196 Interpolated Recall - Query 208: 0.8875 Precision Averages: Query 209: 0.0994 at 0.00 0.5698 Query 210: 0.0334 at 0.10 0.5205 0.6 Query 211: 0.6302 at 0.20 0.4783 Query 212: 0.2592 at 0.30 0.4130 Query 213: 0.5195 at 0.40 0.3717 Precision Query 214: 0.1331 at 0.50 0.3351 Query 215: 0.2486 at 0.60 0.3161 0.4 Query 216: 0.0104 at 0.70 0.2969 Query 217: 0.0124 at 0.80 0.2358 Query 218: 0.8625 at 0.90 0.2078 Query 219: 0.3355 at 1.00 0.1646 Query 220: 0.0288 0.2 Query 221: 0.4614 Avg. prec. (non-interpolated) Query 222: 0.0877 for all rel. documents Query 223: 0.0696 0.3365 Query 224: 0.8734 Precision: Query 225: 0.1667 At 5 docs: 0.3306 0.0 Query 226: 1.0000 At 10 docs: 0.3143 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.1762 At 15 docs: 0.2830 Query 229: 0.0023 At 20 docs: 0.2510 Recall Query 230: 0.8379 At 30 docs: 0.2143 Query 231: 0.0135 At 100 docs: 0.1061 Query 232: 0.0086 At 200 docs: 0.0649 Run ltrcmonofr3 Query 233: 0.5777 At 500 docs: 0.0278 Comparison to median by topic Query 234: 0.0040 At 1000 docs: 0.0149 Query 235: 0.3600 +1.0 Query 236: 1.0000 R-Precision (prec. after R Query 237: 0.6760 (=num_rel) docs. retrieved): Query 238: 0.3324 Exact: 0.3242 Query 239: 0.0231 Query 240: 1.0000 Query 241: 0.0004 +0.5 Query 242: 0.4750 Query 243: 0.4344 Query 244: 0.0040 Query 245: 0.7500 Query 246: 0.0744 Query 247: 0.1858 Query 248: 0.6816 0.0 Query 249: 0.0833 Query 250: 0.0493 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number ILTG, Monolingual French, Auto, TDN Run ltrcmonofr4 Average precision Overall statistics Recall−Precision Values (individual queries): (for 49 queries): 1.0 Query 201: 0.0166 Total number of documents Query 202: 0.6231 over all queries Query 203: 0.1952 Retrieved: 49000 Query 204: 0.2924 Relevant: 915 Query 205: 0.2051 Rel_ret: 635 0.8 Query 206: 0.2920 Query 207: 0.1881 Interpolated Recall - Query 208: 0.8875 Precision Averages: Query 209: 0.1242 at 0.00 0.4977 Query 210: 0.0310 at 0.10 0.4527 0.6 Query 211: 0.6302 at 0.20 0.4159 Query 212: 0.1586 at 0.30 0.3666 Query 213: 0.0120 at 0.40 0.3147 Precision Query 214: 0.2484 at 0.50 0.2826 Query 215: 0.1399 at 0.60 0.2598 0.4 Query 216: 0.0089 at 0.70 0.2382 Query 217: 0.0086 at 0.80 0.1989 Query 218: 0.8801 at 0.90 0.1665 Query 219: 0.4690 at 1.00 0.1331 Query 220: 0.0157 0.2 Query 221: 0.4774 Avg. prec. (non-interpolated) Query 222: 0.0877 for all rel. documents Query 223: 0.0696 0.2865 Query 224: 0.9333 Precision: Query 225: 0.1667 At 5 docs: 0.3224 0.0 Query 226: 0.0104 At 10 docs: 0.2939 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.1950 At 15 docs: 0.2639 Query 229: 0.0012 At 20 docs: 0.2347 Recall Query 230: 0.8379 At 30 docs: 0.2027 Query 231: 0.0135 At 100 docs: 0.0916 Query 232: 0.1046 At 200 docs: 0.0586 Run ltrcmonofr4 Query 233: 0.4646 At 500 docs: 0.0249 Comparison to median by topic Query 234: 0.0000 At 1000 docs: 0.0130 Query 235: 0.3064 +1.0 Query 236: 1.0000 R-Precision (prec. after R Query 237: 0.6760 (=num_rel) docs. retrieved): Query 238: 0.3039 Exact: 0.2793 Query 239: 0.0238 Query 240: 0.5000 Query 241: 0.0000 +0.5 Query 242: 0.2767 Query 243: 0.3667 Query 244: 0.0044 Query 245: 0.7500 Query 246: 0.0755 Query 247: 0.1987 Query 248: 0.7235 0.0 Query 249: 0.0400 Query 250: 0.0041 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number NII Group, Monolingual French, Auto, TD Run NiiFF01 Average precision Overall statistics Recall−Precision Values (individual queries): (for 49 queries): 1.0 Query 201: 0.3699 Total number of documents Query 202: 0.6254 over all queries Query 203: 0.4625 Retrieved: 49000 Query 204: 0.8509 Relevant: 915 Query 205: 0.5013 Rel_ret: 837 0.8 Query 206: 0.3215 Query 207: 0.3452 Interpolated Recall - Query 208: 0.5191 Precision Averages: Query 209: 0.2032 at 0.00 0.5734 Query 210: 0.0592 at 0.10 0.5452 0.6 Query 211: 0.8503 at 0.20 0.5041 Query 212: 0.4620 at 0.30 0.4645 Query 213: 0.8065 at 0.40 0.4294 Precision Query 214: 0.0651 at 0.50 0.4163 Query 215: 0.0005 at 0.60 0.3922 0.4 Query 216: 0.0039 at 0.70 0.3609 Query 217: 0.5449 at 0.80 0.3100 Query 218: 0.9356 at 0.90 0.2635 Query 219: 0.0141 at 1.00 0.1886 Query 220: 0.0027 0.2 Query 221: 0.6226 Avg. prec. (non-interpolated) Query 222: 0.0427 for all rel. documents Query 223: 0.0192 0.3944 Query 224: 1.0000 Precision: Query 225: 0.0025 At 5 docs: 0.4204 0.0 Query 226: 0.1667 At 10 docs: 0.3429 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.0004 At 15 docs: 0.3143 Query 229: 0.3770 At 20 docs: 0.2990 Recall Query 230: 0.8521 At 30 docs: 0.2619 Query 231: 0.4975 At 100 docs: 0.1341 Query 232: 0.0656 At 200 docs: 0.0751 Run NiiFF01 Query 233: 0.4837 At 500 docs: 0.0326 Comparison to median by topic Query 234: 0.0258 At 1000 docs: 0.0171 Query 235: 0.6556 +1.0 Query 236: 0.9206 R-Precision (prec. after R Query 237: 0.8844 (=num_rel) docs. retrieved): Query 238: 0.3467 Exact: 0.3783 Query 239: 0.0159 Query 240: 1.0000 Query 241: 0.0186 +0.5 Query 242: 0.1905 Query 243: 0.4083 Query 244: 0.0175 Query 245: 0.7561 Query 246: 0.1355 Query 247: 0.9833 Query 248: 0.6545 0.0 Query 249: 0.2000 Query 250: 0.0371 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Amsterdam, Monolingual French, Auto, TD Run UAmsC04FrFr4GiSb Average precision Overall statistics Recall−Precision Values (individual queries): (for 49 queries): 1.0 Query 201: 0.3712 Total number of documents Query 202: 0.6980 over all queries Query 203: 0.5176 Retrieved: 49000 Query 204: 0.7903 Relevant: 915 Query 205: 0.3546 Rel_ret: 829 0.8 Query 206: 0.5251 Query 207: 0.1489 Interpolated Recall - Query 208: 0.8042 Precision Averages: Query 209: 0.1992 at 0.00 0.7007 Query 210: 0.0925 at 0.10 0.6394 0.6 Query 211: 0.8996 at 0.20 0.5933 Query 212: 0.3391 at 0.30 0.5360 Query 213: 0.7083 at 0.40 0.4900 Precision Query 214: 0.1713 at 0.50 0.4679 Query 215: 0.0600 at 0.60 0.4166 0.4 Query 216: 0.0333 at 0.70 0.3733 Query 217: 0.5011 at 0.80 0.3230 Query 218: 0.8730 at 0.90 0.2594 Query 219: 0.5727 at 1.00 0.2075 Query 220: 0.0901 0.2 Query 221: 0.6760 Avg. prec. (non-interpolated) Query 222: 0.0046 for all rel. documents Query 223: 0.0227 0.4410 Query 224: 0.7523 Precision: Query 225: 0.0185 At 5 docs: 0.4816 0.0 Query 226: 1.0000 At 10 docs: 0.4041 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.6105 At 15 docs: 0.3537 Query 229: 0.3896 At 20 docs: 0.3235 Recall Query 230: 0.8724 At 30 docs: 0.2748 Query 231: 0.3625 At 100 docs: 0.1357 Query 232: 0.1313 At 200 docs: 0.0774 Run UAmsC04FrFr4GiSb Query 233: 0.5241 At 500 docs: 0.0332 Comparison to median by topic Query 234: 0.1094 At 1000 docs: 0.0169 Query 235: 0.7111 +1.0 Query 236: 0.8091 R-Precision (prec. after R Query 237: 0.8326 (=num_rel) docs. retrieved): Query 238: 0.3548 Exact: 0.4154 Query 239: 0.0841 Query 240: 1.0000 Query 241: 0.0081 +0.5 Query 242: 0.2685 Query 243: 0.3731 Query 244: 0.2500 Query 245: 0.7569 Query 246: 0.1390 Query 247: 0.9909 Query 248: 0.7564 0.0 Query 249: 0.0312 Query 250: 0.0165 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Amsterdam, Monolingual French, Auto, TD Run UAmsC04FrFr4GiWd Average precision Overall statistics Recall−Precision Values (individual queries): (for 49 queries): 1.0 Query 201: 0.2616 Total number of documents Query 202: 0.6802 over all queries Query 203: 0.5632 Retrieved: 49000 Query 204: 0.8121 Relevant: 915 Query 205: 0.2515 Rel_ret: 772 0.8 Query 206: 0.5211 Query 207: 0.1923 Interpolated Recall - Query 208: 0.8042 Precision Averages: Query 209: 0.2236 at 0.00 0.6452 Query 210: 0.0668 at 0.10 0.6070 0.6 Query 211: 0.8918 at 0.20 0.5555 Query 212: 0.2886 at 0.30 0.5070 Query 213: 0.8243 at 0.40 0.4632 Precision Query 214: 0.0673 at 0.50 0.4178 Query 215: 0.0741 at 0.60 0.3731 0.4 Query 216: 0.0278 at 0.70 0.3375 Query 217: 0.5095 at 0.80 0.2959 Query 218: 0.8900 at 0.90 0.2479 Query 219: 0.4039 at 1.00 0.1881 Query 220: 0.1291 0.2 Query 221: 0.6973 Avg. prec. (non-interpolated) Query 222: 0.0067 for all rel. documents Query 223: 0.0206 0.4092 Query 224: 0.6777 Precision: Query 225: 0.0333 At 5 docs: 0.4612 0.0 Query 226: 0.1111 At 10 docs: 0.3816 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.5557 At 15 docs: 0.3415 Query 229: 0.3264 At 20 docs: 0.3020 Recall Query 230: 0.8799 At 30 docs: 0.2639 Query 231: 0.2559 At 100 docs: 0.1324 Query 232: 0.0013 At 200 docs: 0.0742 Run UAmsC04FrFr4GiWd Query 233: 0.5166 At 500 docs: 0.0310 Comparison to median by topic Query 234: 0.0833 At 1000 docs: 0.0158 Query 235: 0.7759 +1.0 Query 236: 0.8919 R-Precision (prec. after R Query 237: 0.8292 (=num_rel) docs. retrieved): Query 238: 0.3671 Exact: 0.3753 Query 239: 0.0458 Query 240: 1.0000 Query 241: 0.0025 +0.5 Query 242: 0.3867 Query 243: 0.3624 Query 244: 0.0909 Query 245: 0.7559 Query 246: 0.0821 Query 247: 0.9909 Query 248: 0.7413 0.0 Query 249: 0.0286 Query 250: 0.0505 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Amsterdam, Monolingual French, Auto, TD Run UAmsC04FrFrAll Average precision Overall statistics Recall−Precision Values (individual queries): (for 49 queries): 1.0 Query 201: 0.2764 Total number of documents Query 202: 0.6848 over all queries Query 203: 0.5210 Retrieved: 49000 Query 204: 0.8127 Relevant: 915 Query 205: 0.4093 Rel_ret: 830 0.8 Query 206: 0.5054 Query 207: 0.2055 Interpolated Recall - Query 208: 0.8042 Precision Averages: Query 209: 0.2133 at 0.00 0.6977 Query 210: 0.0918 at 0.10 0.6491 0.6 Query 211: 0.9014 at 0.20 0.6024 Query 212: 0.3394 at 0.30 0.5503 Query 213: 0.8465 at 0.40 0.5098 Precision Query 214: 0.1180 at 0.50 0.4688 Query 215: 0.0636 at 0.60 0.4239 0.4 Query 216: 0.0344 at 0.70 0.3811 Query 217: 0.5319 at 0.80 0.3330 Query 218: 0.9106 at 0.90 0.2806 Query 219: 0.4858 at 1.00 0.2193 Query 220: 0.0981 0.2 Query 221: 0.6545 Avg. prec. (non-interpolated) Query 222: 0.0051 for all rel. documents Query 223: 0.0235 0.4499 Query 224: 0.7857 Precision: Query 225: 0.0294 At 5 docs: 0.4816 0.0 Query 226: 1.0000 At 10 docs: 0.3959 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.5614 At 15 docs: 0.3510 Query 229: 0.3747 At 20 docs: 0.3194 Recall Query 230: 0.9047 At 30 docs: 0.2721 Query 231: 0.3633 At 100 docs: 0.1365 Query 232: 0.0339 At 200 docs: 0.0762 Run UAmsC04FrFrAll Query 233: 0.5201 At 500 docs: 0.0324 Comparison to median by topic Query 234: 0.0867 At 1000 docs: 0.0169 Query 235: 0.7851 +1.0 Query 236: 0.8949 R-Precision (prec. after R Query 237: 0.8348 (=num_rel) docs. retrieved): Query 238: 0.4210 Exact: 0.4107 Query 239: 0.0635 Query 240: 1.0000 Query 241: 0.0036 +0.5 Query 242: 0.4029 Query 243: 0.3765 Query 244: 0.3333 Query 245: 0.7603 Query 246: 0.1388 Query 247: 0.9909 Query 248: 0.7598 0.0 Query 249: 0.0370 Query 250: 0.0459 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number SUNY Buffalo, Monolingual French, Auto, TD Run UBmonoFR01 Average precision Overall statistics Recall−Precision Values (individual queries): (for 49 queries): 1.0 Query 201: 0.3020 Total number of documents Query 202: 0.6394 over all queries Query 203: 0.4743 Retrieved: 49000 Query 204: 0.8405 Relevant: 915 0.8 Query 205: 0.6522 Rel_ret: 863 Query 206: 0.3861 Query 207: 0.3233 Interpolated Recall - Query 208: 0.9500 Precision Averages: Query 209: 0.2480 at 0.00 0.7146 Query 210: 0.1366 at 0.10 0.6418 0.6 Query 211: 0.8484 at 0.20 0.6069 Query 212: 0.3777 at 0.30 0.5499 Query 213: 0.8025 at 0.40 0.5192 Precision Query 214: 0.0769 at 0.50 0.4907 Query 215: 0.0761 at 0.60 0.4477 0.4 Query 216: 0.0225 at 0.70 0.4006 Query 217: 0.4496 at 0.80 0.3626 Query 218: 0.8967 at 0.90 0.3130 Query 219: 0.3395 at 1.00 0.2446 Query 220: 0.1543 0.2 Query 221: 0.3317 Avg. prec. (non-interpolated) Query 222: 0.0604 for all rel. documents Query 223: 0.0268 0.4629 Query 224: 0.8774 Precision: Query 225: 0.0099 At 5 docs: 0.4653 0.0 Query 226: 1.0000 At 10 docs: 0.4143 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.3881 At 15 docs: 0.3633 Query 229: 0.4311 At 20 docs: 0.3255 Recall Query 230: 0.8575 At 30 docs: 0.2680 Query 231: 0.6923 At 100 docs: 0.1390 Query 232: 0.0796 At 200 docs: 0.0786 Run UBmonoFR01 Query 233: 0.4759 At 500 docs: 0.0334 Comparison to median by topic Query 234: 0.1558 At 1000 docs: 0.0176 Query 235: 0.7978 +1.0 Query 236: 0.8614 R-Precision (prec. after R Query 237: 0.8264 (=num_rel) docs. retrieved): Query 238: 0.5167 Exact: 0.4239 Query 239: 0.1022 Query 240: 1.0000 Query 241: 0.0083 +0.5 Query 242: 0.2583 Query 243: 0.8481 Query 244: 0.0043 Query 245: 1.0000 Query 246: 0.2346 Query 247: 0.9263 0.0 Query 248: 0.7296 Query 249: 0.0208 Query 250: 0.1620 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Université de Neuchâtel, Monolingual French, Auto, TD Run UniNEfr1 Average precision Overall statistics Recall−Precision Values (individual queries): (for 49 queries): 1.0 Query 201: 0.2356 Total number of documents Query 202: 0.6322 over all queries Query 203: 0.5961 Retrieved: 49000 Query 204: 0.8707 Relevant: 915 0.8 Query 205: 0.5208 Rel_ret: 864 Query 206: 0.4015 Query 207: 0.3042 Interpolated Recall - Query 208: 0.6792 Precision Averages: Query 209: 0.1705 at 0.00 0.6248 Query 210: 0.1213 at 0.10 0.5939 0.6 Query 211: 0.8526 at 0.20 0.5588 Query 212: 0.3801 at 0.30 0.5448 Query 213: 0.8281 at 0.40 0.5187 Precision Query 214: 0.0446 at 0.50 0.4710 Query 215: 0.2354 at 0.60 0.4377 0.4 Query 216: 0.0176 at 0.70 0.3869 Query 217: 0.3518 at 0.80 0.3598 Query 218: 0.9425 at 0.90 0.3142 Query 219: 0.5213 at 1.00 0.2548 Query 220: 0.1381 0.2 Query 221: 0.4849 Avg. prec. (non-interpolated) Query 222: 0.1280 for all rel. documents Query 223: 0.0220 0.4437 Query 224: 0.9762 Precision: Query 225: 0.0062 At 5 docs: 0.4571 0.0 Query 226: 0.1111 At 10 docs: 0.3980 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.4793 At 15 docs: 0.3592 Query 229: 0.3984 At 20 docs: 0.3286 Recall Query 230: 0.9151 At 30 docs: 0.2816 Query 231: 0.2995 At 100 docs: 0.1429 Query 232: 0.0259 At 200 docs: 0.0793 Run UniNEfr1 Query 233: 0.4378 At 500 docs: 0.0341 Comparison to median by topic Query 234: 0.7167 At 1000 docs: 0.0176 Query 235: 0.8417 +1.0 Query 236: 0.9430 R-Precision (prec. after R Query 237: 0.9599 (=num_rel) docs. retrieved): Query 238: 0.3655 Exact: 0.4136 Query 239: 0.1612 Query 240: 1.0000 Query 241: 0.0136 +0.5 Query 242: 0.3054 Query 243: 0.5084 Query 244: 0.0042 Query 245: 0.9500 Query 246: 0.1605 Query 247: 0.9573 0.0 Query 248: 0.6469 Query 249: 0.0333 Query 250: 0.0433 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Université de Neuchâtel, Monolingual French, Auto, TD Run UniNEfr2 Average precision Overall statistics Recall−Precision Values (individual queries): (for 49 queries): 1.0 Query 201: 0.2389 Total number of documents Query 202: 0.6943 over all queries Query 203: 0.6010 Retrieved: 49000 Query 204: 0.8470 Relevant: 915 0.8 Query 205: 0.5551 Rel_ret: 840 Query 206: 0.5280 Query 207: 0.4631 Interpolated Recall - Query 208: 0.8042 Precision Averages: Query 209: 0.3179 at 0.00 0.6946 Query 210: 0.0752 at 0.10 0.6725 0.6 Query 211: 0.8814 at 0.20 0.6327 Query 212: 0.4124 at 0.30 0.5919 Query 213: 0.8465 at 0.40 0.5328 Precision Query 214: 0.0483 at 0.50 0.4916 Query 215: 0.2660 at 0.60 0.4546 0.4 Query 216: 0.0379 at 0.70 0.4150 Query 217: 0.3600 at 0.80 0.3886 Query 218: 0.9343 at 0.90 0.3467 Query 219: 0.3830 at 1.00 0.2736 Query 220: 0.2544 0.2 Query 221: 0.5349 Avg. prec. (non-interpolated) Query 222: 0.1667 for all rel. documents Query 223: 0.0203 0.4849 Query 224: 1.0000 Precision: Query 225: 0.0097 At 5 docs: 0.4857 0.0 Query 226: 0.5000 At 10 docs: 0.4245 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.6289 At 15 docs: 0.3837 Query 229: 0.5024 At 20 docs: 0.3500 Recall Query 230: 0.9042 At 30 docs: 0.2891 Query 231: 0.7089 At 100 docs: 0.1437 Query 232: 0.0025 At 200 docs: 0.0796 Run UniNEfr2 Query 233: 0.4193 At 500 docs: 0.0334 Comparison to median by topic Query 234: 0.4961 At 1000 docs: 0.0171 Query 235: 0.8107 +1.0 Query 236: 0.9833 R-Precision (prec. after R Query 237: 0.9245 (=num_rel) docs. retrieved): Query 238: 0.4830 Exact: 0.4475 Query 239: 0.1704 Query 240: 1.0000 Query 241: 0.0316 +0.5 Query 242: 0.4643 Query 243: 0.4638 Query 244: 0.0036 Query 245: 1.0000 Query 246: 0.2222 Query 247: 1.0000 0.0 Query 248: 0.6658 Query 249: 0.0200 Query 250: 0.0724 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Université de Neuchâtel, Monolingual French, Auto, TDN Run UniNEfr3 Average precision Overall statistics Recall−Precision Values (individual queries): (for 49 queries): 1.0 Query 201: 0.1955 Total number of documents Query 202: 0.5769 over all queries Query 203: 0.5778 Retrieved: 49000 Query 204: 0.8581 Relevant: 915 0.8 Query 205: 0.5614 Rel_ret: 898 Query 206: 0.4279 Query 207: 0.3328 Interpolated Recall - Query 208: 0.6792 Precision Averages: Query 209: 0.2563 at 0.00 0.6909 Query 210: 0.0786 at 0.10 0.6653 0.6 Query 211: 0.8536 at 0.20 0.6340 Query 212: 0.4074 at 0.30 0.5781 Query 213: 0.8561 at 0.40 0.5442 Precision Query 214: 0.0872 at 0.50 0.4870 Query 215: 0.3012 at 0.60 0.4612 0.4 Query 216: 0.0233 at 0.70 0.4133 Query 217: 0.2926 at 0.80 0.3796 Query 218: 0.9142 at 0.90 0.3291 Query 219: 0.6306 at 1.00 0.2627 Query 220: 0.5050 0.2 Query 221: 0.6447 Avg. prec. (non-interpolated) Query 222: 0.1433 for all rel. documents Query 223: 0.0222 0.4785 Query 224: 1.0000 Precision: Query 225: 0.0323 At 5 docs: 0.5102 0.0 Query 226: 0.2000 At 10 docs: 0.4388 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.5372 At 15 docs: 0.3918 Query 229: 0.4925 At 20 docs: 0.3571 Recall Query 230: 0.8943 At 30 docs: 0.3075 Query 231: 0.3807 At 100 docs: 0.1537 Query 232: 0.5790 At 200 docs: 0.0850 Run UniNEfr3 Query 233: 0.6700 At 500 docs: 0.0359 Comparison to median by topic Query 234: 0.3162 At 1000 docs: 0.0183 Query 235: 0.6968 +1.0 Query 236: 1.0000 R-Precision (prec. after R Query 237: 0.9103 (=num_rel) docs. retrieved): Query 238: 0.3693 Exact: 0.4488 Query 239: 0.1777 Query 240: 1.0000 Query 241: 0.0161 +0.5 Query 242: 0.4295 Query 243: 0.5433 Query 244: 0.0023 Query 245: 0.9500 Query 246: 0.1494 Query 247: 1.0000 0.0 Query 248: 0.7797 Query 249: 0.0263 Query 250: 0.0705 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Glasgow, Monolingual French, Auto, TDN Run UOGLQ Average precision Overall statistics Recall−Precision Values (individual queries): (for 49 queries): 1.0 Query 201: 0.2097 Total number of documents Query 202: 0.6740 over all queries Query 203: 0.4347 Retrieved: 49000 Query 204: 0.8720 Relevant: 915 Query 205: 0.5787 Rel_ret: 846 0.8 Query 206: 0.2972 Query 207: 0.1984 Interpolated Recall - Query 208: 0.7708 Precision Averages: Query 209: 0.0538 at 0.00 0.6513 Query 210: 0.2028 at 0.10 0.5901 0.6 Query 211: 0.6823 at 0.20 0.5668 Query 212: 0.3427 at 0.30 0.5380 Query 213: 0.8206 at 0.40 0.4856 Precision Query 214: 0.0941 at 0.50 0.4593 Query 215: 0.0000 at 0.60 0.4274 0.4 Query 216: 0.0063 at 0.70 0.3617 Query 217: 0.3264 at 0.80 0.3094 Query 218: 0.9169 at 0.90 0.2594 Query 219: 0.0087 at 1.00 0.1735 Query 220: 0.5179 0.2 Query 221: 0.2150 Avg. prec. (non-interpolated) Query 222: 0.0425 for all rel. documents Query 223: 0.0114 0.4244 Query 224: 1.0000 Precision: Query 225: 0.0027 At 5 docs: 0.4449 0.0 Query 226: 0.3333 At 10 docs: 0.3735 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.0006 At 15 docs: 0.3320 Query 229: 0.4661 At 20 docs: 0.3031 Recall Query 230: 0.8982 At 30 docs: 0.2673 Query 231: 0.6247 At 100 docs: 0.1349 Query 232: 0.5407 At 200 docs: 0.0767 Run UOGLQ Query 233: 0.4107 At 500 docs: 0.0329 Query 234: 0.2489 At 1000 docs: 0.0173 Comparison to median by topic Query 235: 0.8357 +1.0 Query 236: 0.9733 R-Precision (prec. after R Query 237: 0.8476 (=num_rel) docs. retrieved): Query 238: 0.5061 Exact: 0.3937 Query 239: 0.1345 Query 240: 1.0000 Query 241: 0.0269 +0.5 Query 242: 0.3539 Query 243: 0.4969 Query 244: 0.0000 Query 245: 0.7917 Query 246: 0.3647 Query 247: 0.8727 Query 248: 0.5566 0.0 Query 249: 0.2000 Query 250: 0.0324 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Glasgow, Monolingual French, Auto, TDN Run UOGLQQE Average precision Overall statistics Recall−Precision Values (individual queries): (for 49 queries): 1.0 Query 201: 0.0030 Total number of documents Query 202: 0.6481 over all queries Query 203: 0.6692 Retrieved: 49000 Query 204: 0.7935 Relevant: 915 Query 205: 0.5400 Rel_ret: 838 0.8 Query 206: 0.5073 Query 207: 0.3208 Interpolated Recall - Query 208: 0.2028 Precision Averages: Query 209: 0.3105 at 0.00 0.6142 Query 210: 0.0762 at 0.10 0.5911 0.6 Query 211: 0.8711 at 0.20 0.5715 Query 212: 0.5101 at 0.30 0.5068 Query 213: 0.8776 at 0.40 0.4680 Precision Query 214: 0.0994 at 0.50 0.4290 Query 215: 0.0781 at 0.60 0.3987 0.4 Query 216: 0.0039 at 0.70 0.3659 Query 217: 0.0320 at 0.80 0.3090 Query 218: 0.9276 at 0.90 0.2656 Query 219: 0.0002 at 1.00 0.1851 Query 220: 0.1882 0.2 Query 221: 0.1707 Avg. prec. (non-interpolated) Query 222: 0.1797 for all rel. documents Query 223: 0.0234 0.4186 Query 224: 0.8089 Precision: Query 225: 0.0370 At 5 docs: 0.4286 0.0 Query 226: 0.5000 At 10 docs: 0.3735 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.0144 At 15 docs: 0.3320 Query 229: 0.3977 At 20 docs: 0.3031 Recall Query 230: 0.8123 At 30 docs: 0.2701 Query 231: 0.6181 At 100 docs: 0.1396 Query 232: 0.7143 At 200 docs: 0.0774 Run UOGLQQE Query 233: 0.5229 At 500 docs: 0.0327 Query 234: 0.2411 At 1000 docs: 0.0171 Comparison to median by topic Query 235: 0.8024 +1.0 Query 236: 1.0000 R-Precision (prec. after R Query 237: 0.8698 (=num_rel) docs. retrieved): Query 238: 0.5531 Exact: 0.3623 Query 239: 0.0450 Query 240: 1.0000 Query 241: 0.0000 +0.5 Query 242: 0.3488 Query 243: 0.4021 Query 244: 0.0045 Query 245: 0.7672 Query 246: 0.2026 Query 247: 0.9833 Query 248: 0.8194 0.0 Query 249: 0.0122 Query 250: 0.0021 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Glasgow, Monolingual French, Auto, T Run UOGSQ Average precision Overall statistics Recall−Precision Values (individual queries): (for 49 queries): 1.0 Query 201: 0.2378 Total number of documents Query 202: 0.6413 over all queries Query 203: 0.4619 Retrieved: 49000 Query 204: 0.8243 Relevant: 915 Query 205: 0.5670 Rel_ret: 842 0.8 Query 206: 0.3802 Query 207: 0.2482 Interpolated Recall - Query 208: 0.9500 Precision Averages: Query 209: 0.0852 at 0.00 0.6653 Query 210: 0.1613 at 0.10 0.5962 0.6 Query 211: 0.7004 at 0.20 0.5663 Query 212: 0.3463 at 0.30 0.5182 Query 213: 0.8054 at 0.40 0.4844 Precision Query 214: 0.1047 at 0.50 0.4453 Query 215: 0.0000 at 0.60 0.4273 0.4 Query 216: 0.0182 at 0.70 0.3556 Query 217: 0.3383 at 0.80 0.3080 Query 218: 0.8811 at 0.90 0.2589 Query 219: 0.0119 at 1.00 0.1963 Query 220: 0.2953 0.2 Query 221: 0.2404 Avg. prec. (non-interpolated) Query 222: 0.0582 for all rel. documents Query 223: 0.0142 0.4237 Query 224: 0.9306 Precision: Query 225: 0.0015 At 5 docs: 0.4408 0.0 Query 226: 0.2500 At 10 docs: 0.4000 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.0006 At 15 docs: 0.3551 Query 229: 0.4310 At 20 docs: 0.3102 Recall Query 230: 0.8825 At 30 docs: 0.2612 Query 231: 0.6255 At 100 docs: 0.1339 Query 232: 0.4712 At 200 docs: 0.0764 Run UOGSQ Query 233: 0.4291 At 500 docs: 0.0330 Query 234: 0.1758 At 1000 docs: 0.0172 Comparison to median by topic Query 235: 0.8274 +1.0 Query 236: 0.9207 R-Precision (prec. after R Query 237: 0.7993 (=num_rel) docs. retrieved): Query 238: 0.6103 Exact: 0.3893 Query 239: 0.1079 Query 240: 1.0000 Query 241: 0.0216 +0.5 Query 242: 0.3609 Query 243: 0.5329 Query 244: 0.0000 Query 245: 0.8929 Query 246: 0.3929 Query 247: 0.8267 Query 248: 0.4864 0.0 Query 249: 0.3333 Query 250: 0.0766 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Glasgow, Monolingual French, Auto, T Run UOGSQQE Average precision Overall statistics Recall−Precision Values (individual queries): (for 49 queries): 1.0 Query 201: 0.0001 Total number of documents Query 202: 0.6450 over all queries Query 203: 0.5399 Retrieved: 49000 Query 204: 0.7636 Relevant: 915 Query 205: 0.6703 Rel_ret: 720 0.8 Query 206: 0.1891 Query 207: 0.2483 Interpolated Recall - Query 208: 0.0004 Precision Averages: Query 209: 0.2504 at 0.00 0.5589 Query 210: 0.1281 at 0.10 0.4719 0.6 Query 211: 0.8339 at 0.20 0.4293 Query 212: 0.3648 at 0.30 0.3948 Query 213: 0.0128 at 0.40 0.3724 Precision Query 214: 0.1746 at 0.50 0.3614 Query 215: 0.3778 at 0.60 0.3253 0.4 Query 216: 0.0029 at 0.70 0.2845 Query 217: 0.0176 at 0.80 0.2689 Query 218: 0.0871 at 0.90 0.2378 Query 219: 0.4499 at 1.00 0.1923 Query 220: 0.0811 0.2 Query 221: 0.0193 Avg. prec. (non-interpolated) Query 222: 0.0067 for all rel. documents Query 223: 0.0176 0.3400 Query 224: 1.0000 Precision: Query 225: 0.0233 At 5 docs: 0.3673 0.0 Query 226: 0.3333 At 10 docs: 0.2918 0.0 0.2 0.4 0.6 0.8 1.0 Query 228: 0.0014 At 15 docs: 0.2667 Query 229: 0.1923 At 20 docs: 0.2418 Recall Query 230: 0.7681 At 30 docs: 0.2061 Query 231: 0.0090 At 100 docs: 0.1039 Query 232: 0.5794 At 200 docs: 0.0605 Run UOGSQQE Query 233: 0.2549 At 500 docs: 0.0273 Query 234: 0.2881 At 1000 docs: 0.0147 Comparison to median by topic Query 235: 0.8190 +1.0 Query 236: 1.0000 R-Precision (prec. after R Query 237: 0.8799 (=num_rel) docs. retrieved): Query 238: 0.0002 Exact: 0.2975 Query 239: 0.0781 Query 240: 1.0000 Query 241: 0.0000 +0.5 Query 242: 0.4368 Query 243: 0.2552 Query 244: 0.0033 Query 245: 1.0000 Query 246: 0.1347 Query 247: 0.8567 Query 248: 0.8647 0.0 Query 249: 0.0000 Query 250: 0.0004 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Universidad de Evora, Monolingual Portuguese, Auto, T Run alentejo1 Average precision Overall statistics (individual queries): (for 46 queries): Recall−Precision Values 1.0 Query 201: 0.0271 Total number of documents Query 202: 0.1335 over all queries Query 203: 0.0267 Retrieved: 40134 Query 204: 0.1694 Relevant: 678 Query 205: 0.7500 Rel_ret: 442 0.8 Query 206: 0.0321 Query 207: 0.1964 Interpolated Recall - Query 208: 0.2233 Precision Averages: Query 209: 0.0000 at 0.00 0.3875 Query 210: 0.0588 at 0.10 0.3318 0.6 Query 211: 0.5799 at 0.20 0.2502 Query 212: 0.0019 at 0.30 0.2045 Query 213: 0.1743 at 0.40 0.1946 Precision Query 214: 0.0000 at 0.50 0.1872 Query 215: 0.0000 at 0.60 0.1676 0.4 Query 217: 0.0005 at 0.70 0.1253 Query 218: 0.4980 at 0.80 0.1240 Query 219: 0.0031 at 0.90 0.1216 Query 221: 0.6050 at 1.00 0.1101 Query 222: 0.0160 0.2 Query 223: 0.0000 Avg. prec. (non-interpolated) Query 224: 0.1964 for all rel. documents Query 225: 0.0115 0.1827 Query 226: 0.4762 Precision: Query 228: 0.0206 At 5 docs: 0.2000 0.0 Query 229: 0.6585 At 10 docs: 0.1652 0.0 0.2 0.4 0.6 0.8 1.0 Query 230: 0.1971 At 15 docs: 0.1377 Query 231: 0.0000 At 20 docs: 0.1141 Recall Query 232: 0.0328 At 30 docs: 0.0913 Query 233: 0.2399 At 100 docs: 0.0496 Query 234: 0.0081 At 200 docs: 0.0339 Run alentejo1 Query 235: 0.0164 At 500 docs: 0.0177 Query 236: 0.6667 At 1000 docs: 0.0096 Comparison to median by topic Query 237: 1.0000 +1.0 Query 238: 0.0029 R-Precision (prec. after R Query 239: 0.0226 (=num_rel) docs. retrieved): Query 241: 0.0343 Exact: 0.1640 Query 242: 0.0000 Query 243: 0.0015 Query 244: 0.0000 +0.5 Query 245: 0.9167 Query 246: 0.0000 Query 247: 0.2853 Query 248: 0.1008 Query 249: 0.0043 Query 250: 0.0136 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Universidad de Evora, Monolingual Portuguese, Auto, T Run alentejo2 Average precision Overall statistics (individual queries): (for 46 queries): Recall−Precision Values 1.0 Query 201: 0.0068 Total number of documents Query 202: 0.1339 over all queries Query 203: 0.0231 Retrieved: 39128 Query 204: 0.0021 Relevant: 678 Query 205: 0.0352 Rel_ret: 422 0.8 Query 206: 0.0340 Query 207: 0.0966 Interpolated Recall - Query 208: 0.2233 Precision Averages: Query 209: 0.0006 at 0.00 0.2587 Query 210: 0.0663 at 0.10 0.2216 0.6 Query 211: 0.4424 at 0.20 0.1861 Query 212: 0.0035 at 0.30 0.1528 Query 213: 0.1686 at 0.40 0.1358 Precision Query 214: 0.0000 at 0.50 0.1135 Query 215: 0.0000 at 0.60 0.0989 0.4 Query 217: 0.0008 at 0.70 0.0883 Query 218: 0.6214 at 0.80 0.0859 Query 219: 0.0066 at 0.90 0.0731 Query 221: 0.1499 at 1.00 0.0707 Query 222: 0.0246 0.2 Query 223: 0.0000 Avg. prec. (non-interpolated) Query 224: 0.1964 for all rel. documents Query 225: 0.0204 0.1243 Query 226: 0.1785 Precision: Query 228: 0.0337 At 5 docs: 0.1348 0.0 Query 229: 0.6746 At 10 docs: 0.1130 0.0 0.2 0.4 0.6 0.8 1.0 Query 230: 0.1971 At 15 docs: 0.1101 Query 231: 0.0000 At 20 docs: 0.0957 Recall Query 232: 0.0028 At 30 docs: 0.0790 Query 233: 0.0016 At 100 docs: 0.0487 Query 234: 0.0263 At 200 docs: 0.0313 Run alentejo2 Query 235: 0.0000 At 500 docs: 0.0167 Query 236: 0.0390 At 1000 docs: 0.0092 Comparison to median by topic Query 237: 1.0000 +1.0 Query 238: 0.0029 R-Precision (prec. after R Query 239: 0.0077 (=num_rel) docs. retrieved): Query 241: 0.0789 Exact: 0.1080 Query 242: 0.0000 Query 243: 0.0031 Query 244: 0.0000 +0.5 Query 245: 0.9167 Query 246: 0.0000 Query 247: 0.2942 Query 248: 0.0001 Query 249: 0.0030 Query 250: 0.0006 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number JHU/APL, Monolingual Portuguese, Auto, TD Run aplmopta Average precision Overall statistics (individual queries): (for 46 queries): Recall−Precision Values 1.0 Query 201: 0.0044 Total number of documents Query 202: 0.8155 over all queries Query 203: 0.4075 Retrieved: 46000 Query 204: 0.8571 Relevant: 678 Query 205: 0.8333 Rel_ret: 582 0.8 Query 206: 0.5385 Query 207: 0.0619 Interpolated Recall - Query 208: 1.0000 Precision Averages: Query 209: 0.0007 at 0.00 0.5514 Query 210: 0.6242 at 0.10 0.5351 0.6 Query 211: 0.9551 at 0.20 0.5217 Query 212: 0.3556 at 0.30 0.4942 Query 213: 0.6575 at 0.40 0.4826 Precision Query 214: 0.0850 at 0.50 0.4486 Query 215: 0.3333 at 0.60 0.4096 0.4 Query 217: 0.0009 at 0.70 0.3816 Query 218: 0.8156 at 0.80 0.3563 Query 219: 0.0146 at 0.90 0.3287 Query 221: 0.9107 at 1.00 0.2783 Query 222: 0.0031 0.2 Query 223: 1.0000 Avg. prec. (non-interpolated) Query 224: 0.1964 for all rel. documents Query 225: 0.2500 0.4231 Query 226: 0.4929 Precision: Query 228: 0.5183 At 5 docs: 0.3696 0.0 Query 229: 0.7998 At 10 docs: 0.3000 0.0 0.2 0.4 0.6 0.8 1.0 Query 230: 0.6247 At 15 docs: 0.2435 Query 231: 0.0004 At 20 docs: 0.2174 Recall Query 232: 0.1284 At 30 docs: 0.1841 Query 233: 0.7362 At 100 docs: 0.0883 Query 234: 0.0048 At 200 docs: 0.0536 Run aplmopta Query 235: 0.0019 At 500 docs: 0.0245 Query 236: 0.5317 At 1000 docs: 0.0127 Comparison to median by topic Query 237: 1.0000 +1.0 Query 238: 0.0034 R-Precision (prec. after R Query 239: 0.0711 (=num_rel) docs. retrieved): Query 241: 0.0005 Exact: 0.3562 Query 242: 0.4507 Query 243: 0.3333 Query 244: 0.0069 +0.5 Query 245: 1.0000 Query 246: 0.2500 Query 247: 1.0000 Query 248: 0.6391 Query 249: 0.1415 Query 250: 0.0055 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number JHU/APL, Monolingual Portuguese, Auto, TD Run aplmoptb Average precision Overall statistics (individual queries): (for 46 queries): Recall−Precision Values 1.0 Query 201: 0.0005 Total number of documents Query 202: 0.7844 over all queries Query 203: 0.3953 Retrieved: 46000 Query 204: 0.8560 Relevant: 678 Query 205: 1.0000 Rel_ret: 604 0.8 Query 206: 0.6429 Query 207: 0.0779 Interpolated Recall - Query 208: 1.0000 Precision Averages: Query 209: 0.0007 at 0.00 0.5969 Query 210: 0.4227 at 0.10 0.5617 0.6 Query 211: 0.9482 at 0.20 0.5469 Query 212: 0.3188 at 0.30 0.5112 Query 213: 0.6562 at 0.40 0.4873 Precision Query 214: 0.1225 at 0.50 0.4713 Query 215: 0.3333 at 0.60 0.4311 0.4 Query 217: 0.7597 at 0.70 0.4144 Query 218: 0.7878 at 0.80 0.3817 Query 219: 0.0013 at 0.90 0.3522 Query 221: 0.8552 at 1.00 0.3103 Query 222: 0.0397 0.2 Query 223: 1.0000 Avg. prec. (non-interpolated) Query 224: 0.2083 for all rel. documents Query 225: 0.1111 0.4445 Query 226: 0.4929 Precision: Query 228: 0.4971 At 5 docs: 0.3957 0.0 Query 229: 0.8204 At 10 docs: 0.3065 0.0 0.2 0.4 0.6 0.8 1.0 Query 230: 0.6253 At 15 docs: 0.2623 Query 231: 0.0016 At 20 docs: 0.2446 Recall Query 232: 0.2137 At 30 docs: 0.2007 Query 233: 0.6762 At 100 docs: 0.0913 Query 234: 0.0021 At 200 docs: 0.0558 Run aplmoptb Query 235: 0.0025 At 500 docs: 0.0256 Query 236: 0.6389 At 1000 docs: 0.0131 Comparison to median by topic Query 237: 1.0000 +1.0 Query 238: 0.0169 R-Precision (prec. after R Query 239: 0.1538 (=num_rel) docs. retrieved): Query 241: 0.0152 Exact: 0.3907 Query 242: 0.4921 Query 243: 0.3333 Query 244: 0.0027 +0.5 Query 245: 1.0000 Query 246: 0.3333 Query 247: 1.0000 Query 248: 0.6019 Query 249: 0.2021 Query 250: 0.0016 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number JHU/APL, Monolingual Portuguese, Auto, TD Run aplmoptc Average precision Overall statistics (individual queries): (for 46 queries): Recall−Precision Values 1.0 Query 201: 0.0052 Total number of documents Query 202: 0.7849 over all queries Query 203: 0.4230 Retrieved: 46000 Query 204: 0.8228 Relevant: 678 Query 205: 1.0000 Rel_ret: 589 0.8 Query 206: 0.5526 Query 207: 0.3551 Interpolated Recall - Query 208: 1.0000 Precision Averages: Query 209: 0.0029 at 0.00 0.6553 Query 210: 0.5762 at 0.10 0.6225 0.6 Query 211: 0.9405 at 0.20 0.5890 Query 212: 0.3410 at 0.30 0.5366 Query 213: 0.6745 at 0.40 0.5095 Precision Query 214: 0.1781 at 0.50 0.4910 Query 215: 0.3333 at 0.60 0.4407 0.4 Query 217: 0.6060 at 0.70 0.4223 Query 218: 0.8102 at 0.80 0.3900 Query 219: 0.0125 at 0.90 0.3526 Query 221: 0.7885 at 1.00 0.3197 Query 222: 0.0456 0.2 Query 223: 1.0000 Avg. prec. (non-interpolated) Query 224: 1.0000 for all rel. documents Query 225: 0.1250 0.4691 Query 226: 0.6917 Precision: Query 228: 0.5455 At 5 docs: 0.4130 0.0 Query 229: 0.8240 At 10 docs: 0.3174 0.0 0.2 0.4 0.6 0.8 1.0 Query 230: 0.6244 At 15 docs: 0.2667 Query 231: 0.0014 At 20 docs: 0.2348 Recall Query 232: 0.0011 At 30 docs: 0.1906 Query 233: 0.7545 At 100 docs: 0.0883 Query 234: 0.0083 At 200 docs: 0.0539 Run aplmoptc Query 235: 0.0039 At 500 docs: 0.0247 Query 236: 0.6389 At 1000 docs: 0.0128 Comparison to median by topic Query 237: 1.0000 +1.0 Query 238: 0.0263 R-Precision (prec. after R Query 239: 0.1218 (=num_rel) docs. retrieved): Query 241: 0.0266 Exact: 0.4219 Query 242: 0.4507 Query 243: 0.3333 Query 244: 0.0083 +0.5 Query 245: 1.0000 Query 246: 0.3333 Query 247: 1.0000 Query 248: 0.5974 Query 249: 0.2032 Query 250: 0.0043 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Hummingbird, Monolingual Portuguese, Auto, T Run humPT04t Average precision Overall statistics Recall−Precision Values (individual queries): (for 46 queries): 1.0 Query 201: 0.0166 Total number of documents Query 202: 0.5174 over all queries Query 203: 0.2225 Retrieved: 40815 Query 204: 0.4234 Relevant: 678 Query 205: 0.7500 Rel_ret: 588 0.8 Query 206: 0.1650 Query 207: 0.2279 Interpolated Recall - Query 208: 0.6290 Precision Averages: Query 209: 0.0000 at 0.00 0.6270 Query 210: 0.4389 at 0.10 0.5865 0.6 Query 211: 0.9076 at 0.20 0.5416 Query 212: 0.2216 at 0.30 0.4752 Query 213: 0.6177 at 0.40 0.4422 Precision Query 214: 0.0000 at 0.50 0.4234 Query 215: 0.0385 at 0.60 0.3666 0.4 Query 217: 0.9405 at 0.70 0.3293 Query 218: 0.8089 at 0.80 0.3120 Query 219: 0.0221 at 0.90 0.2729 Query 221: 0.8179 at 1.00 0.2382 Query 222: 0.0105 0.2 Query 223: 0.2500 Avg. prec. (non-interpolated) Query 224: 0.5244 for all rel. documents Query 225: 1.0000 0.4051 Query 226: 0.8929 Precision: Query 228: 0.0408 At 5 docs: 0.3783 0.0 Query 229: 0.7982 At 10 docs: 0.2935 0.0 0.2 0.4 0.6 0.8 1.0 Query 230: 0.4925 At 15 docs: 0.2478 Query 231: 0.0296 At 20 docs: 0.2109 Recall Query 232: 0.2062 At 30 docs: 0.1804 Query 233: 0.6345 At 100 docs: 0.0835 Query 234: 0.4167 At 200 docs: 0.0514 Run humPT04t Query 235: 0.0909 At 500 docs: 0.0241 Comparison to median by topic Query 236: 0.5744 At 1000 docs: 0.0128 Query 237: 1.0000 +1.0 Query 238: 0.0303 R-Precision (prec. after R Query 239: 0.0579 (=num_rel) docs. retrieved): Query 241: 0.1717 Exact: 0.3418 Query 242: 0.5242 Query 243: 0.3333 Query 244: 0.0000 +0.5 Query 245: 1.0000 Query 246: 0.2000 Query 247: 0.9861 Query 248: 0.5373 Query 249: 0.0423 Query 250: 0.0234 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Hummingbird, Monolingual Portuguese, Auto, TD Run humPT04td Average precision Overall statistics Recall−Precision Values (individual queries): (for 46 queries): 1.0 Query 201: 0.0281 Total number of documents Query 202: 0.5441 over all queries Query 203: 0.2371 Retrieved: 46000 Query 204: 0.5474 Relevant: 678 Query 205: 0.7500 Rel_ret: 613 0.8 Query 206: 0.8333 Query 207: 0.2742 Interpolated Recall - Query 208: 1.0000 Precision Averages: Query 209: 0.0000 at 0.00 0.6140 Query 210: 0.4800 at 0.10 0.5850 0.6 Query 211: 0.8943 at 0.20 0.5475 Query 212: 0.1327 at 0.30 0.5132 Query 213: 0.7478 at 0.40 0.5075 Precision Query 214: 0.0046 at 0.50 0.4921 Query 215: 0.0476 at 0.60 0.4312 0.4 Query 217: 0.6235 at 0.70 0.4112 Query 218: 0.8145 at 0.80 0.3762 Query 219: 0.0285 at 0.90 0.3418 Query 221: 1.0000 at 1.00 0.2999 Query 222: 0.0205 0.2 Query 223: 0.5000 Avg. prec. (non-interpolated) Query 224: 1.0000 for all rel. documents Query 225: 0.5000 0.4534 Query 226: 0.8750 Precision: Query 228: 0.3584 At 5 docs: 0.4087 0.0 Query 229: 0.7982 At 10 docs: 0.3196 0.0 0.2 0.4 0.6 0.8 1.0 Query 230: 0.5023 At 15 docs: 0.2594 Query 231: 0.0097 At 20 docs: 0.2261 Recall Query 232: 0.0245 At 30 docs: 0.1891 Query 233: 0.7963 At 100 docs: 0.0887 Query 234: 0.1625 At 200 docs: 0.0542 Run humPT04td Query 235: 0.0455 At 500 docs: 0.0255 Comparison to median by topic Query 236: 0.5333 At 1000 docs: 0.0133 Query 237: 1.0000 +1.0 Query 238: 0.0833 R-Precision (prec. after R Query 239: 0.1658 (=num_rel) docs. retrieved): Query 241: 0.1125 Exact: 0.3791 Query 242: 0.7088 Query 243: 0.2500 Query 244: 0.0023 +0.5 Query 245: 1.0000 Query 246: 0.5000 Query 247: 1.0000 Query 248: 0.8075 Query 249: 0.0931 Query 250: 0.0190 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Hummingbird, Monolingual Portuguese, Auto, TD Run humPT04tde Average precision Overall statistics Recall−Precision Values (individual queries): (for 46 queries): 1.0 Query 201: 0.0492 Total number of documents Query 202: 0.6080 over all queries Query 203: 0.2617 Retrieved: 46000 Query 204: 0.5914 Relevant: 678 Query 205: 0.5833 Rel_ret: 616 0.8 Query 206: 0.8333 Query 207: 0.3538 Interpolated Recall - Query 208: 1.0000 Precision Averages: Query 209: 0.0017 at 0.00 0.6260 Query 210: 0.5949 at 0.10 0.5786 0.6 Query 211: 0.9278 at 0.20 0.5541 Query 212: 0.2641 at 0.30 0.5360 Query 213: 0.7939 at 0.40 0.5245 Precision Query 214: 0.0050 at 0.50 0.5132 Query 215: 0.2000 at 0.60 0.4727 0.4 Query 217: 0.7296 at 0.70 0.4412 Query 218: 0.8545 at 0.80 0.4180 Query 219: 0.0101 at 0.90 0.3801 Query 221: 1.0000 at 1.00 0.3323 Query 222: 0.0565 0.2 Query 223: 0.5000 Avg. prec. (non-interpolated) Query 224: 1.0000 for all rel. documents Query 225: 0.5000 0.4750 Query 226: 1.0000 Precision: Query 228: 0.4505 At 5 docs: 0.4304 0.0 Query 229: 0.8180 At 10 docs: 0.3326 0.0 0.2 0.4 0.6 0.8 1.0 Query 230: 0.4989 At 15 docs: 0.2725 Query 231: 0.0038 At 20 docs: 0.2337 Recall Query 232: 0.0570 At 30 docs: 0.1928 Query 233: 0.8507 At 100 docs: 0.0907 Query 234: 0.1409 At 200 docs: 0.0564 Run humPT04tde Query 235: 0.0149 At 500 docs: 0.0260 Comparison to median by topic Query 236: 0.5333 At 1000 docs: 0.0134 Query 237: 1.0000 +1.0 Query 238: 0.0769 R-Precision (prec. after R Query 239: 0.1061 (=num_rel) docs. retrieved): Query 241: 0.0731 Exact: 0.4071 Query 242: 0.8750 Query 243: 0.2500 Query 244: 0.0073 +0.5 Query 245: 1.0000 Query 246: 0.5000 Query 247: 1.0000 Query 248: 0.8057 Query 249: 0.0569 Query 250: 0.0141 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Alicante, Monolingual Portuguese, Auto, TD Run IRn−MP−Dexp Average precision Overall statistics (individual queries): (for 46 queries): Recall−Precision Values 1.0 Query 201: 0.0212 Total number of documents Query 202: 0.4325 over all queries Query 203: 0.2288 Retrieved: 46000 Query 204: 0.3459 Relevant: 678 Query 205: 0.0595 Rel_ret: 538 0.8 Query 206: 0.7500 Query 207: 0.0384 Interpolated Recall - Query 208: 1.0000 Precision Averages: Query 209: 0.0019 at 0.00 0.5781 Query 210: 0.7019 at 0.10 0.5465 0.6 Query 211: 0.8224 at 0.20 0.4868 Query 212: 0.1817 at 0.30 0.4505 Query 213: 0.6419 at 0.40 0.4238 Precision Query 214: 0.0000 at 0.50 0.3921 Query 215: 0.0278 at 0.60 0.3576 0.4 Query 217: 0.9325 at 0.70 0.3369 Query 218: 0.7071 at 0.80 0.3126 Query 219: 0.0008 at 0.90 0.2796 Query 221: 0.8552 at 1.00 0.2521 Query 222: 0.0033 0.2 Query 223: 0.2500 Avg. prec. (non-interpolated) Query 224: 1.0000 for all rel. documents Query 225: 1.0000 0.3909 Query 226: 0.1125 Precision: Query 228: 0.3614 At 5 docs: 0.3696 0.0 Query 229: 0.2972 At 10 docs: 0.2870 0.0 0.2 0.4 0.6 0.8 1.0 Query 230: 0.4860 At 15 docs: 0.2275 Query 231: 0.0281 At 20 docs: 0.2011 Recall Query 232: 0.0439 At 30 docs: 0.1587 Query 233: 0.7045 At 100 docs: 0.0713 Query 234: 0.0000 At 200 docs: 0.0437 Run IRn−MP−Dexp Query 235: 0.0909 At 500 docs: 0.0212 Query 236: 0.7556 At 1000 docs: 0.0117 Comparison to median by topic Query 237: 1.0000 +1.0 Query 238: 0.0145 R-Precision (prec. after R Query 239: 0.1889 (=num_rel) docs. retrieved): Query 241: 0.0162 Exact: 0.3533 Query 242: 0.5556 Query 243: 0.2500 Query 244: 0.2500 +0.5 Query 245: 1.0000 Query 246: 0.0250 Query 247: 1.0000 Query 248: 0.6585 Query 249: 0.1335 Query 250: 0.0058 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Alicante, Monolingual Portuguese, Auto, TD Run IRn−MP−nexp Average precision Overall statistics (individual queries): (for 46 queries): Recall−Precision Values 1.0 Query 201: 0.0484 Total number of documents Query 202: 0.2607 over all queries Query 203: 0.2145 Retrieved: 46000 Query 204: 0.3690 Relevant: 678 Query 205: 0.1169 Rel_ret: 471 0.8 Query 206: 0.7000 Query 207: 0.1106 Interpolated Recall - Query 208: 0.9250 Precision Averages: Query 209: 0.0000 at 0.00 0.5799 Query 210: 0.3667 at 0.10 0.5078 0.6 Query 211: 0.7556 at 0.20 0.4636 Query 212: 0.0660 at 0.30 0.4066 Query 213: 0.5558 at 0.40 0.3838 Precision Query 214: 0.0000 at 0.50 0.3634 Query 215: 0.0139 at 0.60 0.3169 0.4 Query 217: 0.8347 at 0.70 0.2963 Query 218: 0.7339 at 0.80 0.2736 Query 219: 0.0015 at 0.90 0.2439 Query 221: 0.7903 at 1.00 0.2193 Query 222: 0.0034 0.2 Query 223: 0.1667 Avg. prec. (non-interpolated) Query 224: 1.0000 for all rel. documents Query 225: 1.0000 0.3532 Query 226: 0.1052 Precision: Query 228: 0.2327 At 5 docs: 0.3391 0.0 Query 229: 0.1751 At 10 docs: 0.2630 0.0 0.2 0.4 0.6 0.8 1.0 Query 230: 0.5051 At 15 docs: 0.2261 Query 231: 0.0837 At 20 docs: 0.1967 Recall Query 232: 0.0396 At 30 docs: 0.1558 Query 233: 0.6798 At 100 docs: 0.0678 Query 234: 0.0000 At 200 docs: 0.0393 Run IRn−MP−nexp Query 235: 0.0667 At 500 docs: 0.0188 Query 236: 0.5556 At 1000 docs: 0.0102 Comparison to median by topic Query 237: 1.0000 +1.0 Query 238: 0.0154 R-Precision (prec. after R Query 239: 0.1748 (=num_rel) docs. retrieved): Query 241: 0.0298 Exact: 0.3302 Query 242: 0.5005 Query 243: 0.1429 Query 244: 0.0556 +0.5 Query 245: 1.0000 Query 246: 0.0185 Query 247: 1.0000 Query 248: 0.5699 Query 249: 0.2557 Query 250: 0.0050 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Alicante, Monolingual Portuguese, Auto, TD Run IRn−MP−Pexp Average precision Overall statistics (individual queries): (for 46 queries): Recall−Precision Values 1.0 Query 201: 0.0190 Total number of documents Query 202: 0.4297 over all queries Query 203: 0.2478 Retrieved: 46000 Query 204: 0.4204 Relevant: 678 Query 205: 0.0595 Rel_ret: 497 0.8 Query 206: 0.4167 Query 207: 0.0426 Interpolated Recall - Query 208: 1.0000 Precision Averages: Query 209: 0.0342 at 0.00 0.5512 Query 210: 0.7332 at 0.10 0.5114 0.6 Query 211: 0.8302 at 0.20 0.4721 Query 212: 0.1330 at 0.30 0.4304 Query 213: 0.6254 at 0.40 0.4068 Precision Query 214: 0.0000 at 0.50 0.3816 Query 215: 0.0244 at 0.60 0.3544 0.4 Query 217: 0.9325 at 0.70 0.3291 Query 218: 0.6876 at 0.80 0.2929 Query 219: 0.0008 at 0.90 0.2633 Query 221: 0.8552 at 1.00 0.2354 Query 222: 0.0079 0.2 Query 223: 0.2500 Avg. prec. (non-interpolated) Query 224: 1.0000 for all rel. documents Query 225: 0.3333 0.3750 Query 226: 0.1613 Precision: Query 228: 0.3614 At 5 docs: 0.3739 0.0 Query 229: 0.2151 At 10 docs: 0.2870 0.0 0.2 0.4 0.6 0.8 1.0 Query 230: 0.5649 At 15 docs: 0.2261 Query 231: 0.0281 At 20 docs: 0.1978 Recall Query 232: 0.0511 At 30 docs: 0.1594 Query 233: 0.7045 At 100 docs: 0.0720 Query 234: 0.0000 At 200 docs: 0.0427 Run IRn−MP−Pexp Query 235: 0.1111 At 500 docs: 0.0196 Query 236: 0.7222 At 1000 docs: 0.0108 Comparison to median by topic Query 237: 1.0000 +1.0 Query 238: 0.0143 R-Precision (prec. after R Query 239: 0.1483 (=num_rel) docs. retrieved): Query 241: 0.0125 Exact: 0.3225 Query 242: 0.8088 Query 243: 0.1429 Query 244: 0.2500 +0.5 Query 245: 1.0000 Query 246: 0.0238 Query 247: 1.0000 Query 248: 0.7028 Query 249: 0.1335 Query 250: 0.0078 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Thomson Legal, Monolingual Portuguese, Auto, TD Run tlrpt1 Average precision Overall statistics (individual queries): (for 46 queries): Recall−Precision Values 1.0 Query 201: 0.0295 Total number of documents Query 202: 0.4328 over all queries Query 203: 0.2695 Retrieved: 46000 Query 204: 0.5495 Relevant: 678 Query 205: 0.5000 Rel_ret: 616 0.8 Query 206: 0.6667 Query 207: 0.2383 Interpolated Recall - Query 208: 1.0000 Precision Averages: Query 209: 0.0000 at 0.00 0.6021 Query 210: 0.4190 at 0.10 0.5979 0.6 Query 211: 0.8267 at 0.20 0.5505 Query 212: 0.1368 at 0.30 0.4922 Query 213: 0.6509 at 0.40 0.4826 Precision Query 214: 0.0042 at 0.50 0.4723 Query 215: 0.0455 at 0.60 0.4174 0.4 Query 217: 0.6738 at 0.70 0.4003 Query 218: 0.7513 at 0.80 0.3605 Query 219: 0.0071 at 0.90 0.3282 Query 221: 0.9151 at 1.00 0.3052 Query 222: 0.0193 0.2 Query 223: 0.5000 Avg. prec. (non-interpolated) Query 224: 1.0000 for all rel. documents Query 225: 1.0000 0.4458 Query 226: 0.9167 Precision: Query 228: 0.3557 At 5 docs: 0.3870 0.0 Query 229: 0.8013 At 10 docs: 0.2913 0.0 0.2 0.4 0.6 0.8 1.0 Query 230: 0.4529 At 15 docs: 0.2464 Query 231: 0.0300 At 20 docs: 0.2130 Recall Query 232: 0.0630 At 30 docs: 0.1775 Query 233: 0.5369 At 100 docs: 0.0857 Query 234: 0.0406 At 200 docs: 0.0539 Run tlrpt1 Query 235: 0.0263 At 500 docs: 0.0253 Query 236: 0.5000 At 1000 docs: 0.0134 Comparison to median by topic Query 237: 1.0000 +1.0 Query 238: 0.0400 R-Precision (prec. after R Query 239: 0.0933 (=num_rel) docs. retrieved): Query 241: 0.0701 Exact: 0.4017 Query 242: 0.8500 Query 243: 0.1111 Query 244: 0.0026 +0.5 Query 245: 1.0000 Query 246: 1.0000 Query 247: 1.0000 Query 248: 0.7496 Query 249: 0.1863 Query 250: 0.0446 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Thomson Legal, Monolingual Portuguese, Auto, TD Run tlrpt2 Average precision Overall statistics (individual queries): (for 46 queries): Recall−Precision Values 1.0 Query 201: 0.0343 Total number of documents Query 202: 0.4317 over all queries Query 203: 0.2695 Retrieved: 46000 Query 204: 0.5495 Relevant: 678 Query 205: 0.5000 Rel_ret: 616 0.8 Query 206: 0.6667 Query 207: 0.2383 Interpolated Recall - Query 208: 1.0000 Precision Averages: Query 209: 0.0000 at 0.00 0.6053 Query 210: 0.4377 at 0.10 0.6002 0.6 Query 211: 0.8267 at 0.20 0.5550 Query 212: 0.1393 at 0.30 0.4953 Query 213: 0.6509 at 0.40 0.4869 Precision Query 214: 0.0038 at 0.50 0.4735 Query 215: 0.0455 at 0.60 0.4211 0.4 Query 217: 0.6738 at 0.70 0.4049 Query 218: 0.7546 at 0.80 0.3624 Query 219: 0.0085 at 0.90 0.3323 Query 221: 0.9151 at 1.00 0.3085 Query 222: 0.0239 0.2 Query 223: 0.5000 Avg. prec. (non-interpolated) Query 224: 1.0000 for all rel. documents Query 225: 1.0000 0.4469 Query 226: 0.9167 Precision: Query 228: 0.3557 At 5 docs: 0.3913 0.0 Query 229: 0.8013 At 10 docs: 0.2935 0.0 0.2 0.4 0.6 0.8 1.0 Query 230: 0.4529 At 15 docs: 0.2464 Query 231: 0.0421 At 20 docs: 0.2098 Recall Query 232: 0.0647 At 30 docs: 0.1812 Query 233: 0.5369 At 100 docs: 0.0867 Query 234: 0.0489 At 200 docs: 0.0541 Run tlrpt2 Query 235: 0.0263 At 500 docs: 0.0253 Query 236: 0.5333 At 1000 docs: 0.0134 Comparison to median by topic Query 237: 1.0000 +1.0 Query 238: 0.0400 R-Precision (prec. after R Query 239: 0.0746 (=num_rel) docs. retrieved): Query 241: 0.0701 Exact: 0.4044 Query 242: 0.8500 Query 243: 0.1111 Query 244: 0.0026 +0.5 Query 245: 1.0000 Query 246: 1.0000 Query 247: 1.0000 Query 248: 0.7264 Query 249: 0.1891 Query 250: 0.0446 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Amsterdam, Monolingual Portuguese, Auto, TD Run UAmsC04PoPo4GiSb Average precision Overall statistics Recall−Precision Values (individual queries): (for 46 queries): 1.0 Query 201: 0.0146 Total number of documents Query 202: 0.7994 over all queries Query 203: 0.2342 Retrieved: 46000 Query 204: 0.8571 Relevant: 678 Query 205: 0.5909 Rel_ret: 605 0.8 Query 206: 0.8333 Query 207: 0.3349 Interpolated Recall - Query 208: 1.0000 Precision Averages: Query 209: 0.0348 at 0.00 0.5467 Query 210: 0.8509 at 0.10 0.5372 0.6 Query 211: 0.9328 at 0.20 0.5121 Query 212: 0.1517 at 0.30 0.4852 Query 213: 0.7426 at 0.40 0.4667 Precision Query 214: 0.0819 at 0.50 0.4489 Query 215: 0.1000 at 0.60 0.3897 0.4 Query 217: 0.0702 at 0.70 0.3555 Query 218: 0.8109 at 0.80 0.3389 Query 219: 0.1224 at 0.90 0.3015 Query 221: 0.8542 at 1.00 0.2666 Query 222: 0.0045 0.2 Query 223: 0.5000 Avg. prec. (non-interpolated) Query 224: 1.0000 for all rel. documents Query 225: 0.0833 0.4110 Query 226: 0.5012 Precision: Query 228: 0.4452 At 5 docs: 0.3565 0.0 Query 229: 0.5779 At 10 docs: 0.2804 0.0 0.2 0.4 0.6 0.8 1.0 Query 230: 0.3873 At 15 docs: 0.2464 Query 231: 0.0125 At 20 docs: 0.2174 Recall Query 232: 0.0360 At 30 docs: 0.1725 Query 233: 0.5322 At 100 docs: 0.0848 Query 234: 0.0711 At 200 docs: 0.0526 Run UAmsC04PoPo4GiSb Query 235: 0.0137 At 500 docs: 0.0253 Comparison to median by topic Query 236: 0.5536 At 1000 docs: 0.0132 Query 237: 1.0000 +1.0 Query 238: 0.0625 R-Precision (prec. after R Query 239: 0.1574 (=num_rel) docs. retrieved): Query 241: 0.0103 Exact: 0.3647 Query 242: 0.3500 Query 243: 0.0769 Query 244: 0.0132 +0.5 Query 245: 1.0000 Query 246: 0.3333 Query 247: 1.0000 Query 248: 0.5913 Query 249: 0.1440 Query 250: 0.0314 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Amsterdam, Monolingual Portuguese, Auto, TD Run UAmsC04PoPo4GiWd Average precision Overall statistics Recall−Precision Values (individual queries): (for 46 queries): 1.0 Query 201: 0.0085 Total number of documents Query 202: 0.8027 over all queries Query 203: 0.2394 Retrieved: 46000 Query 204: 0.8075 Relevant: 678 Query 205: 0.3167 Rel_ret: 595 0.8 Query 206: 0.6667 Query 207: 0.1986 Interpolated Recall - Query 208: 1.0000 Precision Averages: Query 209: 0.0278 at 0.00 0.5534 Query 210: 0.8833 at 0.10 0.5311 0.6 Query 211: 0.9333 at 0.20 0.5184 Query 212: 0.2149 at 0.30 0.5052 Query 213: 0.7459 at 0.40 0.4703 Precision Query 214: 0.0227 at 0.50 0.4494 Query 215: 0.0556 at 0.60 0.3991 0.4 Query 217: 0.8766 at 0.70 0.3719 Query 218: 0.8250 at 0.80 0.3476 Query 219: 0.2292 at 0.90 0.3094 Query 221: 0.8819 at 1.00 0.2768 Query 222: 0.0029 0.2 Query 223: 1.0000 Avg. prec. (non-interpolated) Query 224: 1.0000 for all rel. documents Query 225: 0.1111 0.4180 Query 226: 0.5012 Precision: Query 228: 0.4175 At 5 docs: 0.3565 0.0 Query 229: 0.5891 At 10 docs: 0.2957 0.0 0.2 0.4 0.6 0.8 1.0 Query 230: 0.4467 At 15 docs: 0.2507 Query 231: 0.0021 At 20 docs: 0.2130 Recall Query 232: 0.0071 At 30 docs: 0.1768 Query 233: 0.5463 At 100 docs: 0.0817 Query 234: 0.0046 At 200 docs: 0.0522 Run UAmsC04PoPo4GiWd Query 235: 0.0769 At 500 docs: 0.0248 Comparison to median by topic Query 236: 0.5873 At 1000 docs: 0.0129 Query 237: 0.5873 +1.0 Query 238: 0.0312 R-Precision (prec. after R Query 239: 0.1414 (=num_rel) docs. retrieved): Query 241: 0.0205 Exact: 0.3713 Query 242: 0.2264 Query 243: 0.0833 Query 244: 0.0833 +0.5 Query 245: 1.0000 Query 246: 0.3333 Query 247: 1.0000 Query 248: 0.5400 Query 249: 0.1024 Query 250: 0.0506 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Amsterdam, Monolingual Portuguese, Auto, TD Run UAmsC04PoPoAll Average precision Overall statistics Recall−Precision Values (individual queries): (for 46 queries): 1.0 Query 201: 0.0105 Total number of documents Query 202: 0.8166 over all queries Query 203: 0.2728 Retrieved: 46000 Query 204: 0.8857 Relevant: 678 Query 205: 0.3611 Rel_ret: 610 0.8 Query 206: 0.6667 Query 207: 0.2163 Interpolated Recall - Query 208: 1.0000 Precision Averages: Query 209: 0.0159 at 0.00 0.5827 Query 210: 0.8509 at 0.10 0.5638 0.6 Query 211: 0.9514 at 0.20 0.5345 Query 212: 0.2085 at 0.30 0.5008 Query 213: 0.7752 at 0.40 0.4827 Precision Query 214: 0.0519 at 0.50 0.4659 Query 215: 0.1667 at 0.60 0.4039 0.4 Query 217: 0.6782 at 0.70 0.3737 Query 218: 0.8533 at 0.80 0.3564 Query 219: 0.1294 at 0.90 0.3249 Query 221: 0.8774 at 1.00 0.2892 Query 222: 0.0038 0.2 Query 223: 0.5000 Avg. prec. (non-interpolated) Query 224: 1.0000 for all rel. documents Query 225: 0.2000 0.4326 Query 226: 0.5250 Precision: Query 228: 0.4795 At 5 docs: 0.4043 0.0 Query 229: 0.6324 At 10 docs: 0.3174 0.0 0.2 0.4 0.6 0.8 1.0 Query 230: 0.4509 At 15 docs: 0.2522 Query 231: 0.0092 At 20 docs: 0.2207 Recall Query 232: 0.0207 At 30 docs: 0.1790 Query 233: 0.5643 At 100 docs: 0.0870 Query 234: 0.0218 At 200 docs: 0.0540 Run UAmsC04PoPoAll Query 235: 0.0476 At 500 docs: 0.0254 Comparison to median by topic Query 236: 0.6095 At 1000 docs: 0.0133 Query 237: 1.0000 +1.0 Query 238: 0.0312 R-Precision (prec. after R Query 239: 0.1825 (=num_rel) docs. retrieved): Query 241: 0.0228 Exact: 0.3706 Query 242: 0.4083 Query 243: 0.1111 Query 244: 0.0204 +0.5 Query 245: 1.0000 Query 246: 0.3333 Query 247: 1.0000 Query 248: 0.6178 Query 249: 0.2759 Query 250: 0.0446 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Université de Neuchâtel, Monolingual Portuguese, Auto, TD Run UniNEpt1 Average precision Overall statistics (individual queries): (for 46 queries): Recall−Precision Values 1.0 Query 201: 0.0466 Total number of documents Query 202: 0.6865 over all queries Query 203: 0.3278 Retrieved: 46000 Query 204: 0.8044 Relevant: 678 Query 205: 0.6429 Rel_ret: 611 0.8 Query 206: 0.8333 Query 207: 0.2633 Interpolated Recall - Query 208: 1.0000 Precision Averages: Query 209: 0.0175 at 0.00 0.6586 Query 210: 0.8262 at 0.10 0.6319 0.6 Query 211: 0.9325 at 0.20 0.5947 Query 212: 0.3272 at 0.30 0.5549 Query 213: 0.6872 at 0.40 0.5364 Precision Query 214: 0.0066 at 0.50 0.5225 Query 215: 0.0714 at 0.60 0.4735 0.4 Query 217: 1.0000 at 0.70 0.4488 Query 218: 0.8405 at 0.80 0.4201 Query 219: 0.2436 at 0.90 0.3936 Query 221: 0.9762 at 1.00 0.3534 Query 222: 0.0409 0.2 Query 223: 1.0000 Avg. prec. (non-interpolated) Query 224: 1.0000 for all rel. documents Query 225: 0.2500 0.5004 Query 226: 0.9500 Precision: Query 228: 0.5512 At 5 docs: 0.4522 0.0 Query 229: 0.7751 At 10 docs: 0.3457 0.0 0.2 0.4 0.6 0.8 1.0 Query 230: 0.4431 At 15 docs: 0.2855 Query 231: 0.0051 At 20 docs: 0.2446 Recall Query 232: 0.1626 At 30 docs: 0.1928 Query 233: 0.8335 At 100 docs: 0.0909 Query 234: 0.2679 At 200 docs: 0.0542 Run UniNEpt1 Query 235: 0.0400 At 500 docs: 0.0256 Query 236: 0.8667 At 1000 docs: 0.0133 Comparison to median by topic Query 237: 1.0000 +1.0 Query 238: 0.0556 R-Precision (prec. after R Query 239: 0.1359 (=num_rel) docs. retrieved): Query 241: 0.0122 Exact: 0.4243 Query 242: 0.4409 Query 243: 0.1429 Query 244: 0.0012 +0.5 Query 245: 1.0000 Query 246: 0.5000 Query 247: 1.0000 Query 248: 0.7213 Query 249: 0.2719 Query 250: 0.0157 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Université de Neuchâtel, Monolingual Portuguese, Auto, TD Run UniNEpt2 Average precision Overall statistics (individual queries): (for 46 queries): Recall−Precision Values 1.0 Query 201: 0.0233 Total number of documents Query 202: 0.7243 over all queries Query 203: 0.2808 Retrieved: 46000 Query 204: 0.9367 Relevant: 678 Query 205: 0.6667 Rel_ret: 617 0.8 Query 206: 0.8333 Query 207: 0.2787 Interpolated Recall - Query 208: 1.0000 Precision Averages: Query 209: 0.0081 at 0.00 0.6584 Query 210: 0.7862 at 0.10 0.6348 0.6 Query 211: 0.9358 at 0.20 0.6167 Query 212: 0.3576 at 0.30 0.5841 Query 213: 0.8002 at 0.40 0.5691 Precision Query 214: 0.0081 at 0.50 0.5552 Query 215: 0.0588 at 0.60 0.4883 0.4 Query 217: 0.9683 at 0.70 0.4657 Query 218: 0.8420 at 0.80 0.4376 Query 219: 0.6111 at 0.90 0.3950 Query 221: 0.9583 at 1.00 0.3533 Query 222: 0.0581 0.2 Query 223: 1.0000 Avg. prec. (non-interpolated) Query 224: 1.0000 for all rel. documents Query 225: 0.0667 0.5105 Query 226: 0.5250 Precision: Query 228: 0.5618 At 5 docs: 0.4565 0.0 Query 229: 0.8232 At 10 docs: 0.3522 0.0 0.2 0.4 0.6 0.8 1.0 Query 230: 0.4486 At 15 docs: 0.2841 Query 231: 0.0066 At 20 docs: 0.2478 Recall Query 232: 0.1419 At 30 docs: 0.1964 Query 233: 0.8216 At 100 docs: 0.0928 Query 234: 0.5833 At 200 docs: 0.0555 Run UniNEpt2 Query 235: 0.1000 At 500 docs: 0.0255 Query 236: 0.8056 At 1000 docs: 0.0134 Comparison to median by topic Query 237: 1.0000 +1.0 Query 238: 0.0455 R-Precision (prec. after R Query 239: 0.1800 (=num_rel) docs. retrieved): Query 241: 0.0176 Exact: 0.4565 Query 242: 0.6838 Query 243: 0.3333 Query 244: 0.0018 +0.5 Query 245: 1.0000 Query 246: 0.3333 Query 247: 1.0000 Query 248: 0.7126 Query 249: 0.1508 Query 250: 0.0058 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Université de Neuchâtel, Monolingual Portuguese, Auto, TD Run UniNEpt3 Average precision Overall statistics (individual queries): (for 46 queries): Recall−Precision Values 1.0 Query 201: 0.0269 Total number of documents Query 202: 0.7639 over all queries Query 203: 0.3180 Retrieved: 46000 Query 204: 0.8121 Relevant: 678 Query 205: 0.6000 Rel_ret: 611 0.8 Query 206: 0.8333 Query 207: 0.2845 Interpolated Recall - Query 208: 1.0000 Precision Averages: Query 209: 0.0136 at 0.00 0.6701 Query 210: 0.9667 at 0.10 0.6467 0.6 Query 211: 0.9427 at 0.20 0.6143 Query 212: 0.3275 at 0.30 0.5726 Query 213: 0.7518 at 0.40 0.5605 Precision Query 214: 0.0120 at 0.50 0.5467 Query 215: 0.0476 at 0.60 0.4893 0.4 Query 217: 1.0000 at 0.70 0.4700 Query 218: 0.8679 at 0.80 0.4492 Query 219: 0.1625 at 0.90 0.4128 Query 221: 0.9444 at 1.00 0.3744 Query 222: 0.0629 0.2 Query 223: 1.0000 Avg. prec. (non-interpolated) Query 224: 1.0000 for all rel. documents Query 225: 0.2000 0.5188 Query 226: 0.8167 Precision: Query 228: 0.5514 At 5 docs: 0.4478 0.0 Query 229: 0.7466 At 10 docs: 0.3522 0.0 0.2 0.4 0.6 0.8 1.0 Query 230: 0.4527 At 15 docs: 0.2826 Query 231: 0.0046 At 20 docs: 0.2391 Recall Query 232: 0.1358 At 30 docs: 0.1949 Query 233: 0.7702 At 100 docs: 0.0907 Query 234: 1.0000 At 200 docs: 0.0540 Run UniNEpt3 Query 235: 0.0286 At 500 docs: 0.0250 Query 236: 0.7556 At 1000 docs: 0.0133 Comparison to median by topic Query 237: 1.0000 +1.0 Query 238: 0.0667 R-Precision (prec. after R Query 239: 0.0944 (=num_rel) docs. retrieved): Query 241: 0.0090 Exact: 0.4669 Query 242: 0.3930 Query 243: 0.1111 Query 244: 0.0015 +0.5 Query 245: 1.0000 Query 246: 1.0000 Query 247: 1.0000 Query 248: 0.6926 Query 249: 0.2685 Query 250: 0.0283 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number FCUL Lisbon, Monolingual Portuguese, Manual, missing Run XLDBTumba01 Average precision Overall statistics Recall−Precision Values (individual queries): (for 46 queries): 1.0 Query 201: 0.0000 Total number of documents Query 202: 0.1570 over all queries Query 203: 0.0405 Retrieved: 209 Query 204: 0.1667 Relevant: 678 Query 205: 0.6111 Rel_ret: 79 0.8 Query 206: 0.0000 Query 207: 0.1817 Interpolated Recall - Query 208: 0.6000 Precision Averages: Query 209: 0.0000 at 0.00 0.4738 Query 210: 0.0286 at 0.10 0.3578 0.6 Query 211: 0.2500 at 0.20 0.3578 Query 212: 0.4714 at 0.30 0.2928 Query 213: 0.0464 at 0.40 0.2717 Precision Query 214: 0.2205 at 0.50 0.2564 Query 215: 0.0000 at 0.60 0.1483 0.4 Query 217: 0.0000 at 0.70 0.1121 Query 218: 0.0476 at 0.80 0.1121 Query 219: 0.0000 at 0.90 0.1121 Query 221: 1.0000 at 1.00 0.1121 Query 222: 0.0000 0.2 Query 223: 0.0000 Avg. prec. (non-interpolated) Query 224: 0.0000 for all rel. documents Query 225: 1.0000 0.2184 Query 226: 0.2500 Precision: Query 228: 0.0510 At 5 docs: 0.2696 0.0 Query 229: 0.0026 At 10 docs: 0.1587 0.0 0.2 0.4 0.6 0.8 1.0 Query 230: 0.0256 At 15 docs: 0.1145 Query 231: 0.0000 At 20 docs: 0.0859 Recall Query 232: 0.0000 At 30 docs: 0.0572 Query 233: 0.0000 At 100 docs: 0.0172 Query 234: 0.5833 At 200 docs: 0.0086 Run XLDBTumba01 Query 235: 0.0000 At 500 docs: 0.0034 Comparison to median by topic Query 236: 0.5333 At 1000 docs: 0.0017 Query 237: 1.0000 +1.0 Query 238: 0.0000 R-Precision (prec. after R Query 239: 0.0000 (=num_rel) docs. retrieved): Query 241: 0.0259 Exact: 0.2241 Query 242: 0.2250 Query 243: 0.0000 Query 244: 0.0000 +0.5 Query 245: 0.5556 Query 246: 0.0000 Query 247: 0.5000 Query 248: 0.1400 Query 249: 0.5000 Query 250: 0.8333 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number FCUL Lisbon, Monolingual Portuguese, Manual, missing Run XLDBTumba02 Average precision Overall statistics Recall−Precision Values (individual queries): (for 46 queries): 1.0 Query 201: 0.0000 Total number of documents Query 202: 0.1667 over all queries Query 203: 0.1592 Retrieved: 2350 Query 204: 0.2517 Relevant: 678 Query 205: 0.0714 Rel_ret: 168 0.8 Query 206: 0.0000 Query 207: 0.4167 Interpolated Recall - Query 208: 1.0000 Precision Averages: Query 209: 0.0000 at 0.00 0.5677 Query 210: 0.0286 at 0.10 0.5054 0.6 Query 211: 0.5364 at 0.20 0.4216 Query 212: 0.4689 at 0.30 0.3363 Query 213: 0.0000 at 0.40 0.2922 Precision Query 214: 0.1547 at 0.50 0.2457 Query 215: 0.0000 at 0.60 0.2124 0.4 Query 217: 0.4275 at 0.70 0.1938 Query 218: 0.7416 at 0.80 0.1815 Query 219: 0.0000 at 0.90 0.1671 Query 221: 0.5812 at 1.00 0.1542 Query 222: 0.0000 0.2 Query 223: 1.0000 Avg. prec. (non-interpolated) Query 224: 0.0000 for all rel. documents Query 225: 1.0000 0.2810 Query 226: 0.3435 Precision: Query 228: 0.0154 At 5 docs: 0.2783 0.0 Query 229: 0.0026 At 10 docs: 0.2022 0.0 0.2 0.4 0.6 0.8 1.0 Query 230: 0.4200 At 15 docs: 0.1609 Query 231: 0.0000 At 20 docs: 0.1359 Recall Query 232: 0.0737 At 30 docs: 0.0978 Query 233: 0.2902 At 100 docs: 0.0354 Query 234: 0.2679 At 200 docs: 0.0183 Run XLDBTumba02 Query 235: 0.0000 At 500 docs: 0.0073 Comparison to median by topic Query 236: 0.5333 At 1000 docs: 0.0037 Query 237: 1.0000 +1.0 Query 238: 0.0000 R-Precision (prec. after R Query 239: 0.0123 (=num_rel) docs. retrieved): Query 241: 0.0175 Exact: 0.2628 Query 242: 0.5469 Query 243: 0.0357 Query 244: 0.0000 +0.5 Query 245: 1.0000 Query 246: 0.3333 Query 247: 0.3750 Query 248: 0.2750 Query 249: 0.3344 Query 250: 0.0435 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number FCUL Lisbon, Monolingual Portuguese, Manual, missing Run XLDBTumba04 Average precision Overall statistics Recall−Precision Values (individual queries): (for 46 queries): 1.0 Query 201: 0.0000 Total number of documents Query 202: 0.1556 over all queries Query 203: 0.1430 Retrieved: 2350 Query 204: 0.2517 Relevant: 678 Query 205: 0.2500 Rel_ret: 168 0.8 Query 206: 0.0000 Query 207: 0.3375 Interpolated Recall - Query 208: 1.0000 Precision Averages: Query 209: 0.0000 at 0.00 0.5532 Query 210: 0.0286 at 0.10 0.4689 0.6 Query 211: 0.5036 at 0.20 0.3996 Query 212: 0.3282 at 0.30 0.3614 Query 213: 0.0000 at 0.40 0.3064 Precision Query 214: 0.0488 at 0.50 0.2561 Query 215: 0.0000 at 0.60 0.2081 0.4 Query 217: 0.4110 at 0.70 0.1918 Query 218: 0.8040 at 0.80 0.1794 Query 219: 0.0000 at 0.90 0.1670 Query 221: 0.6416 at 1.00 0.1545 Query 222: 0.0000 0.2 Query 223: 0.2000 Avg. prec. (non-interpolated) Query 224: 0.0000 for all rel. documents Query 225: 1.0000 0.2775 Query 226: 0.4050 Precision: Query 228: 0.0176 At 5 docs: 0.2957 0.0 Query 229: 0.0026 At 10 docs: 0.2087 0.0 0.2 0.4 0.6 0.8 1.0 Query 230: 0.4200 At 15 docs: 0.1638 Query 231: 0.0000 At 20 docs: 0.1326 Recall Query 232: 0.0737 At 30 docs: 0.1007 Query 233: 0.2902 At 100 docs: 0.0359 Query 234: 0.2679 At 200 docs: 0.0183 Run XLDBTumba04 Query 235: 0.0000 At 500 docs: 0.0073 Comparison to median by topic Query 236: 0.7000 At 1000 docs: 0.0037 Query 237: 1.0000 +1.0 Query 238: 0.0000 R-Precision (prec. after R Query 239: 0.0123 (=num_rel) docs. retrieved): Query 241: 0.0669 Exact: 0.2726 Query 242: 0.5469 Query 243: 0.0357 Query 244: 0.0000 +0.5 Query 245: 1.0000 Query 246: 1.0000 Query 247: 0.3750 Query 248: 0.2750 Query 249: 0.1271 Query 250: 0.0435 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number FCUL Lisbon, Monolingual Portuguese, Manual, missing Run XLDBTumba05 Average precision Overall statistics Recall−Precision Values (individual queries): (for 46 queries): 1.0 Query 201: 0.0000 Total number of documents Query 202: 0.0648 over all queries Query 203: 0.0962 Retrieved: 2350 Query 204: 0.1374 Relevant: 678 Query 205: 0.2500 Rel_ret: 168 0.8 Query 206: 0.0000 Query 207: 0.3375 Interpolated Recall - Query 208: 1.0000 Precision Averages: Query 209: 0.0000 at 0.00 0.4694 Query 210: 0.0222 at 0.10 0.4101 0.6 Query 211: 0.4391 at 0.20 0.3716 Query 212: 0.4571 at 0.30 0.3397 Query 213: 0.0000 at 0.40 0.2854 Precision Query 214: 0.0576 at 0.50 0.2508 Query 215: 0.0000 at 0.60 0.1989 0.4 Query 217: 0.3608 at 0.70 0.1787 Query 218: 0.7852 at 0.80 0.1663 Query 219: 0.0000 at 0.90 0.1538 Query 221: 0.4957 at 1.00 0.1412 Query 222: 0.0000 0.2 Query 223: 0.1667 Avg. prec. (non-interpolated) Query 224: 0.0000 for all rel. documents Query 225: 1.0000 0.2513 Query 226: 0.1758 Precision: Query 228: 0.0154 At 5 docs: 0.2565 0.0 Query 229: 0.0026 At 10 docs: 0.1870 0.0 0.2 0.4 0.6 0.8 1.0 Query 230: 0.1409 At 15 docs: 0.1406 Query 231: 0.0000 At 20 docs: 0.1185 Recall Query 232: 0.0368 At 30 docs: 0.0899 Query 233: 0.1322 At 100 docs: 0.0352 Query 234: 0.4167 At 200 docs: 0.0183 Run XLDBTumba05 Query 235: 0.0000 At 500 docs: 0.0073 Comparison to median by topic Query 236: 0.7000 At 1000 docs: 0.0037 Query 237: 1.0000 +1.0 Query 238: 0.0000 R-Precision (prec. after R Query 239: 0.0123 (=num_rel) docs. retrieved): Query 241: 0.0519 Exact: 0.2673 Query 242: 0.5469 Query 243: 0.0345 Query 244: 0.0000 +0.5 Query 245: 0.7222 Query 246: 1.0000 Query 247: 0.3750 Query 248: 0.2100 Query 249: 0.0570 Query 250: 0.2579 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number JHU/APL, Monolingual Russian, Auto, TD Run aplmorua Average precision Overall statistics (individual queries): (for 34 queries): Recall−Precision Values 1.0 Query 201: 0.0097 Total number of documents Query 202: 0.2619 over all queries Query 203: 0.0040 Retrieved: 34000 Query 207: 0.0000 Relevant: 123 Query 209: 0.8333 Rel_ret: 98 0.8 Query 210: 0.4446 Query 211: 1.0000 Interpolated Recall - Query 212: 0.2109 Precision Averages: Query 213: 0.4278 at 0.00 0.4481 Query 214: 0.1151 at 0.10 0.4448 0.6 Query 215: 0.3333 at 0.20 0.4289 Query 216: 0.0357 at 0.30 0.3900 Query 218: 0.2500 at 0.40 0.3487 Precision Query 220: 0.0272 at 0.50 0.3394 Query 221: 0.3167 at 0.60 0.2526 0.4 Query 224: 0.1000 at 0.70 0.2003 Query 225: 0.5436 at 0.80 0.1926 Query 226: 0.5000 at 0.90 0.1778 Query 227: 0.1250 at 1.00 0.1766 Query 228: 0.0052 0.2 Query 230: 0.3818 Avg. prec. (non-interpolated) Query 231: 0.5000 for all rel. documents Query 232: 0.0440 0.2974 Query 233: 0.0878 Precision: Query 234: 0.0492 At 5 docs: 0.1882 0.0 Query 235: 0.0367 At 10 docs: 0.1353 0.0 0.2 0.4 0.6 0.8 1.0 Query 237: 0.4167 At 15 docs: 0.1059 Query 238: 1.0000 At 20 docs: 0.0838 Recall Query 239: 0.6754 At 30 docs: 0.0647 Query 241: 0.1261 At 100 docs: 0.0235 Query 242: 0.0345 At 200 docs: 0.0129 Run aplmorua Query 244: 1.0000 At 500 docs: 0.0055 Query 245: 0.1157 At 1000 docs: 0.0029 Comparison to median by topic Query 250: 0.1000 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.2472 +0.5 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number JHU/APL, Monolingual Russian, Auto, TD Run aplmorub Average precision Overall statistics (individual queries): (for 34 queries): Recall−Precision Values 1.0 Query 201: 0.0108 Total number of documents Query 202: 0.0806 over all queries Query 203: 0.0063 Retrieved: 34000 Query 207: 0.0000 Relevant: 123 Query 209: 1.0000 Rel_ret: 100 0.8 Query 210: 0.4410 Query 211: 1.0000 Interpolated Recall - Query 212: 0.3934 Precision Averages: Query 213: 0.3077 at 0.00 0.4554 Query 214: 0.1111 at 0.10 0.4517 0.6 Query 215: 1.0000 at 0.20 0.4237 Query 216: 0.0109 at 0.30 0.3835 Query 218: 0.2500 at 0.40 0.3457 Precision Query 220: 0.0470 at 0.50 0.3342 Query 221: 0.3214 at 0.60 0.2751 0.4 Query 224: 0.1250 at 0.70 0.2256 Query 225: 0.4874 at 0.80 0.2148 Query 226: 0.5000 at 0.90 0.2082 Query 227: 0.0132 at 1.00 0.2059 Query 228: 0.0036 0.2 Query 230: 0.3277 Avg. prec. (non-interpolated) Query 231: 1.0000 for all rel. documents Query 232: 0.0533 0.3076 Query 233: 0.0969 Precision: Query 234: 0.0019 At 5 docs: 0.1706 0.0 Query 235: 0.0244 At 10 docs: 0.1206 0.0 0.2 0.4 0.6 0.8 1.0 Query 237: 0.3750 At 15 docs: 0.0941 Query 238: 0.2000 At 20 docs: 0.0809 Recall Query 239: 0.6466 At 30 docs: 0.0608 Query 241: 0.1568 At 100 docs: 0.0241 Query 242: 0.0400 At 200 docs: 0.0132 Run aplmorub Query 244: 1.0000 At 500 docs: 0.0056 Query 245: 0.0939 At 1000 docs: 0.0029 Comparison to median by topic Query 250: 0.3333 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.2683 +0.5 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number JHU/APL, Monolingual Russian, Auto, TD Run aplmoruc Average precision Overall statistics (individual queries): (for 34 queries): Recall−Precision Values 1.0 Query 201: 0.0128 Total number of documents Query 202: 0.0026 over all queries Query 203: 0.0046 Retrieved: 34000 Query 207: 0.0000 Relevant: 123 Query 209: 1.0000 Rel_ret: 97 0.8 Query 210: 0.4635 Query 211: 1.0000 Interpolated Recall - Query 212: 0.2988 Precision Averages: Query 213: 0.2644 at 0.00 0.4031 Query 214: 0.1191 at 0.10 0.3998 0.6 Query 215: 1.0000 at 0.20 0.3753 Query 216: 0.0063 at 0.30 0.3211 Query 218: 0.2500 at 0.40 0.2896 Precision Query 220: 0.0401 at 0.50 0.2842 Query 221: 0.3125 at 0.60 0.2196 0.4 Query 224: 0.1667 at 0.70 0.1839 Query 225: 0.4833 at 0.80 0.1726 Query 226: 0.0263 at 0.90 0.1671 Query 227: 0.0167 at 1.00 0.1665 Query 228: 0.0022 0.2 Query 230: 0.4022 Avg. prec. (non-interpolated) Query 231: 0.5000 for all rel. documents Query 232: 0.0287 0.2605 Query 233: 0.0648 Precision: Query 234: 0.0016 At 5 docs: 0.1412 0.0 Query 235: 0.0131 At 10 docs: 0.1029 0.0 0.2 0.4 0.6 0.8 1.0 Query 237: 0.2812 At 15 docs: 0.0804 Query 238: 0.1250 At 20 docs: 0.0706 Recall Query 239: 0.6917 At 30 docs: 0.0569 Query 241: 0.0936 At 100 docs: 0.0218 Query 242: 0.0417 At 200 docs: 0.0125 Run aplmoruc Query 244: 1.0000 At 500 docs: 0.0054 Query 245: 0.1037 At 1000 docs: 0.0029 Comparison to median by topic Query 250: 0.0400 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.2309 +0.5 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number UC Berkeley, Monolingual Russian, Auto, TD Run BKRUMLRR1 Average precision Overall statistics Recall−Precision Values (individual queries): (for 34 queries): 1.0 Query 201: 0.0260 Total number of documents Query 202: 0.0232 over all queries Query 203: 1.0000 Retrieved: 34000 Query 207: 0.0000 Relevant: 123 0.8 Query 209: 0.7500 Rel_ret: 105 Query 210: 0.4316 Query 211: 1.0000 Interpolated Recall - Query 212: 0.8016 Precision Averages: Query 213: 0.3570 at 0.00 0.5734 Query 214: 0.1144 at 0.10 0.5636 0.6 Query 215: 1.0000 at 0.20 0.5506 Query 216: 0.0455 at 0.30 0.4969 Query 218: 0.2500 at 0.40 0.4670 Precision Query 220: 0.0032 at 0.50 0.4526 Query 221: 0.2917 at 0.60 0.3628 0.4 Query 224: 0.0874 at 0.70 0.2989 Query 225: 0.6389 at 0.80 0.2839 Query 226: 1.0000 at 0.90 0.2555 Query 227: 0.2500 at 1.00 0.2548 Query 228: 0.0029 0.2 Query 230: 0.3446 Avg. prec. (non-interpolated) Query 231: 1.0000 for all rel. documents Query 232: 0.0538 0.4024 Query 233: 0.2068 Precision: Query 234: 0.0276 At 5 docs: 0.2000 0.0 Query 235: 0.0455 At 10 docs: 0.1353 0.0 0.2 0.4 0.6 0.8 1.0 Query 237: 0.3500 At 15 docs: 0.1137 Query 238: 1.0000 At 20 docs: 0.0912 Recall Query 239: 0.5801 At 30 docs: 0.0647 Query 241: 0.1891 At 100 docs: 0.0235 Query 242: 0.0526 At 200 docs: 0.0129 Run BKRUMLRR1 Query 244: 1.0000 At 500 docs: 0.0059 Comparison to median by topic Query 245: 0.6667 At 1000 docs: 0.0031 Query 250: 0.0909 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.4013 +0.5 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number UC Berkeley, Monolingual Russian, Auto, TDN Run BKRUMLRR2 Average precision Overall statistics Recall−Precision Values (individual queries): (for 34 queries): 1.0 Query 201: 0.0241 Total number of documents Query 202: 0.0145 over all queries Query 203: 0.0909 Retrieved: 34000 Query 207: 0.0000 Relevant: 123 0.8 Query 209: 1.0000 Rel_ret: 108 Query 210: 0.3685 Query 211: 1.0000 Interpolated Recall - Query 212: 0.4122 Precision Averages: Query 213: 0.3521 at 0.00 0.5856 Query 214: 0.1071 at 0.10 0.5688 0.6 Query 215: 1.0000 at 0.20 0.5394 Query 216: 0.5000 at 0.30 0.4871 Query 218: 0.2500 at 0.40 0.4465 Precision Query 220: 0.0630 at 0.50 0.4459 Query 221: 0.8333 at 0.60 0.3619 0.4 Query 224: 0.0466 at 0.70 0.3175 Query 225: 0.5667 at 0.80 0.3061 Query 226: 1.0000 at 0.90 0.2573 Query 227: 0.2500 at 1.00 0.2555 Query 228: 0.0074 0.2 Query 230: 0.3081 Avg. prec. (non-interpolated) Query 231: 1.0000 for all rel. documents Query 232: 0.2611 0.4005 Query 233: 0.2637 Precision: Query 234: 0.0513 At 5 docs: 0.2059 0.0 Query 235: 0.0789 At 10 docs: 0.1500 0.0 0.2 0.4 0.6 0.8 1.0 Query 237: 0.3056 At 15 docs: 0.1216 Query 238: 1.0000 At 20 docs: 0.1000 Recall Query 239: 0.8213 At 30 docs: 0.0706 Query 241: 0.1888 At 100 docs: 0.0256 Query 242: 0.0625 At 200 docs: 0.0146 Run BKRUMLRR2 Query 244: 1.0000 At 500 docs: 0.0062 Comparison to median by topic Query 245: 0.2778 At 1000 docs: 0.0032 Query 250: 0.1111 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.3794 +0.5 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number CLIPS, Monolingual Russian, Auto, TDN Run CLIPS04MNRU1 Average precision Overall statistics Recall−Precision Values (individual queries): (for 34 queries): 1.0 Query 201: 0.0329 Total number of documents Query 202: 0.1320 over all queries Query 203: 1.0000 Retrieved: 34000 Query 207: 0.0000 Relevant: 123 Query 209: 0.8333 Rel_ret: 103 0.8 Query 210: 0.3492 Query 211: 1.0000 Interpolated Recall - Query 212: 0.4812 Precision Averages: Query 213: 0.4316 at 0.00 0.5768 Query 214: 0.0053 at 0.10 0.5768 0.6 Query 215: 1.0000 at 0.20 0.5244 Query 216: 0.0033 at 0.30 0.4574 Query 218: 0.0625 at 0.40 0.4020 Precision Query 220: 0.0363 at 0.50 0.3956 Query 221: 0.5526 at 0.60 0.3057 0.4 Query 224: 0.0008 at 0.70 0.2295 Query 225: 0.5694 at 0.80 0.2132 Query 226: 0.0714 at 0.90 0.2054 Query 227: 0.5000 at 1.00 0.2046 Query 228: 0.0152 0.2 Query 230: 0.4095 Avg. prec. (non-interpolated) Query 231: 0.0256 for all rel. documents Query 232: 0.1943 0.3550 Query 233: 0.2073 Precision: Query 234: 0.3578 At 5 docs: 0.2000 0.0 Query 235: 0.4000 At 10 docs: 0.1382 0.0 0.2 0.4 0.6 0.8 1.0 Query 237: 0.3500 At 15 docs: 0.1000 Query 238: 1.0000 At 20 docs: 0.0853 Recall Query 239: 0.3336 At 30 docs: 0.0588 Query 241: 0.1800 At 100 docs: 0.0250 Query 242: 0.0333 At 200 docs: 0.0143 Run CLIPS04MNRU1 Query 244: 1.0000 At 500 docs: 0.0058 Comparison to median by topic Query 245: 0.0026 At 1000 docs: 0.0030 Query 250: 0.5000 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.3119 +0.5 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Dublin City University, Monolingual Russian, Auto, TD Run exerussmono04a Average precision Overall statistics Recall−Precision Values (individual queries): (for 34 queries): 1.0 Query 201: 0.0226 Total number of documents Query 202: 0.0708 over all queries Query 203: 1.0000 Retrieved: 34000 Query 207: 0.0000 Relevant: 123 0.8 Query 209: 0.8333 Rel_ret: 101 Query 210: 0.4247 Query 211: 1.0000 Interpolated Recall - Query 212: 0.5045 Precision Averages: Query 213: 0.2776 at 0.00 0.5199 Query 214: 0.0238 at 0.10 0.5134 0.6 Query 215: 1.0000 at 0.20 0.5060 Query 216: 0.0227 at 0.30 0.4503 Query 218: 0.2500 at 0.40 0.3857 Precision Query 220: 0.0086 at 0.50 0.3788 Query 221: 0.2675 at 0.60 0.2960 0.4 Query 224: 0.0594 at 0.70 0.2519 Query 225: 0.4515 at 0.80 0.2464 Query 226: 0.1667 at 0.90 0.2271 Query 227: 0.5000 at 1.00 0.2266 Query 228: 0.0050 0.2 Query 230: 0.3546 Avg. prec. (non-interpolated) Query 231: 0.5000 for all rel. documents Query 232: 0.0800 0.3495 Query 233: 0.2527 Precision: Query 234: 0.0955 At 5 docs: 0.1765 0.0 Query 235: 0.0604 At 10 docs: 0.1324 0.0 0.2 0.4 0.6 0.8 1.0 Query 237: 0.2500 At 15 docs: 0.1020 Query 238: 1.0000 At 20 docs: 0.0853 Recall Query 239: 0.3073 At 30 docs: 0.0647 Query 241: 0.1671 At 100 docs: 0.0247 Query 242: 0.0455 At 200 docs: 0.0138 Run exerussmono04a Query 244: 1.0000 At 500 docs: 0.0058 Comparison to median by topic Query 245: 0.3810 At 1000 docs: 0.0030 Query 250: 0.5000 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.3100 +0.5 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Dublin City University, Monolingual Russian, Auto, TD Run exerussmono04l Average precision Overall statistics Recall−Precision Values (individual queries): (for 34 queries): 1.0 Query 201: 0.0222 Total number of documents Query 202: 0.0307 over all queries Query 203: 1.0000 Retrieved: 34000 Query 207: 0.0000 Relevant: 123 Query 209: 0.8333 Rel_ret: 101 0.8 Query 210: 0.3852 Query 211: 1.0000 Interpolated Recall - Query 212: 0.7347 Precision Averages: Query 213: 0.2875 at 0.00 0.5352 Query 214: 0.0123 at 0.10 0.5352 0.6 Query 215: 1.0000 at 0.20 0.5279 Query 216: 0.0096 at 0.30 0.4678 Query 218: 0.2500 at 0.40 0.4048 Precision Query 220: 0.0102 at 0.50 0.3949 Query 221: 0.2685 at 0.60 0.3050 0.4 Query 224: 0.0596 at 0.70 0.2642 Query 225: 0.4505 at 0.80 0.2566 Query 226: 0.5000 at 0.90 0.2338 Query 227: 0.5000 at 1.00 0.2333 Query 228: 0.0056 0.2 Query 230: 0.3557 Avg. prec. (non-interpolated) Query 231: 0.5000 for all rel. documents Query 232: 0.0787 0.3628 Query 233: 0.2544 Precision: Query 234: 0.0805 At 5 docs: 0.1765 0.0 Query 235: 0.0684 At 10 docs: 0.1353 0.0 0.2 0.4 0.6 0.8 1.0 Query 237: 0.2500 At 15 docs: 0.1039 Query 238: 1.0000 At 20 docs: 0.0838 Recall Query 239: 0.2999 At 30 docs: 0.0627 Query 241: 0.1662 At 100 docs: 0.0250 Query 242: 0.0500 At 200 docs: 0.0137 Run exerussmono04l Query 244: 1.0000 At 500 docs: 0.0058 Comparison to median by topic Query 245: 0.3704 At 1000 docs: 0.0030 Query 250: 0.5000 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.3085 +0.5 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Dublin City University, Monolingual Russian, Auto, TD Run exerussmono04q Average precision Overall statistics (individual queries): (for 34 queries): Recall−Precision Values 1.0 Query 201: 0.0237 Total number of documents Query 202: 0.0321 over all queries Query 203: 1.0000 Retrieved: 34000 Query 207: 0.0000 Relevant: 123 Query 209: 0.8333 Rel_ret: 101 0.8 Query 210: 0.4247 Query 211: 1.0000 Interpolated Recall - Query 212: 0.7467 Precision Averages: Query 213: 0.2782 at 0.00 0.5472 Query 214: 0.0303 at 0.10 0.5472 0.6 Query 215: 1.0000 at 0.20 0.5392 Query 216: 0.1667 at 0.30 0.4824 Query 218: 0.2500 at 0.40 0.4324 Precision Query 220: 0.0091 at 0.50 0.4075 Query 221: 0.2616 at 0.60 0.3052 0.4 Query 224: 0.0524 at 0.70 0.2642 Query 225: 0.4514 at 0.80 0.2591 Query 226: 0.5000 at 0.90 0.2377 Query 227: 0.5000 at 1.00 0.2358 Query 228: 0.0055 0.2 Query 230: 0.3584 Avg. prec. (non-interpolated) Query 231: 0.5000 for all rel. documents Query 232: 0.0874 0.3717 Query 233: 0.2557 Precision: Query 234: 0.1807 At 5 docs: 0.2000 0.0 Query 235: 0.0662 At 10 docs: 0.1382 0.0 0.2 0.4 0.6 0.8 1.0 Query 237: 0.2500 At 15 docs: 0.1059 Query 238: 1.0000 At 20 docs: 0.0868 Recall Query 239: 0.4774 At 30 docs: 0.0637 Query 241: 0.1461 At 100 docs: 0.0247 Query 242: 0.0435 At 200 docs: 0.0140 Run exerussmono04q Query 244: 1.0000 At 500 docs: 0.0058 Query 245: 0.2083 At 1000 docs: 0.0030 Comparison to median by topic Query 250: 0.5000 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.3100 +0.5 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Dublin City University, Monolingual Russian, Auto, TD Run exerussmono04t1 Average precision Overall statistics Recall−Precision Values (individual queries): (for 34 queries): 1.0 Query 201: 0.0218 Total number of documents Query 202: 0.0593 over all queries Query 203: 1.0000 Retrieved: 34000 Query 207: 0.0000 Relevant: 123 0.8 Query 209: 0.8333 Rel_ret: 101 Query 210: 0.4247 Query 211: 1.0000 Interpolated Recall - Query 212: 0.7315 Precision Averages: Query 213: 0.2743 at 0.00 0.5694 Query 214: 0.0256 at 0.10 0.5682 0.6 Query 215: 1.0000 at 0.20 0.5682 Query 216: 0.0263 at 0.30 0.5027 Query 218: 0.2500 at 0.40 0.4121 Precision Query 220: 0.0078 at 0.50 0.4018 Query 221: 0.2602 at 0.60 0.3048 0.4 Query 224: 0.0595 at 0.70 0.2689 Query 225: 0.4353 at 0.80 0.2631 Query 226: 0.2500 at 0.90 0.2419 Query 227: 0.5000 at 1.00 0.2409 Query 228: 0.0032 0.2 Query 230: 0.3886 Avg. prec. (non-interpolated) Query 231: 1.0000 for all rel. documents Query 232: 0.0910 0.3790 Query 233: 0.2529 Precision: Query 234: 0.3947 At 5 docs: 0.2000 0.0 Query 235: 0.0621 At 10 docs: 0.1294 0.0 0.2 0.4 0.6 0.8 1.0 Query 237: 0.2500 At 15 docs: 0.1020 Query 238: 1.0000 At 20 docs: 0.0882 Recall Query 239: 0.1990 At 30 docs: 0.0637 Query 241: 0.1682 At 100 docs: 0.0247 Query 242: 0.0476 At 200 docs: 0.0137 Run exerussmono04t1 Query 244: 1.0000 At 500 docs: 0.0059 Comparison to median by topic Query 245: 0.3704 At 1000 docs: 0.0030 Query 250: 0.5000 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.3492 +0.5 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Hummingbird, Monolingual Russian, Auto, T Run humRU04t Average precision Overall statistics Recall−Precision Values (individual queries): (for 34 queries): 1.0 Query 201: 0.0137 Total number of documents Query 202: 0.2125 over all queries Query 203: 1.0000 Retrieved: 20895 Query 207: 0.0000 Relevant: 123 Query 209: 0.7500 Rel_ret: 91 0.8 Query 210: 0.5923 Query 211: 1.0000 Interpolated Recall - Query 212: 0.7483 Precision Averages: Query 213: 0.1312 at 0.00 0.6457 Query 214: 0.0000 at 0.10 0.6425 0.6 Query 215: 1.0000 at 0.20 0.6425 Query 216: 0.5000 at 0.30 0.5922 Query 218: 0.2500 at 0.40 0.5259 Precision Query 220: 0.0123 at 0.50 0.4813 Query 221: 0.2647 at 0.60 0.3464 0.4 Query 224: 0.1025 at 0.70 0.2677 Query 225: 0.4030 at 0.80 0.2514 Query 226: 1.0000 at 0.90 0.2510 Query 227: 0.5000 at 1.00 0.2502 Query 228: 0.0072 0.2 Query 230: 0.4205 Avg. prec. (non-interpolated) Query 231: 1.0000 for all rel. documents Query 232: 0.0696 0.4298 Query 233: 0.1928 Precision: Query 234: 0.3333 At 5 docs: 0.2294 0.0 Query 235: 0.5000 At 10 docs: 0.1382 0.0 0.2 0.4 0.6 0.8 1.0 Query 237: 0.3500 At 15 docs: 0.1059 Query 238: 0.0000 At 20 docs: 0.0824 Recall Query 239: 0.4737 At 30 docs: 0.0578 Query 241: 0.1175 At 100 docs: 0.0218 Query 242: 0.0000 At 200 docs: 0.0122 Run humRU04t Query 244: 1.0000 At 500 docs: 0.0053 Comparison to median by topic Query 245: 0.6667 At 1000 docs: 0.0027 Query 250: 1.0000 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.4134 +0.5 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Hummingbird, Monolingual Russian, Auto, TD Run humRU04td Average precision Overall statistics Recall−Precision Values (individual queries): (for 34 queries): 1.0 Query 201: 0.0181 Total number of documents Query 202: 0.9167 over all queries Query 203: 1.0000 Retrieved: 34000 Query 207: 0.0000 Relevant: 123 Query 209: 0.8333 Rel_ret: 101 0.8 Query 210: 0.5814 Query 211: 1.0000 Interpolated Recall - Query 212: 0.4768 Precision Averages: Query 213: 0.3769 at 0.00 0.6159 Query 214: 0.0222 at 0.10 0.6159 0.6 Query 215: 1.0000 at 0.20 0.6065 Query 216: 0.5000 at 0.30 0.5652 Query 218: 0.2500 at 0.40 0.4886 Precision Query 220: 0.0120 at 0.50 0.4680 Query 221: 0.5213 at 0.60 0.3196 0.4 Query 224: 0.1014 at 0.70 0.2689 Query 225: 0.4484 at 0.80 0.2517 Query 226: 0.5000 at 0.90 0.2356 Query 227: 0.5000 at 1.00 0.2349 Query 228: 0.0303 0.2 Query 230: 0.3441 Avg. prec. (non-interpolated) Query 231: 1.0000 for all rel. documents Query 232: 0.0474 0.4094 Query 233: 0.1793 Precision: Query 234: 0.0358 At 5 docs: 0.2353 0.0 Query 235: 0.0476 At 10 docs: 0.1412 0.0 0.2 0.4 0.6 0.8 1.0 Query 237: 0.4167 At 15 docs: 0.1059 Query 238: 0.5000 At 20 docs: 0.0824 Recall Query 239: 0.5079 At 30 docs: 0.0578 Query 241: 0.0939 At 100 docs: 0.0221 Query 242: 0.0156 At 200 docs: 0.0128 Run humRU04td Query 244: 1.0000 At 500 docs: 0.0058 Comparison to median by topic Query 245: 0.3939 At 1000 docs: 0.0030 Query 250: 0.2500 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.3435 +0.5 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Hummingbird, Monolingual Russian, Auto, TD Run humRU04tde Average precision Overall statistics Recall−Precision Values (individual queries): (for 34 queries): 1.0 Query 201: 0.0161 Total number of documents Query 202: 1.0000 over all queries Query 203: 0.5000 Retrieved: 34000 Query 207: 0.0000 Relevant: 123 Query 209: 0.8333 Rel_ret: 101 0.8 Query 210: 0.6133 Query 211: 1.0000 Interpolated Recall - Query 212: 0.8857 Precision Averages: Query 213: 0.3893 at 0.00 0.6139 Query 214: 0.0222 at 0.10 0.6104 0.6 Query 215: 1.0000 at 0.20 0.6077 Query 216: 0.5000 at 0.30 0.5675 Query 218: 0.2500 at 0.40 0.5211 Precision Query 220: 0.0186 at 0.50 0.5207 Query 221: 0.7500 at 0.60 0.3903 0.4 Query 224: 0.1262 at 0.70 0.3259 Query 225: 0.5806 at 0.80 0.3002 Query 226: 0.5000 at 0.90 0.2801 Query 227: 0.5000 at 1.00 0.2782 Query 228: 0.0526 0.2 Query 230: 0.3340 Avg. prec. (non-interpolated) Query 231: 1.0000 for all rel. documents Query 232: 0.0654 0.4431 Query 233: 0.2002 Precision: Query 234: 0.0130 At 5 docs: 0.2529 0.0 Query 235: 0.0344 At 10 docs: 0.1529 0.0 0.2 0.4 0.6 0.8 1.0 Query 237: 0.4167 At 15 docs: 0.1176 Query 238: 1.0000 At 20 docs: 0.0941 Recall Query 239: 0.6874 At 30 docs: 0.0637 Query 241: 0.1169 At 100 docs: 0.0235 Query 242: 0.0526 At 200 docs: 0.0138 Run humRU04tde Query 244: 1.0000 At 500 docs: 0.0058 Comparison to median by topic Query 245: 0.4074 At 1000 docs: 0.0030 Query 250: 0.2000 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.3908 +0.5 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Padua, Monolingual Russian, Auto, TD Run IMSMRUN Average precision Overall statistics Recall−Precision Values (individual queries): (for 34 queries): 1.0 Query 201: 0.0079 Total number of documents Query 202: 0.1222 over all queries Query 203: 0.0000 Retrieved: 30862 Query 207: 0.0000 Relevant: 123 0.8 Query 209: 0.5833 Rel_ret: 82 Query 210: 0.1833 Query 211: 1.0000 Interpolated Recall - Query 212: 0.0447 Precision Averages: Query 213: 0.3101 at 0.00 0.4525 Query 214: 0.0025 at 0.10 0.4525 0.6 Query 215: 0.0068 at 0.20 0.4442 Query 216: 0.1667 at 0.30 0.3783 Query 218: 0.2500 at 0.40 0.3254 Precision Query 220: 0.0298 at 0.50 0.3058 Query 221: 0.2770 at 0.60 0.2294 0.4 Query 224: 0.0250 at 0.70 0.1806 Query 225: 0.4193 at 0.80 0.1761 Query 226: 1.0000 at 0.90 0.1730 Query 227: 0.0333 at 1.00 0.1730 Query 228: 0.0074 0.2 Query 230: 0.2639 Avg. prec. (non-interpolated) Query 231: 1.0000 for all rel. documents Query 232: 0.0926 0.2840 Query 233: 0.2420 Precision: Query 234: 0.0268 At 5 docs: 0.1647 0.0 Query 235: 0.0348 At 10 docs: 0.1029 0.0 0.2 0.4 0.6 0.8 1.0 Query 237: 0.5000 At 15 docs: 0.0784 Query 238: 0.1000 At 20 docs: 0.0706 Recall Query 239: 0.3147 At 30 docs: 0.0471 Query 241: 0.0549 At 100 docs: 0.0179 Query 242: 0.0000 At 200 docs: 0.0103 Run IMSMRUN Query 244: 1.0000 At 500 docs: 0.0046 Comparison to median by topic Query 245: 0.5556 At 1000 docs: 0.0024 Query 250: 1.0000 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.2845 +0.5 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Padua, Monolingual Russian, Auto, TD Run IMSMRUUd65 Average precision Overall statistics Recall−Precision Values (individual queries): (for 34 queries): 1.0 Query 201: 0.0014 Total number of documents Query 202: 0.0060 over all queries Query 203: 0.0000 Retrieved: 32990 Query 207: 0.0000 Relevant: 123 Query 209: 0.8333 Rel_ret: 94 0.8 Query 210: 0.1494 Query 211: 1.0000 Interpolated Recall - Query 212: 0.6327 Precision Averages: Query 213: 0.3854 at 0.00 0.5635 Query 214: 0.0012 at 0.10 0.5390 0.6 Query 215: 0.0127 at 0.20 0.5298 Query 216: 0.5000 at 0.30 0.4712 Query 218: 0.2500 at 0.40 0.4338 Precision Query 220: 0.0092 at 0.50 0.3950 Query 221: 0.5159 at 0.60 0.2569 0.4 Query 224: 0.1000 at 0.70 0.2051 Query 225: 0.4109 at 0.80 0.1972 Query 226: 0.3333 at 0.90 0.1669 Query 227: 0.5000 at 1.00 0.1668 Query 228: 0.0118 0.2 Query 230: 0.3292 Avg. prec. (non-interpolated) Query 231: 1.0000 for all rel. documents Query 232: 0.0837 0.3406 Query 233: 0.4099 Precision: Query 234: 0.0219 At 5 docs: 0.1882 0.0 Query 235: 0.0308 At 10 docs: 0.1294 0.0 0.2 0.4 0.6 0.8 1.0 Query 237: 0.3750 At 15 docs: 0.0941 Query 238: 0.5000 At 20 docs: 0.0750 Recall Query 239: 0.3690 At 30 docs: 0.0510 Query 241: 0.1238 At 100 docs: 0.0191 Query 242: 0.0175 At 200 docs: 0.0109 Run IMSMRUUd65 Query 244: 1.0000 At 500 docs: 0.0051 Comparison to median by topic Query 245: 0.6667 At 1000 docs: 0.0028 Query 250: 1.0000 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.3056 +0.5 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Padua, Monolingual Russian, Auto, TD Run IMSMRUUd65qe Average precision Overall statistics (individual queries): (for 34 queries): Recall−Precision Values 1.0 Query 201: 0.0000 Total number of documents Query 202: 0.0000 over all queries Query 203: 0.5000 Retrieved: 34000 Query 207: 0.0000 Relevant: 123 Query 209: 0.6000 Rel_ret: 80 0.8 Query 210: 0.0716 Query 211: 0.3929 Interpolated Recall - Query 212: 0.5351 Precision Averages: Query 213: 0.1052 at 0.00 0.4799 Query 214: 0.0000 at 0.10 0.4510 0.6 Query 215: 0.0127 at 0.20 0.4167 Query 216: 0.5000 at 0.30 0.3362 Query 218: 0.0088 at 0.40 0.3040 Precision Query 220: 0.0013 at 0.50 0.2758 Query 221: 0.5833 at 0.60 0.1820 0.4 Query 224: 0.0102 at 0.70 0.1402 Query 225: 0.8056 at 0.80 0.1388 Query 226: 0.0000 at 0.90 0.1373 Query 227: 0.5000 at 1.00 0.1373 Query 228: 0.0000 0.2 Query 230: 0.4055 Avg. prec. (non-interpolated) Query 231: 1.0000 for all rel. documents Query 232: 0.1546 0.2557 Query 233: 0.2021 Precision: Query 234: 0.1677 At 5 docs: 0.1706 0.0 Query 235: 0.0051 At 10 docs: 0.0971 0.0 0.2 0.4 0.6 0.8 1.0 Query 237: 0.2543 At 15 docs: 0.0686 Query 238: 0.0110 At 20 docs: 0.0515 Recall Query 239: 0.1058 At 30 docs: 0.0373 Query 241: 0.0598 At 100 docs: 0.0138 Query 242: 0.0167 At 200 docs: 0.0084 Run IMSMRUUd65qe Query 244: 1.0000 At 500 docs: 0.0041 Query 245: 0.6667 At 1000 docs: 0.0024 Comparison to median by topic Query 250: 0.0185 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.2376 +0.5 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Alicante, Monolingual Russian, Auto, TD Run IRn−MR−Dexp Average precision Overall statistics (individual queries): (for 34 queries): Recall−Precision Values 1.0 Query 201: 0.0260 Total number of documents Query 202: 0.0075 over all queries Query 203: 1.0000 Retrieved: 34000 Query 207: 0.0000 Relevant: 123 Query 209: 0.8333 Rel_ret: 119 0.8 Query 210: 0.8542 Query 211: 0.8333 Interpolated Recall - Query 212: 0.7787 Precision Averages: Query 213: 0.3513 at 0.00 0.6324 Query 214: 0.0069 at 0.10 0.6324 0.6 Query 215: 1.0000 at 0.20 0.6322 Query 216: 0.7000 at 0.30 0.5765 Query 218: 0.5833 at 0.40 0.5302 Precision Query 220: 0.0126 at 0.50 0.5269 Query 221: 0.7500 at 0.60 0.4408 0.4 Query 224: 0.1548 at 0.70 0.3977 Query 225: 0.5812 at 0.80 0.3817 Query 226: 0.5000 at 0.90 0.3715 Query 227: 0.3167 at 1.00 0.3662 Query 228: 0.0038 0.2 Query 230: 0.5417 Avg. prec. (non-interpolated) Query 231: 1.0000 for all rel. documents Query 232: 0.1067 0.4796 Query 233: 0.2461 Precision: Query 234: 0.3472 At 5 docs: 0.2647 0.0 Query 235: 0.3221 At 10 docs: 0.1676 0.0 0.2 0.4 0.6 0.8 1.0 Query 237: 0.9500 At 15 docs: 0.1333 Query 238: 0.5000 At 20 docs: 0.1044 Recall Query 239: 0.4451 At 30 docs: 0.0765 Query 241: 0.1715 At 100 docs: 0.0285 Query 242: 0.0455 At 200 docs: 0.0157 Run IRn−MR−Dexp Query 244: 1.0000 At 500 docs: 0.0068 Query 245: 0.3373 At 1000 docs: 0.0035 Comparison to median by topic Query 250: 1.0000 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.3859 +0.5 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Alicante, Monolingual Russian, Auto, TD Run IRn−MR−nexp Average precision Overall statistics (individual queries): (for 34 queries): Recall−Precision Values 1.0 Query 201: 0.0230 Total number of documents Query 202: 0.0051 over all queries Query 203: 1.0000 Retrieved: 34000 Query 207: 0.0000 Relevant: 123 Query 209: 1.0000 Rel_ret: 115 0.8 Query 210: 0.5595 Query 211: 1.0000 Interpolated Recall - Query 212: 0.3786 Precision Averages: Query 213: 0.3037 at 0.00 0.6297 Query 214: 0.0072 at 0.10 0.6268 0.6 Query 215: 1.0000 at 0.20 0.6057 Query 216: 0.6250 at 0.30 0.5943 Query 218: 0.5833 at 0.40 0.5472 Precision Query 220: 0.0109 at 0.50 0.5232 Query 221: 0.6000 at 0.60 0.4427 0.4 Query 224: 0.1944 at 0.70 0.3877 Query 225: 0.5010 at 0.80 0.3807 Query 226: 1.0000 at 0.90 0.3656 Query 227: 0.5833 at 1.00 0.3611 Query 228: 0.0040 0.2 Query 230: 0.4725 Avg. prec. (non-interpolated) Query 231: 1.0000 for all rel. documents Query 232: 0.0573 0.4809 Query 233: 0.2120 Precision: Query 234: 0.3482 At 5 docs: 0.2353 0.0 Query 235: 0.1734 At 10 docs: 0.1676 0.0 0.2 0.4 0.6 0.8 1.0 Query 237: 1.0000 At 15 docs: 0.1216 Query 238: 0.2500 At 20 docs: 0.0971 Recall Query 239: 0.4866 At 30 docs: 0.0706 Query 241: 0.1481 At 100 docs: 0.0276 Query 242: 0.0323 At 200 docs: 0.0150 Run IRn−MR−nexp Query 244: 1.0000 At 500 docs: 0.0065 Query 245: 0.7917 At 1000 docs: 0.0034 Comparison to median by topic Query 250: 1.0000 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.4502 +0.5 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Alicante, Monolingual Russian, Auto, TD Run IRn−MR−Pexp Average precision Overall statistics (individual queries): (for 34 queries): Recall−Precision Values 1.0 Query 201: 0.0260 Total number of documents Query 202: 0.0074 over all queries Query 203: 1.0000 Retrieved: 34000 Query 207: 0.0000 Relevant: 123 Query 209: 0.8333 Rel_ret: 120 0.8 Query 210: 0.8542 Query 211: 0.8333 Interpolated Recall - Query 212: 0.7787 Precision Averages: Query 213: 0.3513 at 0.00 0.6339 Query 214: 0.0075 at 0.10 0.6339 0.6 Query 215: 1.0000 at 0.20 0.6337 Query 216: 0.7000 at 0.30 0.5781 Query 218: 0.5833 at 0.40 0.5320 Precision Query 220: 0.0126 at 0.50 0.5286 Query 221: 0.7500 at 0.60 0.4276 0.4 Query 224: 0.1944 at 0.70 0.3844 Query 225: 0.5812 at 0.80 0.3684 Query 226: 0.5000 at 0.90 0.3582 Query 227: 0.5625 at 1.00 0.3529 Query 228: 0.0039 0.2 Query 230: 0.5417 Avg. prec. (non-interpolated) Query 231: 1.0000 for all rel. documents Query 232: 0.1067 0.4733 Query 233: 0.2461 Precision: Query 234: 0.3472 At 5 docs: 0.2647 0.0 Query 235: 0.3221 At 10 docs: 0.1706 0.0 0.2 0.4 0.6 0.8 1.0 Query 237: 0.9500 At 15 docs: 0.1314 Query 238: 0.5000 At 20 docs: 0.1044 Recall Query 239: 0.4451 At 30 docs: 0.0765 Query 241: 0.1715 At 100 docs: 0.0285 Query 242: 0.0455 At 200 docs: 0.0159 Run IRn−MR−Pexp Query 244: 1.0000 At 500 docs: 0.0068 Query 245: 0.3373 At 1000 docs: 0.0035 Comparison to median by topic Query 250: 0.5000 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.3565 +0.5 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Daedalus, Monolingual Russian, Auto, TD Run ruav7 Average precision Overall statistics Recall−Precision Values (individual queries): (for 34 queries): 1.0 Query 201: 0.0203 Total number of documents Query 202: 0.0023 over all queries Query 203: 1.0000 Retrieved: 34000 Query 207: 0.0000 Relevant: 123 0.8 Query 209: 0.8333 Rel_ret: 100 Query 210: 0.6042 Query 211: 1.0000 Interpolated Recall - Query 212: 0.6678 Precision Averages: Query 213: 0.3501 at 0.00 0.5638 Query 214: 0.0924 at 0.10 0.5638 0.6 Query 215: 0.5000 at 0.20 0.5638 Query 216: 0.0556 at 0.30 0.5211 Query 218: 0.2500 at 0.40 0.4193 Precision Query 220: 0.0064 at 0.50 0.3951 Query 221: 0.5145 at 0.60 0.2973 0.4 Query 224: 0.1016 at 0.70 0.2453 Query 225: 0.4747 at 0.80 0.2293 Query 226: 0.0062 at 0.90 0.2126 Query 227: 0.1667 at 1.00 0.2100 Query 228: 0.0050 0.2 Query 230: 0.4194 Avg. prec. (non-interpolated) Query 231: 1.0000 for all rel. documents Query 232: 0.0640 0.3695 Query 233: 0.1800 Precision: Query 234: 0.3745 At 5 docs: 0.2235 0.0 Query 235: 0.0843 At 10 docs: 0.1412 0.0 0.2 0.4 0.6 0.8 1.0 Query 237: 0.4167 At 15 docs: 0.1078 Query 238: 1.0000 At 20 docs: 0.0838 Recall Query 239: 0.5387 At 30 docs: 0.0618 Query 241: 0.1602 At 100 docs: 0.0238 Query 242: 0.0357 At 200 docs: 0.0131 Run ruav7 Query 244: 1.0000 At 500 docs: 0.0056 Comparison to median by topic Query 245: 0.3889 At 1000 docs: 0.0029 Query 250: 0.2500 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.3350 +0.5 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Daedalus, Monolingual Russian, Auto, TD Run ruav8 Average precision Overall statistics Recall−Precision Values (individual queries): (for 34 queries): 1.0 Query 201: 0.0200 Total number of documents Query 202: 0.0021 over all queries Query 203: 0.5000 Retrieved: 34000 Query 207: 0.0000 Relevant: 123 0.8 Query 209: 1.0000 Rel_ret: 99 Query 210: 0.5787 Query 211: 1.0000 Interpolated Recall - Query 212: 0.5854 Precision Averages: Query 213: 0.3790 at 0.00 0.5574 Query 214: 0.0910 at 0.10 0.5571 0.6 Query 215: 0.5000 at 0.20 0.5452 Query 216: 0.0833 at 0.30 0.5040 Query 218: 0.2500 at 0.40 0.4117 Precision Query 220: 0.0086 at 0.50 0.3919 Query 221: 0.5175 at 0.60 0.2958 0.4 Query 224: 0.0848 at 0.70 0.2450 Query 225: 0.4751 at 0.80 0.2270 Query 226: 0.0127 at 0.90 0.2079 Query 227: 0.2500 at 1.00 0.2050 Query 228: 0.0061 0.2 Query 230: 0.3924 Avg. prec. (non-interpolated) Query 231: 1.0000 for all rel. documents Query 232: 0.0679 0.3641 Query 233: 0.2345 Precision: Query 234: 0.3847 At 5 docs: 0.2235 0.0 Query 235: 0.0864 At 10 docs: 0.1412 0.0 0.2 0.4 0.6 0.8 1.0 Query 237: 0.4167 At 15 docs: 0.1059 Query 238: 1.0000 At 20 docs: 0.0824 Recall Query 239: 0.5513 At 30 docs: 0.0608 Query 241: 0.1320 At 100 docs: 0.0226 Query 242: 0.0270 At 200 docs: 0.0138 Run ruav8 Query 244: 1.0000 At 500 docs: 0.0056 Comparison to median by topic Query 245: 0.4074 At 1000 docs: 0.0029 Query 250: 0.3333 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.3345 +0.5 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Daedalus, Monolingual Russian, Auto, TD Run rucomb1s101 Average precision Overall statistics Recall−Precision Values (individual queries): (for 34 queries): 1.0 Query 201: 0.0273 Total number of documents Query 202: 0.0021 over all queries Query 203: 1.0000 Retrieved: 34000 Query 207: 0.0000 Relevant: 123 Query 209: 0.7500 Rel_ret: 99 0.8 Query 210: 0.6917 Query 211: 1.0000 Interpolated Recall - Query 212: 0.6380 Precision Averages: Query 213: 0.3764 at 0.00 0.5693 Query 214: 0.1674 at 0.10 0.5693 0.6 Query 215: 0.3333 at 0.20 0.5638 Query 216: 0.0833 at 0.30 0.5256 Query 218: 0.2500 at 0.40 0.4146 Precision Query 220: 0.0072 at 0.50 0.3771 Query 221: 0.5135 at 0.60 0.2871 0.4 Query 224: 0.0884 at 0.70 0.2374 Query 225: 0.4716 at 0.80 0.2248 Query 226: 0.0053 at 0.90 0.2121 Query 227: 0.1250 at 1.00 0.2094 Query 228: 0.0064 0.2 Query 230: 0.4347 Avg. prec. (non-interpolated) Query 231: 1.0000 for all rel. documents Query 232: 0.0458 0.3648 Query 233: 0.1762 Precision: Query 234: 0.3528 At 5 docs: 0.2353 0.0 Query 235: 0.1474 At 10 docs: 0.1441 0.0 0.2 0.4 0.6 0.8 1.0 Query 237: 0.3750 At 15 docs: 0.1137 Query 238: 1.0000 At 20 docs: 0.0868 Recall Query 239: 0.4817 At 30 docs: 0.0598 Query 241: 0.1611 At 100 docs: 0.0229 Query 242: 0.0250 At 200 docs: 0.0131 Run rucomb1s101 Query 244: 1.0000 At 500 docs: 0.0056 Comparison to median by topic Query 245: 0.4167 At 1000 docs: 0.0029 Query 250: 0.2500 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.3415 +0.5 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Daedalus, Monolingual Russian, Auto, TD Run ruR1FWnormal Average precision Overall statistics Recall−Precision Values (individual queries): (for 34 queries): 1.0 Query 201: 0.0188 Total number of documents Query 202: 0.0026 over all queries Query 203: 1.0000 Retrieved: 34000 Query 207: 0.0000 Relevant: 123 Query 209: 0.8333 Rel_ret: 98 0.8 Query 210: 0.6442 Query 211: 1.0000 Interpolated Recall - Query 212: 0.7089 Precision Averages: Query 213: 0.3678 at 0.00 0.5553 Query 214: 0.0012 at 0.10 0.5488 0.6 Query 215: 0.3333 at 0.20 0.5488 Query 216: 0.0185 at 0.30 0.5086 Query 218: 0.2500 at 0.40 0.4256 Precision Query 220: 0.0037 at 0.50 0.3912 Query 221: 0.5152 at 0.60 0.3014 0.4 Query 224: 0.0735 at 0.70 0.2586 Query 225: 0.4499 at 0.80 0.2344 Query 226: 0.0057 at 0.90 0.2113 Query 227: 0.2500 at 1.00 0.2092 Query 228: 0.0054 0.2 Query 230: 0.4086 Avg. prec. (non-interpolated) Query 231: 1.0000 for all rel. documents Query 232: 0.0652 0.3672 Query 233: 0.2012 Precision: Query 234: 0.5909 At 5 docs: 0.2118 0.0 Query 235: 0.0399 At 10 docs: 0.1353 0.0 0.2 0.4 0.6 0.8 1.0 Query 237: 0.3750 At 15 docs: 0.1039 Query 238: 1.0000 At 20 docs: 0.0838 Recall Query 239: 0.4739 At 30 docs: 0.0618 Query 241: 0.1607 At 100 docs: 0.0226 Query 242: 0.0217 At 200 docs: 0.0128 Run ruR1FWnormal Query 244: 1.0000 At 500 docs: 0.0056 Comparison to median by topic Query 245: 0.4167 At 1000 docs: 0.0029 Query 250: 0.2500 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.3526 +0.5 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Thomson Legal, Monolingual Russian, Auto, TD Run tlrru1 Average precision Overall statistics Recall−Precision Values (individual queries): (for 34 queries): 1.0 Query 201: 0.0164 Total number of documents Query 202: 0.6681 over all queries Query 203: 0.0079 Retrieved: 33814 Query 207: 0.0000 Relevant: 123 Query 209: 0.8333 Rel_ret: 102 0.8 Query 210: 0.6223 Query 211: 1.0000 Interpolated Recall - Query 212: 0.5310 Precision Averages: Query 213: 0.3802 at 0.00 0.5912 Query 214: 0.3356 at 0.10 0.5912 0.6 Query 215: 0.5000 at 0.20 0.5814 Query 216: 0.5000 at 0.30 0.5433 Query 218: 0.2500 at 0.40 0.4688 Precision Query 220: 0.0057 at 0.50 0.4488 Query 221: 0.5333 at 0.60 0.2926 0.4 Query 224: 0.1278 at 0.70 0.2148 Query 225: 0.4348 at 0.80 0.1840 Query 226: 0.5000 at 0.90 0.1607 Query 227: 0.5000 at 1.00 0.1584 Query 228: 0.0071 0.2 Query 230: 0.3619 Avg. prec. (non-interpolated) Query 231: 0.1111 for all rel. documents Query 232: 0.0487 0.3702 Query 233: 0.1514 Precision: Query 234: 0.0378 At 5 docs: 0.2118 0.0 Query 235: 0.0890 At 10 docs: 0.1382 0.0 0.2 0.4 0.6 0.8 1.0 Query 237: 0.3750 At 15 docs: 0.1020 Query 238: 1.0000 At 20 docs: 0.0809 Recall Query 239: 0.6254 At 30 docs: 0.0588 Query 241: 0.1039 At 100 docs: 0.0232 Query 242: 0.0120 At 200 docs: 0.0132 Run tlrru1 Query 244: 1.0000 At 500 docs: 0.0059 Comparison to median by topic Query 245: 0.6667 At 1000 docs: 0.0030 Query 250: 0.2500 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.3183 +0.5 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Thomson Legal, Monolingual Russian, Auto, TD Run tlrru2 Average precision Overall statistics Recall−Precision Values (individual queries): (for 34 queries): 1.0 Query 201: 0.0132 Total number of documents Query 202: 0.4444 over all queries Query 203: 0.0078 Retrieved: 34000 Query 207: 0.0000 Relevant: 123 Query 209: 1.0000 Rel_ret: 98 0.8 Query 210: 0.4873 Query 211: 1.0000 Interpolated Recall - Query 212: 0.2575 Precision Averages: Query 213: 0.2861 at 0.00 0.5146 Query 214: 0.0093 at 0.10 0.5146 0.6 Query 215: 1.0000 at 0.20 0.4872 Query 216: 0.5000 at 0.30 0.4324 Query 218: 0.2500 at 0.40 0.3773 Precision Query 220: 0.0083 at 0.50 0.3665 Query 221: 0.5227 at 0.60 0.2529 0.4 Query 224: 0.1250 at 0.70 0.1927 Query 225: 0.4337 at 0.80 0.1749 Query 226: 0.3333 at 0.90 0.1560 Query 227: 0.1250 at 1.00 0.1546 Query 228: 0.0071 0.2 Query 230: 0.3193 Avg. prec. (non-interpolated) Query 231: 0.1250 for all rel. documents Query 232: 0.0405 0.3176 Query 233: 0.1095 Precision: Query 234: 0.0026 At 5 docs: 0.1882 0.0 Query 235: 0.0093 At 10 docs: 0.1294 0.0 0.2 0.4 0.6 0.8 1.0 Query 237: 0.3750 At 15 docs: 0.0902 Query 238: 0.5000 At 20 docs: 0.0721 Recall Query 239: 0.6600 At 30 docs: 0.0500 Query 241: 0.0899 At 100 docs: 0.0200 Query 242: 0.0048 At 200 docs: 0.0121 Run tlrru2 Query 244: 1.0000 At 500 docs: 0.0056 Comparison to median by topic Query 245: 0.6667 At 1000 docs: 0.0029 Query 250: 0.0833 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.2783 +0.5 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Amsterdam, Monolingual Russian, Auto, TD Run UAmsC04RuRu4GiSb Average precision Overall statistics Recall−Precision Values (individual queries): (for 34 queries): 1.0 Query 201: 0.0195 Total number of documents Query 202: 0.0263 over all queries Query 203: 0.0833 Retrieved: 34000 Query 207: 0.0000 Relevant: 123 Query 209: 0.8333 Rel_ret: 103 0.8 Query 210: 0.3371 Query 211: 1.0000 Interpolated Recall - Query 212: 0.7327 Precision Averages: Query 213: 0.3147 at 0.00 0.5983 Query 214: 0.9167 at 0.10 0.5975 0.6 Query 215: 1.0000 at 0.20 0.5970 Query 216: 0.0417 at 0.30 0.5384 Query 218: 0.2500 at 0.40 0.4840 Precision Query 220: 0.0570 at 0.50 0.4787 Query 221: 0.5345 at 0.60 0.3659 0.4 Query 224: 0.0417 at 0.70 0.2977 Query 225: 0.7381 at 0.80 0.2873 Query 226: 1.0000 at 0.90 0.2715 Query 227: 0.5000 at 1.00 0.2693 Query 228: 0.0022 0.2 Query 230: 0.3432 Avg. prec. (non-interpolated) Query 231: 1.0000 for all rel. documents Query 232: 0.1101 0.4227 Query 233: 0.3000 Precision: Query 234: 0.4316 At 5 docs: 0.2176 0.0 Query 235: 0.0740 At 10 docs: 0.1353 0.0 0.2 0.4 0.6 0.8 1.0 Query 237: 0.4167 At 15 docs: 0.1157 Query 238: 1.0000 At 20 docs: 0.0956 Recall Query 239: 0.6667 At 30 docs: 0.0696 Query 241: 0.1554 At 100 docs: 0.0262 Query 242: 0.0833 At 200 docs: 0.0140 Run UAmsC04RuRu4GiSb Query 244: 1.0000 At 500 docs: 0.0060 Comparison to median by topic Query 245: 0.0275 At 1000 docs: 0.0030 Query 250: 0.3333 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.3776 +0.5 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Amsterdam, Monolingual Russian, Auto, TD Run UAmsC04RuRu4GiWd Average precision Overall statistics Recall−Precision Values (individual queries): (for 34 queries): 1.0 Query 201: 0.0099 Total number of documents Query 202: 0.4491 over all queries Query 203: 0.2500 Retrieved: 34000 Query 207: 0.0000 Relevant: 123 Query 209: 0.5833 Rel_ret: 103 0.8 Query 210: 0.2344 Query 211: 1.0000 Interpolated Recall - Query 212: 0.6422 Precision Averages: Query 213: 0.3227 at 0.00 0.6260 Query 214: 0.4167 at 0.10 0.6057 0.6 Query 215: 0.5000 at 0.20 0.5959 Query 216: 0.1000 at 0.30 0.5442 Query 218: 0.2500 at 0.40 0.4832 Precision Query 220: 0.0771 at 0.50 0.4560 Query 221: 0.5357 at 0.60 0.3320 0.4 Query 224: 0.1250 at 0.70 0.2762 Query 225: 0.6465 at 0.80 0.2645 Query 226: 1.0000 at 0.90 0.2477 Query 227: 0.5000 at 1.00 0.2454 Query 228: 0.0028 0.2 Query 230: 0.2409 Avg. prec. (non-interpolated) Query 231: 1.0000 for all rel. documents Query 232: 0.0981 0.4058 Query 233: 0.3129 Precision: Query 234: 0.5598 At 5 docs: 0.2471 0.0 Query 235: 0.0809 At 10 docs: 0.1441 0.0 0.2 0.4 0.6 0.8 1.0 Query 237: 0.5012 At 15 docs: 0.1157 Query 238: 1.0000 At 20 docs: 0.0941 Recall Query 239: 0.5572 At 30 docs: 0.0696 Query 241: 0.2177 At 100 docs: 0.0265 Query 242: 0.0400 At 200 docs: 0.0135 Run UAmsC04RuRu4GiWd Query 244: 0.5000 At 500 docs: 0.0059 Comparison to median by topic Query 245: 0.0417 At 1000 docs: 0.0030 Query 250: 1.0000 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.3644 +0.5 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Amsterdam, Monolingual Russian, Auto, TD Run UAmsC04RuRuAll Average precision Overall statistics Recall−Precision Values (individual queries): (for 34 queries): 1.0 Query 201: 0.0177 Total number of documents Query 202: 0.0895 over all queries Query 203: 0.2500 Retrieved: 34000 Query 207: 0.0000 Relevant: 123 Query 209: 0.7500 Rel_ret: 103 0.8 Query 210: 0.3572 Query 211: 1.0000 Interpolated Recall - Query 212: 0.6605 Precision Averages: Query 213: 0.2985 at 0.00 0.6314 Query 214: 0.8333 at 0.10 0.6314 0.6 Query 215: 1.0000 at 0.20 0.6164 Query 216: 0.0556 at 0.30 0.5549 Query 218: 0.2500 at 0.40 0.5137 Precision Query 220: 0.0656 at 0.50 0.5077 Query 221: 0.5370 at 0.60 0.3881 0.4 Query 224: 0.0714 at 0.70 0.3068 Query 225: 0.6111 at 0.80 0.2998 Query 226: 1.0000 at 0.90 0.2851 Query 227: 0.5000 at 1.00 0.2823 Query 228: 0.0029 0.2 Query 230: 0.3483 Avg. prec. (non-interpolated) Query 231: 1.0000 for all rel. documents Query 232: 0.0956 0.4412 Query 233: 0.2297 Precision: Query 234: 0.5046 At 5 docs: 0.2353 0.0 Query 235: 0.0955 At 10 docs: 0.1471 0.0 0.2 0.4 0.6 0.8 1.0 Query 237: 0.4167 At 15 docs: 0.1078 Query 238: 1.0000 At 20 docs: 0.0956 Recall Query 239: 0.6610 At 30 docs: 0.0716 Query 241: 0.1787 At 100 docs: 0.0271 Query 242: 0.0500 At 200 docs: 0.0144 Run UAmsC04RuRuAll Query 244: 1.0000 At 500 docs: 0.0060 Comparison to median by topic Query 245: 0.0694 At 1000 docs: 0.0030 Query 250: 1.0000 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.4129 +0.5 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number SUNY Buffalo, Monolingual Russian, Auto, TD Run UBmonoRU01 Average precision Overall statistics Recall−Precision Values (individual queries): (for 34 queries): 1.0 Query 201: 0.0108 Total number of documents Query 202: 0.1333 over all queries Query 203: 0.0000 Retrieved: 32515 Query 207: 0.0000 Relevant: 123 0.8 Query 209: 0.8333 Rel_ret: 78 Query 210: 0.1093 Query 211: 1.0000 Interpolated Recall - Query 212: 0.0517 Precision Averages: Query 213: 0.3560 at 0.00 0.4947 Query 214: 0.0051 at 0.10 0.4942 0.6 Query 215: 0.0270 at 0.20 0.4710 Query 216: 0.5000 at 0.30 0.4134 Query 218: 0.2500 at 0.40 0.3635 Precision Query 220: 0.0198 at 0.50 0.3406 Query 221: 0.2333 at 0.60 0.2266 0.4 Query 224: 0.0417 at 0.70 0.1592 Query 225: 0.4587 at 0.80 0.1586 Query 226: 1.0000 at 0.90 0.1582 Query 227: 0.2500 at 1.00 0.1582 Query 228: 0.0147 0.2 Query 230: 0.2759 Avg. prec. (non-interpolated) Query 231: 1.0000 for all rel. documents Query 232: 0.0556 0.2978 Query 233: 0.2375 Precision: Query 234: 0.2083 At 5 docs: 0.1765 0.0 Query 235: 0.1254 At 10 docs: 0.1059 0.0 0.2 0.4 0.6 0.8 1.0 Query 237: 0.5000 At 15 docs: 0.0843 Query 238: 0.1000 At 20 docs: 0.0676 Recall Query 239: 0.3128 At 30 docs: 0.0490 Query 241: 0.0166 At 100 docs: 0.0182 Query 242: 0.0000 At 200 docs: 0.0097 Run UBmonoRU01 Query 244: 0.3333 At 500 docs: 0.0041 Comparison to median by topic Query 245: 0.6667 At 1000 docs: 0.0023 Query 250: 1.0000 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.2807 +0.5 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Hildesheim, Monolingual Russian, Auto, TD Run UHIru1 Average precision Overall statistics Recall−Precision Values (individual queries): (for 34 queries): 1.0 Query 201: 0.0106 Total number of documents Query 202: 0.0022 over all queries Query 203: 1.0000 Retrieved: 34000 Query 207: 0.0000 Relevant: 123 0.8 Query 209: 0.5385 Rel_ret: 88 Query 210: 0.2735 Query 211: 0.0545 Interpolated Recall - Query 212: 0.1502 Precision Averages: Query 213: 0.0933 at 0.00 0.2748 Query 214: 0.0476 at 0.10 0.2536 0.6 Query 215: 1.0000 at 0.20 0.2459 Query 216: 0.0039 at 0.30 0.1967 Query 218: 0.0106 at 0.40 0.1610 Precision Query 220: 0.0056 at 0.50 0.1591 Query 221: 0.0020 at 0.60 0.1092 0.4 Query 224: 0.0073 at 0.70 0.1012 Query 225: 0.2063 at 0.80 0.1004 Query 226: 0.0014 at 0.90 0.0994 Query 227: 0.1667 at 1.00 0.0988 Query 228: 0.0000 0.2 Query 230: 0.3603 Avg. prec. (non-interpolated) Query 231: 0.0032 for all rel. documents Query 232: 0.0008 0.1553 Query 233: 0.0065 Precision: Query 234: 0.0472 At 5 docs: 0.0765 0.0 Query 235: 0.0053 At 10 docs: 0.0588 0.0 0.2 0.4 0.6 0.8 1.0 Query 237: 0.0017 At 15 docs: 0.0471 Query 238: 0.0093 At 20 docs: 0.0382 Recall Query 239: 0.0252 At 30 docs: 0.0294 Query 241: 0.1330 At 100 docs: 0.0126 Query 242: 0.1111 At 200 docs: 0.0075 Run UHIru1 Query 244: 1.0000 At 500 docs: 0.0044 Comparison to median by topic Query 245: 0.0039 At 1000 docs: 0.0026 Query 250: 0.0000 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.1471 +0.5 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Hildesheim, Monolingual Russian, Auto, TD Run UHIru2 Average precision Overall statistics Recall−Precision Values (individual queries): (for 34 queries): 1.0 Query 201: 0.0116 Total number of documents Query 202: 0.0022 over all queries Query 203: 1.0000 Retrieved: 34000 Query 207: 0.0000 Relevant: 123 0.8 Query 209: 0.5303 Rel_ret: 82 Query 210: 0.2773 Query 211: 0.0479 Interpolated Recall - Query 212: 0.0908 Precision Averages: Query 213: 0.1367 at 0.00 0.2652 Query 214: 0.0185 at 0.10 0.2623 0.6 Query 215: 0.5000 at 0.20 0.2401 Query 216: 0.0024 at 0.30 0.1825 Query 218: 0.0093 at 0.40 0.1547 Precision Query 220: 0.0036 at 0.50 0.1541 Query 221: 0.0022 at 0.60 0.0854 0.4 Query 224: 0.0063 at 0.70 0.0817 Query 225: 0.1783 at 0.80 0.0801 Query 226: 0.0022 at 0.90 0.0799 Query 227: 0.5000 at 1.00 0.0799 Query 228: 0.0000 0.2 Query 230: 0.3119 Avg. prec. (non-interpolated) Query 231: 0.0036 for all rel. documents Query 232: 0.0008 0.1420 Query 233: 0.0057 Precision: Query 234: 0.0404 At 5 docs: 0.0706 0.0 Query 235: 0.0053 At 10 docs: 0.0500 0.0 0.2 0.4 0.6 0.8 1.0 Query 237: 0.0033 At 15 docs: 0.0392 Query 238: 0.0031 At 20 docs: 0.0338 Recall Query 239: 0.0232 At 30 docs: 0.0255 Query 241: 0.0555 At 100 docs: 0.0118 Query 242: 0.0500 At 200 docs: 0.0068 Run UHIru2 Query 244: 1.0000 At 500 docs: 0.0040 Comparison to median by topic Query 245: 0.0044 At 1000 docs: 0.0024 Query 250: 0.0000 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.1294 +0.5 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Hildesheim, Monolingual Russian, Auto, TD Run UHIru3 Average precision Overall statistics Recall−Precision Values (individual queries): (for 34 queries): 1.0 Query 201: 0.0000 Total number of documents Query 202: 0.0035 over all queries Query 203: 0.0000 Retrieved: 33873 Query 207: 0.0000 Relevant: 123 0.8 Query 209: 0.2976 Rel_ret: 56 Query 210: 0.0080 Query 211: 0.1548 Interpolated Recall - Query 212: 0.2389 Precision Averages: Query 213: 0.0136 at 0.00 0.1160 Query 214: 0.0008 at 0.10 0.1150 0.6 Query 215: 0.0196 at 0.20 0.0911 Query 216: 0.0021 at 0.30 0.0792 Query 218: 0.0125 at 0.40 0.0616 Precision Query 220: 0.0370 at 0.50 0.0602 Query 221: 0.0019 at 0.60 0.0144 0.4 Query 224: 0.0000 at 0.70 0.0132 Query 225: 0.1750 at 0.80 0.0128 Query 226: 0.0294 at 0.90 0.0128 Query 227: 0.2500 at 1.00 0.0128 Query 228: 0.0000 0.2 Query 230: 0.1351 Avg. prec. (non-interpolated) Query 231: 0.0069 for all rel. documents Query 232: 0.0010 0.0459 Query 233: 0.0021 Precision: Query 234: 0.0000 At 5 docs: 0.0412 0.0 Query 235: 0.0103 At 10 docs: 0.0353 0.0 0.2 0.4 0.6 0.8 1.0 Query 237: 0.0199 At 15 docs: 0.0294 Query 238: 0.0000 At 20 docs: 0.0221 Recall Query 239: 0.0003 At 30 docs: 0.0176 Query 241: 0.0246 At 100 docs: 0.0071 Query 242: 0.0000 At 200 docs: 0.0049 Run UHIru3 Query 244: 0.1111 At 500 docs: 0.0029 Comparison to median by topic Query 245: 0.0045 At 1000 docs: 0.0016 Query 250: 0.0000 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.0627 +0.5 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Université de Neuchâtel, Monolingual Russian, Auto, TD Run UniNEru1 Average precision Overall statistics Recall−Precision Values (individual queries): (for 34 queries): 1.0 Query 201: 0.0263 Total number of documents Query 202: 0.0309 over all queries Query 203: 1.0000 Retrieved: 32933 Query 207: 0.0000 Relevant: 123 0.8 Query 209: 0.5833 Rel_ret: 101 Query 210: 0.4159 Query 211: 1.0000 Interpolated Recall - Query 212: 0.4056 Precision Averages: Query 213: 0.1899 at 0.00 0.5329 Query 214: 0.0386 at 0.10 0.5090 0.6 Query 215: 1.0000 at 0.20 0.4990 Query 216: 0.5000 at 0.30 0.4534 Query 218: 0.2500 at 0.40 0.3965 Precision Query 220: 0.0255 at 0.50 0.3894 Query 221: 0.5227 at 0.60 0.3051 0.4 Query 224: 0.0705 at 0.70 0.2589 Query 225: 0.5050 at 0.80 0.2567 Query 226: 1.0000 at 0.90 0.2364 Query 227: 0.0500 at 1.00 0.2353 Query 228: 0.0054 0.2 Query 230: 0.3485 Avg. prec. (non-interpolated) Query 231: 0.5000 for all rel. documents Query 232: 0.0506 0.3546 Query 233: 0.2053 Precision: Query 234: 0.4135 At 5 docs: 0.1824 0.0 Query 235: 0.1289 At 10 docs: 0.1324 0.0 0.2 0.4 0.6 0.8 1.0 Query 237: 0.2500 At 15 docs: 0.1039 Query 238: 0.5000 At 20 docs: 0.0824 Recall Query 239: 0.2453 At 30 docs: 0.0637 Query 241: 0.1412 At 100 docs: 0.0229 Query 242: 0.0476 At 200 docs: 0.0132 Run UniNEru1 Query 244: 1.0000 At 500 docs: 0.0058 Comparison to median by topic Query 245: 0.1068 At 1000 docs: 0.0030 Query 250: 0.5000 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.3003 +0.5 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Université de Neuchâtel, Monolingual Russian, Auto, TD Run UniNEru2 Average precision Overall statistics Recall−Precision Values (individual queries): (for 34 queries): 1.0 Query 201: 0.0259 Total number of documents Query 202: 0.0375 over all queries Query 203: 1.0000 Retrieved: 32926 Query 207: 0.0000 Relevant: 123 0.8 Query 209: 0.5833 Rel_ret: 101 Query 210: 0.3513 Query 211: 1.0000 Interpolated Recall - Query 212: 0.3968 Precision Averages: Query 213: 0.1584 at 0.00 0.5452 Query 214: 0.0574 at 0.10 0.5203 0.6 Query 215: 1.0000 at 0.20 0.5125 Query 216: 0.5000 at 0.30 0.4636 Query 218: 0.2500 at 0.40 0.3926 Precision Query 220: 0.0260 at 0.50 0.3833 Query 221: 0.5172 at 0.60 0.3000 0.4 Query 224: 0.0710 at 0.70 0.2483 Query 225: 0.4724 at 0.80 0.2459 Query 226: 1.0000 at 0.90 0.2338 Query 227: 0.0625 at 1.00 0.2325 Query 228: 0.0063 0.2 Query 230: 0.3602 Avg. prec. (non-interpolated) Query 231: 0.5000 for all rel. documents Query 232: 0.0423 0.3545 Query 233: 0.1975 Precision: Query 234: 0.3873 At 5 docs: 0.1765 0.0 Query 235: 0.1724 At 10 docs: 0.1324 0.0 0.2 0.4 0.6 0.8 1.0 Query 237: 0.2500 At 15 docs: 0.0961 Query 238: 0.5000 At 20 docs: 0.0794 Recall Query 239: 0.2169 At 30 docs: 0.0618 Query 241: 0.1443 At 100 docs: 0.0232 Query 242: 0.0385 At 200 docs: 0.0135 Run UniNEru2 Query 244: 1.0000 At 500 docs: 0.0058 Comparison to median by topic Query 245: 0.2273 At 1000 docs: 0.0030 Query 250: 0.5000 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.3062 +0.5 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number Université de Neuchâtel, Monolingual Russian, Auto, TDN Run UniNEru3 Average precision Overall statistics Recall−Precision Values (individual queries): (for 34 queries): 1.0 Query 201: 0.0188 Total number of documents Query 202: 0.0386 over all queries Query 203: 1.0000 Retrieved: 34000 Query 207: 0.0000 Relevant: 123 0.8 Query 209: 0.8333 Rel_ret: 108 Query 210: 0.1916 Query 211: 1.0000 Interpolated Recall - Query 212: 0.1094 Precision Averages: Query 213: 0.2245 at 0.00 0.5605 Query 214: 0.0917 at 0.10 0.5523 0.6 Query 215: 1.0000 at 0.20 0.5523 Query 216: 0.2500 at 0.30 0.5003 Query 218: 0.2500 at 0.40 0.4651 Precision Query 220: 0.0316 at 0.50 0.4539 Query 221: 0.5667 at 0.60 0.3505 0.4 Query 224: 0.0470 at 0.70 0.3024 Query 225: 0.7917 at 0.80 0.2975 Query 226: 1.0000 at 0.90 0.2902 Query 227: 0.5000 at 1.00 0.2892 Query 228: 0.0047 0.2 Query 230: 0.3340 Avg. prec. (non-interpolated) Query 231: 1.0000 for all rel. documents Query 232: 0.2498 0.4070 Query 233: 0.2429 Precision: Query 234: 0.8056 At 5 docs: 0.2000 0.0 Query 235: 0.2090 At 10 docs: 0.1353 0.0 0.2 0.4 0.6 0.8 1.0 Query 237: 0.2560 At 15 docs: 0.1020 Query 238: 0.3333 At 20 docs: 0.0853 Recall Query 239: 0.2108 At 30 docs: 0.0637 Query 241: 0.1530 At 100 docs: 0.0271 Query 242: 0.0417 At 200 docs: 0.0149 Run UniNEru3 Query 244: 1.0000 At 500 docs: 0.0062 Comparison to median by topic Query 245: 0.0519 At 1000 docs: 0.0032 Query 250: 1.0000 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.3902 +0.5 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number U Oviedo, Monolingual Russian, Auto, TD Run uoviRU Average precision Overall statistics Recall−Precision Values (individual queries): (for 34 queries): 1.0 Query 201: 0.0004 Total number of documents Query 202: 0.0692 over all queries Query 203: 0.0000 Retrieved: 33999 Query 207: 0.0000 Relevant: 123 Query 209: 0.7500 Rel_ret: 72 0.8 Query 210: 0.4028 Query 211: 1.0000 Interpolated Recall - Query 212: 0.0006 Precision Averages: Query 213: 0.0209 at 0.00 0.2203 Query 214: 0.0410 at 0.10 0.2203 0.6 Query 215: 0.0032 at 0.20 0.2199 Query 216: 0.0054 at 0.30 0.1998 Query 218: 0.5000 at 0.40 0.1815 Precision Query 220: 0.0243 at 0.50 0.1664 Query 221: 0.2167 at 0.60 0.0928 0.4 Query 224: 0.1667 at 0.70 0.0902 Query 225: 0.1758 at 0.80 0.0864 Query 226: 0.0016 at 0.90 0.0857 Query 227: 0.0000 at 1.00 0.0857 Query 228: 0.0000 0.2 Query 230: 0.2267 Avg. prec. (non-interpolated) Query 231: 0.0250 for all rel. documents Query 232: 0.0006 0.1433 Query 233: 0.0104 Precision: Query 234: 0.0013 At 5 docs: 0.0882 0.0 Query 235: 0.0010 At 10 docs: 0.0529 0.0 0.2 0.4 0.6 0.8 1.0 Query 237: 0.0150 At 15 docs: 0.0392 Query 238: 0.1000 At 20 docs: 0.0309 Recall Query 239: 0.0846 At 30 docs: 0.0294 Query 241: 0.0242 At 100 docs: 0.0121 Query 242: 0.0000 At 200 docs: 0.0068 Run uoviRU Query 244: 1.0000 At 500 docs: 0.0034 Comparison to median by topic Query 245: 0.0054 At 1000 docs: 0.0021 Query 250: 0.0000 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.1245 +0.5 0.0 Difference (average precision) −0.5 −1.0 201 210 220 230 240 250 Topic number UC Berkeley, GIRT English to German, Auto, TD Run BKGRBLEG1 Average precision Overall statistics Recall−Precision Values (individual queries): (for 25 queries): 1.0 Query 101: 0.0122 Total number of documents Query 102: 0.7329 over all queries Query 103: 0.0666 Retrieved: 25000 Query 104: 0.3916 Relevant: 1663 Query 105: 0.5594 Rel_ret: 1426 0.8 Query 106: 0.9963 Query 107: 0.3945 Interpolated Recall - Query 108: 0.6033 Precision Averages: Query 109: 0.1271 at 0.00 0.7751 Query 110: 0.4295 at 0.10 0.6637 0.6 Query 111: 0.1765 at 0.20 0.5711 Query 112: 0.2056 at 0.30 0.5137 Query 113: 0.4274 at 0.40 0.4597 Precision Query 114: 0.4847 at 0.50 0.4100 Query 115: 0.8966 at 0.60 0.3404 0.4 Query 116: 0.1002 at 0.70 0.2693 Query 117: 0.1300 at 0.80 0.1962 Query 118: 0.3991 at 0.90 0.1296 Query 119: 0.0805 at 1.00 0.0482 Query 120: 0.3758 0.2 Query 121: 0.3257 Avg. prec. (non-interpolated) Query 122: 0.3074 for all rel. documents Query 123: 0.0009 0.3868 Query 124: 0.8176 Precision: Query 125: 0.6293 At 5 docs: 0.6400 0.0 At 10 docs: 0.5960 0.0 0.2 0.4 0.6 0.8 1.0 At 15 docs: 0.5627 At 20 docs: 0.5220 Recall At 30 docs: 0.4880 At 100 docs: 0.3188 At 200 docs: 0.2070 Run BKGRBLEG1 At 500 docs: 0.1033 Comparison to median by topic At 1000 docs: 0.0570 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.4021 +0.5 0.0 Difference (average precision) −0.5 −1.0 101 105 110 115 120 125 Topic number UC Berkeley, GIRT English to German, Auto, TD Run BKGRBLEG2 Average precision Overall statistics Recall−Precision Values (individual queries): (for 25 queries): 1.0 Query 101: 0.3374 Total number of documents Query 102: 0.2569 over all queries Query 103: 0.0382 Retrieved: 25000 Query 104: 0.3251 Relevant: 1663 Query 105: 0.6136 Rel_ret: 1348 0.8 Query 106: 0.3200 Query 107: 0.4175 Interpolated Recall - Query 108: 0.5598 Precision Averages: Query 109: 0.0366 at 0.00 0.7021 Query 110: 0.4264 at 0.10 0.5792 0.6 Query 111: 0.1217 at 0.20 0.5259 Query 112: 0.2085 at 0.30 0.4606 Query 113: 0.4094 at 0.40 0.3593 Precision Query 114: 0.0131 at 0.50 0.2995 Query 115: 0.8880 at 0.60 0.2516 0.4 Query 116: 0.0092 at 0.70 0.2010 Query 117: 0.2475 at 0.80 0.1352 Query 118: 0.2411 at 0.90 0.0775 Query 119: 0.0788 at 1.00 0.0218 Query 120: 0.3717 0.2 Query 121: 0.0832 Avg. prec. (non-interpolated) Query 122: 0.4263 for all rel. documents Query 123: 0.0041 0.3176 Query 124: 0.8412 Precision: Query 125: 0.6660 At 5 docs: 0.5520 0.0 At 10 docs: 0.5000 0.0 0.2 0.4 0.6 0.8 1.0 At 15 docs: 0.4773 At 20 docs: 0.4420 Recall At 30 docs: 0.3987 At 100 docs: 0.2808 At 200 docs: 0.1892 Run BKGRBLEG2 At 500 docs: 0.0970 Comparison to median by topic At 1000 docs: 0.0539 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.3448 +0.5 0.0 Difference (average precision) −0.5 −1.0 101 105 110 115 120 125 Topic number UC Berkeley, GIRT English to German, Auto, TD Run BKGRBLEG3 Average precision Overall statistics Recall−Precision Values (individual queries): (for 25 queries): 1.0 Query 101: 0.1692 Total number of documents Query 102: 0.3479 over all queries Query 103: 0.0295 Retrieved: 25000 Query 104: 0.3676 Relevant: 1663 Query 105: 0.5718 Rel_ret: 1411 0.8 Query 106: 0.8743 Query 107: 0.4231 Interpolated Recall - Query 108: 0.6746 Precision Averages: Query 109: 0.0627 at 0.00 0.7912 Query 110: 0.3963 at 0.10 0.6590 0.6 Query 111: 0.1735 at 0.20 0.5735 Query 112: 0.2697 at 0.30 0.5126 Query 113: 0.4252 at 0.40 0.4028 Precision Query 114: 0.1155 at 0.50 0.3601 Query 115: 0.8766 at 0.60 0.2998 0.4 Query 116: 0.1492 at 0.70 0.2430 Query 117: 0.2602 at 0.80 0.1757 Query 118: 0.3065 at 0.90 0.1138 Query 119: 0.1045 at 1.00 0.0307 Query 120: 0.5222 0.2 Query 121: 0.2739 Avg. prec. (non-interpolated) Query 122: 0.3597 for all rel. documents Query 123: 0.0022 0.3641 Query 124: 0.8274 Precision: Query 125: 0.5184 At 5 docs: 0.5760 0.0 At 10 docs: 0.5520 0.0 0.2 0.4 0.6 0.8 1.0 At 15 docs: 0.5200 At 20 docs: 0.5020 Recall At 30 docs: 0.4573 At 100 docs: 0.3076 At 200 docs: 0.2008 Run BKGRBLEG3 At 500 docs: 0.1022 Comparison to median by topic At 1000 docs: 0.0564 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.3889 +0.5 0.0 Difference (average precision) −0.5 −1.0 101 105 110 115 120 125 Topic number UC Berkeley, GIRT English to German, Auto, TD Run BKGRBLEG4 Average precision Overall statistics Recall−Precision Values (individual queries): (for 25 queries): 1.0 Query 101: 0.3425 Total number of documents Query 102: 0.2007 over all queries Query 103: 0.0022 Retrieved: 25000 Query 104: 0.2687 Relevant: 1663 Query 105: 0.6345 Rel_ret: 1318 0.8 Query 106: 0.7209 Query 107: 0.1087 Interpolated Recall - Query 108: 0.6866 Precision Averages: Query 109: 0.0010 at 0.00 0.7012 Query 110: 0.3378 at 0.10 0.5362 0.6 Query 111: 0.1257 at 0.20 0.4752 Query 112: 0.0000 at 0.30 0.4178 Query 113: 0.3043 at 0.40 0.3141 Precision Query 114: 0.0113 at 0.50 0.2869 Query 115: 0.8902 at 0.60 0.2372 0.4 Query 116: 0.0800 at 0.70 0.1945 Query 117: 0.1657 at 0.80 0.1484 Query 118: 0.2411 at 0.90 0.0833 Query 119: 0.0650 at 1.00 0.0167 Query 120: 0.4340 0.2 Query 121: 0.2312 Avg. prec. (non-interpolated) Query 122: 0.4286 for all rel. documents Query 123: 0.0000 0.2964 Query 124: 0.8653 Precision: Query 125: 0.2636 At 5 docs: 0.5120 0.0 At 10 docs: 0.4760 0.0 0.2 0.4 0.6 0.8 1.0 At 15 docs: 0.4213 At 20 docs: 0.3920 Recall At 30 docs: 0.3693 At 100 docs: 0.2572 At 200 docs: 0.1726 Run BKGRBLEG4 At 500 docs: 0.0924 Comparison to median by topic At 1000 docs: 0.0527 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.3145 +0.5 0.0 Difference (average precision) −0.5 −1.0 101 105 110 115 120 125 Topic number UC Berkeley, GIRT English to German, Auto, TD Run BKGRBLEG5 Average precision Overall statistics Recall−Precision Values (individual queries): (for 25 queries): 1.0 Query 101: 0.0315 Total number of documents Query 102: 0.4657 over all queries Query 103: 0.0381 Retrieved: 25000 Query 104: 0.3420 Relevant: 1663 Query 105: 0.5859 Rel_ret: 1402 0.8 Query 106: 0.6546 Query 107: 0.3868 Interpolated Recall - Query 108: 0.4257 Precision Averages: Query 109: 0.0550 at 0.00 0.6956 Query 110: 0.3545 at 0.10 0.5552 0.6 Query 111: 0.0814 at 0.20 0.5033 Query 112: 0.1196 at 0.30 0.4612 Query 113: 0.5240 at 0.40 0.3961 Precision Query 114: 0.0939 at 0.50 0.3435 Query 115: 0.8598 at 0.60 0.2635 0.4 Query 116: 0.0097 at 0.70 0.2055 Query 117: 0.1933 at 0.80 0.1541 Query 118: 0.3209 at 0.90 0.0719 Query 119: 0.0997 at 1.00 0.0219 Query 120: 0.5643 0.2 Query 121: 0.1059 Avg. prec. (non-interpolated) Query 122: 0.3791 for all rel. documents Query 123: 0.0001 0.3224 Query 124: 0.7321 Precision: Query 125: 0.6369 At 5 docs: 0.5600 0.0 At 10 docs: 0.5080 0.0 0.2 0.4 0.6 0.8 1.0 At 15 docs: 0.4613 At 20 docs: 0.4380 Recall At 30 docs: 0.4147 At 100 docs: 0.2952 At 200 docs: 0.1948 Run BKGRBLEG5 At 500 docs: 0.1018 Comparison to median by topic At 1000 docs: 0.0561 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.3412 +0.5 0.0 Difference (average precision) −0.5 −1.0 101 105 110 115 120 125 Topic number UC Berkeley, GIRT German to German, Auto, TD Run BKGRMLGG0 Average precision Overall statistics Recall−Precision Values (individual queries): (for 25 queries): 1.0 Query 101: 0.3450 Total number of documents Query 102: 0.7535 over all queries Query 103: 0.0657 Retrieved: 25000 Query 104: 0.1310 Relevant: 1663 Query 105: 0.4282 Rel_ret: 1299 0.8 Query 106: 0.9778 Query 107: 0.0613 Interpolated Recall - Query 108: 0.3507 Precision Averages: Query 109: 0.0875 at 0.00 0.7878 Query 110: 0.3774 at 0.10 0.6154 0.6 Query 111: 0.1802 at 0.20 0.5695 Query 112: 0.1350 at 0.30 0.5124 Query 113: 0.2906 at 0.40 0.4070 Precision Query 114: 0.0992 at 0.50 0.3631 Query 115: 0.8355 at 0.60 0.3049 0.4 Query 116: 0.1975 at 0.70 0.2554 Query 117: 0.1819 at 0.80 0.2003 Query 118: 0.4225 at 0.90 0.1450 Query 119: 0.9520 at 1.00 0.0424 Query 120: 0.2962 0.2 Query 121: 0.3418 Avg. prec. (non-interpolated) Query 122: 0.2879 for all rel. documents Query 123: 0.0000 0.3706 Query 124: 0.5862 Precision: Query 125: 0.8795 At 5 docs: 0.5840 0.0 At 10 docs: 0.5320 0.0 0.2 0.4 0.6 0.8 1.0 At 15 docs: 0.5147 At 20 docs: 0.4840 Recall At 30 docs: 0.4573 At 100 docs: 0.2980 At 200 docs: 0.1956 Run BKGRMLGG0 At 500 docs: 0.0949 Comparison to median by topic At 1000 docs: 0.0520 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.3933 +0.5 0.0 Difference (average precision) −0.5 −1.0 101 105 110 115 120 125 Topic number UC Berkeley, GIRT German to German, Auto, TD Run BKGRMLGG1 Average precision Overall statistics Recall−Precision Values (individual queries): (for 25 queries): 1.0 Query 101: 0.0260 Total number of documents Query 102: 0.7174 over all queries Query 103: 0.1522 Retrieved: 25000 Query 104: 0.3598 Relevant: 1663 Query 105: 0.5248 Rel_ret: 1471 0.8 Query 106: 0.8055 Query 107: 0.0914 Interpolated Recall - Query 108: 0.4672 Precision Averages: Query 109: 0.1671 at 0.00 0.7290 Query 110: 0.4232 at 0.10 0.6666 0.6 Query 111: 0.1908 at 0.20 0.6101 Query 112: 0.1011 at 0.30 0.5631 Query 113: 0.3953 at 0.40 0.5038 Precision Query 114: 0.5857 at 0.50 0.4206 Query 115: 0.8725 at 0.60 0.3728 0.4 Query 116: 0.3103 at 0.70 0.2958 Query 117: 0.2514 at 0.80 0.2324 Query 118: 0.3590 at 0.90 0.1579 Query 119: 0.9883 at 1.00 0.0604 Query 120: 0.4743 0.2 Query 121: 0.2212 Avg. prec. (non-interpolated) Query 122: 0.2569 for all rel. documents Query 123: 0.0000 0.4102 Query 124: 0.6872 Precision: Query 125: 0.8252 At 5 docs: 0.5920 0.0 At 10 docs: 0.6120 0.0 0.2 0.4 0.6 0.8 1.0 At 15 docs: 0.5520 At 20 docs: 0.5380 Recall At 30 docs: 0.5080 At 100 docs: 0.3264 At 200 docs: 0.2080 Run BKGRMLGG1 At 500 docs: 0.1062 Comparison to median by topic At 1000 docs: 0.0588 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.4354 +0.5 0.0 Difference (average precision) −0.5 −1.0 101 105 110 115 120 125 Topic number UC Berkeley, GIRT German to German, Auto, TD Run BKGRMLGG2 Average precision Overall statistics Recall−Precision Values (individual queries): (for 25 queries): 1.0 Query 101: 0.3392 Total number of documents Query 102: 0.7472 over all queries Query 103: 0.0804 Retrieved: 25000 Query 104: 0.2155 Relevant: 1663 Query 105: 0.5545 Rel_ret: 1472 0.8 Query 106: 0.8368 Query 107: 0.1565 Interpolated Recall - Query 108: 0.4684 Precision Averages: Query 109: 0.1690 at 0.00 0.7843 Query 110: 0.3233 at 0.10 0.6725 0.6 Query 111: 0.1571 at 0.20 0.6268 Query 112: 0.3335 at 0.30 0.5703 Query 113: 0.4505 at 0.40 0.4921 Precision Query 114: 0.5920 at 0.50 0.4505 Query 115: 0.9001 at 0.60 0.3835 0.4 Query 116: 0.0065 at 0.70 0.2960 Query 117: 0.2163 at 0.80 0.2287 Query 118: 0.3699 at 0.90 0.1614 Query 119: 0.9903 at 1.00 0.0678 Query 120: 0.5201 0.2 Query 121: 0.2453 Avg. prec. (non-interpolated) Query 122: 0.2767 for all rel. documents Query 123: 0.0000 0.4177 Query 124: 0.6969 Precision: Query 125: 0.7961 At 5 docs: 0.5920 0.0 At 10 docs: 0.5600 0.0 0.2 0.4 0.6 0.8 1.0 At 15 docs: 0.5280 At 20 docs: 0.5080 Recall At 30 docs: 0.4853 At 100 docs: 0.3300 At 200 docs: 0.2166 Run BKGRMLGG2 At 500 docs: 0.1062 Comparison to median by topic At 1000 docs: 0.0589 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.4334 +0.5 0.0 Difference (average precision) −0.5 −1.0 101 105 110 115 120 125 Topic number FU Hagen, GIRT German to German, Auto, TD Run FUHdm Average precision Overall statistics Recall−Precision Values (individual queries): (for 25 queries): 1.0 Query 101: 0.0000 Total number of documents Query 102: 0.0000 over all queries Query 103: 0.0360 Retrieved: 1309 Query 104: 0.0000 Relevant: 1663 Query 105: 0.0117 Rel_ret: 167 0.8 Query 106: 0.8708 Query 107: 0.0222 Interpolated Recall - Query 108: 0.0000 Precision Averages: Query 109: 0.0192 at 0.00 0.3509 Query 110: 0.0000 at 0.10 0.2045 0.6 Query 111: 0.0000 at 0.20 0.1395 Query 112: 0.0173 at 0.30 0.1357 Query 113: 0.0250 at 0.40 0.1114 Precision Query 114: 0.0000 at 0.50 0.1078 Query 115: 0.0000 at 0.60 0.1078 0.4 Query 116: 0.8179 at 0.70 0.1061 Query 117: 0.0000 at 0.80 0.1058 Query 118: 0.0913 at 0.90 0.0000 Query 119: 0.0000 at 1.00 0.0000 Query 120: 0.0000 0.2 Query 121: 0.2200 Avg. prec. (non-interpolated) Query 122: 0.0000 for all rel. documents Query 123: 0.0000 0.1126 Query 124: 0.0539 Precision: Query 125: 0.6300 At 5 docs: 0.2480 0.0 At 10 docs: 0.1960 0.0 0.2 0.4 0.6 0.8 1.0 At 15 docs: 0.1947 At 20 docs: 0.1780 Recall At 30 docs: 0.1547 At 100 docs: 0.0664 At 200 docs: 0.0332 Run FUHdm At 500 docs: 0.0134 Comparison to median by topic At 1000 docs: 0.0067 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.1393 +0.5 0.0 Difference (average precision) −0.5 −1.0 101 105 110 115 120 125 Topic number FU Hagen, GIRT German to German, Auto, TD Run FUHdrw Average precision Overall statistics Recall−Precision Values (individual queries): (for 25 queries): 1.0 Query 101: 0.0088 Total number of documents Query 102: 0.1507 over all queries Query 103: 0.0702 Retrieved: 25000 Query 104: 0.0209 Relevant: 1663 Query 105: 0.0252 Rel_ret: 672 0.8 Query 106: 0.2858 Query 107: 0.0004 Interpolated Recall - Query 108: 0.1818 Precision Averages: Query 109: 0.0138 at 0.00 0.3685 Query 110: 0.0025 at 0.10 0.2865 0.6 Query 111: 0.0131 at 0.20 0.2114 Query 112: 0.0487 at 0.30 0.1768 Query 113: 0.1158 at 0.40 0.1062 Precision Query 114: 0.0234 at 0.50 0.0934 Query 115: 0.1487 at 0.60 0.0784 0.4 Query 116: 0.7857 at 0.70 0.0694 Query 117: 0.0079 at 0.80 0.0544 Query 118: 0.0347 at 0.90 0.0120 Query 119: 0.0035 at 1.00 0.0015 Query 120: 0.0626 0.2 Query 121: 0.1873 Avg. prec. (non-interpolated) Query 122: 0.0106 for all rel. documents Query 123: 0.0015 0.1162 Query 124: 0.0550 Precision: Query 125: 0.6458 At 5 docs: 0.2320 0.0 At 10 docs: 0.2120 0.0 0.2 0.4 0.6 0.8 1.0 At 15 docs: 0.2133 At 20 docs: 0.2140 Recall At 30 docs: 0.1867 At 100 docs: 0.0976 At 200 docs: 0.0684 Run FUHdrw At 500 docs: 0.0394 Comparison to median by topic At 1000 docs: 0.0269 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.1632 +0.5 0.0 Difference (average precision) −0.5 −1.0 101 105 110 115 120 125 Topic number FU Hagen, GIRT German to German, Auto, TD Run FUHds1 Average precision Overall statistics Recall−Precision Values (individual queries): (for 25 queries): 1.0 Query 101: 0.0370 Total number of documents Query 102: 0.4567 over all queries Query 103: 0.0762 Retrieved: 25000 Query 104: 0.1733 Relevant: 1663 Query 105: 0.4815 Rel_ret: 1148 0.8 Query 106: 0.7269 Query 107: 0.1623 Interpolated Recall - Query 108: 0.3043 Precision Averages: Query 109: 0.1042 at 0.00 0.8119 Query 110: 0.2217 at 0.10 0.5467 0.6 Query 111: 0.0643 at 0.20 0.4134 Query 112: 0.0030 at 0.30 0.3611 Query 113: 0.2042 at 0.40 0.2825 Precision Query 114: 0.0929 at 0.50 0.2190 Query 115: 0.4745 at 0.60 0.1543 0.4 Query 116: 0.1462 at 0.70 0.0837 Query 117: 0.2373 at 0.80 0.0459 Query 118: 0.3153 at 0.90 0.0161 Query 119: 0.3892 at 1.00 0.0022 Query 120: 0.2075 0.2 Query 121: 0.1494 Avg. prec. (non-interpolated) Query 122: 0.0525 for all rel. documents Query 123: 0.1383 0.2446 Query 124: 0.4336 Precision: Query 125: 0.4636 At 5 docs: 0.5680 0.0 At 10 docs: 0.5000 0.0 0.2 0.4 0.6 0.8 1.0 At 15 docs: 0.4347 At 20 docs: 0.4080 Recall At 30 docs: 0.3760 At 100 docs: 0.2224 At 200 docs: 0.1506 Run FUHds1 At 500 docs: 0.0794 Comparison to median by topic At 1000 docs: 0.0459 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.2815 +0.5 0.0 Difference (average precision) −0.5 −1.0 101 105 110 115 120 125 Topic number FU Hagen, GIRT German to German, Auto, TD Run FUHdw1 Average precision Overall statistics Recall−Precision Values (individual queries): (for 25 queries): 1.0 Query 101: 0.3342 Total number of documents Query 102: 0.3393 over all queries Query 103: 0.0670 Retrieved: 25000 Query 104: 0.0940 Relevant: 1663 Query 105: 0.3916 Rel_ret: 1009 0.8 Query 106: 0.3032 Query 107: 0.0053 Interpolated Recall - Query 108: 0.2160 Precision Averages: Query 109: 0.0089 at 0.00 0.6620 Query 110: 0.5343 at 0.10 0.5377 0.6 Query 111: 0.2493 at 0.20 0.4653 Query 112: 0.0471 at 0.30 0.4012 Query 113: 0.1437 at 0.40 0.2761 Precision Query 114: 0.0456 at 0.50 0.2335 Query 115: 0.2426 at 0.60 0.1612 0.4 Query 116: 0.8755 at 0.70 0.1240 Query 117: 0.0885 at 0.80 0.0937 Query 118: 0.3256 at 0.90 0.0580 Query 119: 0.4180 at 1.00 0.0131 Query 120: 0.1161 0.2 Query 121: 0.0383 Avg. prec. (non-interpolated) Query 122: 0.0443 for all rel. documents Query 123: 0.0622 0.2482 Query 124: 0.6641 Precision: Query 125: 0.5493 At 5 docs: 0.4240 0.0 At 10 docs: 0.4160 0.0 0.2 0.4 0.6 0.8 1.0 At 15 docs: 0.3973 At 20 docs: 0.3720 Recall At 30 docs: 0.3413 At 100 docs: 0.2104 At 200 docs: 0.1362 Run FUHdw1 At 500 docs: 0.0695 Comparison to median by topic At 1000 docs: 0.0404 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.2799 +0.5 0.0 Difference (average precision) −0.5 −1.0 101 105 110 115 120 125 Topic number FU Hagen, GIRT German to German, Auto, TD Run FUHdw2 Average precision Overall statistics Recall−Precision Values (individual queries): (for 25 queries): 1.0 Query 101: 0.3344 Total number of documents Query 102: 0.3479 over all queries Query 103: 0.0874 Retrieved: 25000 Query 104: 0.0789 Relevant: 1663 Query 105: 0.3734 Rel_ret: 938 0.8 Query 106: 0.2818 Query 107: 0.0015 Interpolated Recall - Query 108: 0.1246 Precision Averages: Query 109: 0.0018 at 0.00 0.6919 Query 110: 0.5663 at 0.10 0.5545 0.6 Query 111: 0.2523 at 0.20 0.4355 Query 112: 0.0218 at 0.30 0.3816 Query 113: 0.2195 at 0.40 0.2726 Precision Query 114: 0.0723 at 0.50 0.1762 Query 115: 0.0998 at 0.60 0.1177 0.4 Query 116: 0.6701 at 0.70 0.0720 Query 117: 0.0940 at 0.80 0.0614 Query 118: 0.3264 at 0.90 0.0393 Query 119: 0.4054 at 1.00 0.0074 Query 120: 0.1369 0.2 Query 121: 0.0444 Avg. prec. (non-interpolated) Query 122: 0.1018 for all rel. documents Query 123: 0.0327 0.2276 Query 124: 0.6217 Precision: Query 125: 0.3926 At 5 docs: 0.4400 0.0 At 10 docs: 0.4280 0.0 0.2 0.4 0.6 0.8 1.0 At 15 docs: 0.4053 At 20 docs: 0.3800 Recall At 30 docs: 0.3507 At 100 docs: 0.1944 At 200 docs: 0.1228 Run FUHdw2 At 500 docs: 0.0638 Comparison to median by topic At 1000 docs: 0.0375 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.2457 +0.5 0.0 Difference (average precision) −0.5 −1.0 101 105 110 115 120 125 Topic number Ricoh, GIRT German to German, Auto, TD Run rdedetde04 Average precision Overall statistics Recall−Precision Values (individual queries): (for 25 queries): 1.0 Query 101: 0.0701 Total number of documents Query 102: 0.1415 over all queries Query 103: 0.1920 Retrieved: 25000 Query 104: 0.1509 Relevant: 1663 Query 105: 0.2466 Rel_ret: 922 0.8 Query 106: 1.0000 Query 107: 0.0122 Interpolated Recall - Query 108: 0.2007 Precision Averages: Query 109: 0.0832 at 0.00 0.6007 Query 110: 0.1528 at 0.10 0.4474 0.6 Query 111: 0.2563 at 0.20 0.3752 Query 112: 0.2138 at 0.30 0.3252 Query 113: 0.2265 at 0.40 0.2629 Precision Query 114: 0.5418 at 0.50 0.2144 Query 115: 0.6158 at 0.60 0.1678 0.4 Query 116: 0.0001 at 0.70 0.1349 Query 117: 0.0738 at 0.80 0.1050 Query 118: 0.1494 at 0.90 0.0958 Query 119: 0.9564 at 1.00 0.0421 Query 120: 0.0006 0.2 Query 121: 0.3352 Avg. prec. (non-interpolated) Query 122: 0.0362 for all rel. documents Query 123: 0.0012 0.2381 Query 124: 0.2665 Precision: Query 125: 0.0286 At 5 docs: 0.4080 0.0 At 10 docs: 0.4160 0.0 0.2 0.4 0.6 0.8 1.0 At 15 docs: 0.3893 At 20 docs: 0.3600 Recall At 30 docs: 0.3187 At 100 docs: 0.2064 At 200 docs: 0.1306 Run rdedetde04 At 500 docs: 0.0642 Comparison to median by topic At 1000 docs: 0.0369 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.2759 +0.5 0.0 Difference (average precision) −0.5 −1.0 101 105 110 115 120 125 Topic number Ricoh, GIRT English to German, Auto, TD Run rendetde04 Average precision Overall statistics Recall−Precision Values (individual queries): (for 25 queries): 1.0 Query 101: 0.0282 Total number of documents Query 102: 0.2096 over all queries Query 103: 0.0087 Retrieved: 25000 Query 104: 0.1969 Relevant: 1663 Query 105: 0.2578 Rel_ret: 684 0.8 Query 106: 0.7468 Query 107: 0.0938 Interpolated Recall - Query 108: 0.1732 Precision Averages: Query 109: 0.0009 at 0.00 0.5697 Query 110: 0.0818 at 0.10 0.3478 0.6 Query 111: 0.0284 at 0.20 0.2338 Query 112: 0.0000 at 0.30 0.1708 Query 113: 0.0654 at 0.40 0.1177 Precision Query 114: 0.1029 at 0.50 0.0886 Query 115: 0.1334 at 0.60 0.0471 0.4 Query 116: 0.0000 at 0.70 0.0268 Query 117: 0.0212 at 0.80 0.0252 Query 118: 0.1923 at 0.90 0.0016 Query 119: 0.0300 at 1.00 0.0016 Query 120: 0.0002 0.2 Query 121: 0.0534 Avg. prec. (non-interpolated) Query 122: 0.0380 for all rel. documents Query 123: 0.0019 0.1261 Query 124: 0.2486 Precision: Query 125: 0.4396 At 5 docs: 0.3920 0.0 At 10 docs: 0.3280 0.0 0.2 0.4 0.6 0.8 1.0 At 15 docs: 0.3040 At 20 docs: 0.2640 Recall At 30 docs: 0.2387 At 100 docs: 0.1252 At 200 docs: 0.0858 Run rendetde04 At 500 docs: 0.0448 Comparison to median by topic At 1000 docs: 0.0274 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.1678 +0.5 0.0 Difference (average precision) −0.5 −1.0 101 105 110 115 120 125 Topic number UC Berkeley, GIRT German to English, Auto, TD Run BKGRBLGE1 Average precision Overall statistics Recall−Precision Values (individual queries): (for 24 queries): 1.0 Query 101: 0.0139 Total number of documents Query 102: 0.6606 over all queries Query 103: 0.1848 Retrieved: 24000 Query 104: 0.3119 Relevant: 1235 Query 105: 0.4166 Rel_ret: 1100 0.8 Query 106: 0.9178 Query 107: 0.0516 Interpolated Recall - Query 108: 0.6331 Precision Averages: Query 109: 0.1544 at 0.00 0.7434 Query 110: 0.4638 at 0.10 0.6626 0.6 Query 111: 0.1097 at 0.20 0.5636 Query 113: 0.3669 at 0.30 0.5173 Query 114: 0.6507 at 0.40 0.4845 Precision Query 115: 0.8458 at 0.50 0.4106 Query 116: 0.2237 at 0.60 0.3675 0.4 Query 117: 0.0857 at 0.70 0.3074 Query 118: 0.2415 at 0.80 0.2421 Query 119: 0.7454 at 0.90 0.1835 Query 120: 0.5478 at 1.00 0.0762 Query 121: 0.0253 0.2 Query 122: 0.3786 Avg. prec. (non-interpolated) Query 123: 0.0000 for all rel. documents Query 124: 0.7888 0.4053 Query 125: 0.9094 Precision: At 5 docs: 0.5833 0.0 At 10 docs: 0.5750 0.0 0.2 0.4 0.6 0.8 1.0 At 15 docs: 0.5472 At 20 docs: 0.5083 Recall At 30 docs: 0.4569 At 100 docs: 0.2829 At 200 docs: 0.1752 Run BKGRBLGE1 At 500 docs: 0.0828 Comparison to median by topic At 1000 docs: 0.0458 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.3963 +0.5 0.0 Difference (average precision) −0.5 −1.0 101 105 110 115 120 125 Topic number UC Berkeley, GIRT German to English, Auto, TD Run BKGRBLGE2 Average precision Overall statistics Recall−Precision Values (individual queries): (for 24 queries): 1.0 Query 101: 0.0059 Total number of documents Query 102: 0.6596 over all queries Query 103: 0.1827 Retrieved: 24000 Query 104: 0.2688 Relevant: 1235 Query 105: 0.4514 Rel_ret: 1032 0.8 Query 106: 0.7495 Query 107: 0.4430 Interpolated Recall - Query 108: 0.7310 Precision Averages: Query 109: 0.0758 at 0.00 0.6386 Query 110: 0.3429 at 0.10 0.5398 0.6 Query 111: 0.1150 at 0.20 0.4737 Query 113: 0.0279 at 0.30 0.4260 Query 114: 0.1608 at 0.40 0.3748 Precision Query 115: 0.5717 at 0.50 0.3218 Query 116: 0.0021 at 0.60 0.2733 0.4 Query 117: 0.0295 at 0.70 0.2156 Query 118: 0.4087 at 0.80 0.1280 Query 119: 0.0756 at 0.90 0.0818 Query 120: 0.4653 at 1.00 0.0203 Query 121: 0.0006 0.2 Query 122: 0.1997 Avg. prec. (non-interpolated) Query 123: 0.0007 for all rel. documents Query 124: 0.8504 0.3054 Query 125: 0.5110 Precision: At 5 docs: 0.5083 0.0 At 10 docs: 0.4750 0.0 0.2 0.4 0.6 0.8 1.0 At 15 docs: 0.4444 At 20 docs: 0.4083 Recall At 30 docs: 0.3806 At 100 docs: 0.2387 At 200 docs: 0.1538 Run BKGRBLGE2 At 500 docs: 0.0781 Comparison to median by topic At 1000 docs: 0.0430 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.3177 +0.5 0.0 Difference (average precision) −0.5 −1.0 101 105 110 115 120 125 Topic number UC Berkeley, GIRT German to English, Auto, TD Run BKGRBLGE3 Average precision Overall statistics Recall−Precision Values (individual queries): (for 24 queries): 1.0 Query 101: 0.0046 Total number of documents Query 102: 0.7079 over all queries Query 103: 0.1844 Retrieved: 24000 Query 104: 0.2775 Relevant: 1235 Query 105: 0.3794 Rel_ret: 1058 0.8 Query 106: 0.8810 Query 107: 0.4211 Interpolated Recall - Query 108: 0.6825 Precision Averages: Query 109: 0.0850 at 0.00 0.7184 Query 110: 0.4300 at 0.10 0.5957 0.6 Query 111: 0.1303 at 0.20 0.5407 Query 113: 0.1694 at 0.30 0.4875 Query 114: 0.5389 at 0.40 0.4454 Precision Query 115: 0.8168 at 0.50 0.3903 Query 116: 0.0048 at 0.60 0.3200 0.4 Query 117: 0.0669 at 0.70 0.2618 Query 118: 0.1518 at 0.80 0.2178 Query 119: 0.2013 at 0.90 0.1499 Query 120: 0.5654 at 1.00 0.0446 Query 121: 0.0004 0.2 Query 122: 0.3742 Avg. prec. (non-interpolated) Query 123: 0.0007 for all rel. documents Query 124: 0.8256 0.3668 Query 125: 0.9031 Precision: At 5 docs: 0.5250 0.0 At 10 docs: 0.5292 0.0 0.2 0.4 0.6 0.8 1.0 At 15 docs: 0.5056 At 20 docs: 0.4729 Recall At 30 docs: 0.4278 At 100 docs: 0.2650 At 200 docs: 0.1694 Run BKGRBLGE3 At 500 docs: 0.0806 Comparison to median by topic At 1000 docs: 0.0441 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.3596 +0.5 0.0 Difference (average precision) −0.5 −1.0 101 105 110 115 120 125 Topic number UC Berkeley, GIRT German to English, Auto, TD Run BKGRBLGE4 Average precision Overall statistics Recall−Precision Values (individual queries): (for 24 queries): 1.0 Query 101: 0.0056 Total number of documents Query 102: 0.7967 over all queries Query 103: 0.1951 Retrieved: 24000 Query 104: 0.0645 Relevant: 1235 Query 105: 0.4514 Rel_ret: 1010 0.8 Query 106: 0.7337 Query 107: 0.3726 Interpolated Recall - Query 108: 0.6805 Precision Averages: Query 109: 0.1462 at 0.00 0.6348 Query 110: 0.0639 at 0.10 0.5394 0.6 Query 111: 0.1259 at 0.20 0.4894 Query 113: 0.0279 at 0.30 0.4300 Query 114: 0.6052 at 0.40 0.3948 Precision Query 115: 0.7850 at 0.50 0.3609 Query 116: 0.0010 at 0.60 0.3172 0.4 Query 117: 0.0347 at 0.70 0.2471 Query 118: 0.3010 at 0.80 0.1868 Query 119: 0.0092 at 0.90 0.1083 Query 120: 0.5912 at 1.00 0.0280 Query 121: 0.0001 0.2 Query 122: 0.4640 Avg. prec. (non-interpolated) Query 123: 0.0000 for all rel. documents Query 124: 0.6670 0.3340 Query 125: 0.8926 Precision: At 5 docs: 0.5083 0.0 At 10 docs: 0.4917 0.0 0.2 0.4 0.6 0.8 1.0 At 15 docs: 0.4417 At 20 docs: 0.4333 Recall At 30 docs: 0.4125 At 100 docs: 0.2612 At 200 docs: 0.1575 Run BKGRBLGE4 At 500 docs: 0.0766 Comparison to median by topic At 1000 docs: 0.0421 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.3383 +0.5 0.0 Difference (average precision) −0.5 −1.0 101 105 110 115 120 125 Topic number UC Berkeley, GIRT German to English, Auto, TD Run BKGRBLGE5 Average precision Overall statistics Recall−Precision Values (individual queries): (for 24 queries): 1.0 Query 101: 0.0051 Total number of documents Query 102: 0.7645 over all queries Query 103: 0.1753 Retrieved: 24000 Query 104: 0.4721 Relevant: 1235 Query 105: 0.3531 Rel_ret: 968 0.8 Query 106: 0.7516 Query 107: 0.1194 Interpolated Recall - Query 108: 0.6713 Precision Averages: Query 109: 0.0930 at 0.00 0.6312 Query 110: 0.2925 at 0.10 0.5184 0.6 Query 111: 0.0827 at 0.20 0.4916 Query 113: 0.3015 at 0.30 0.4567 Query 114: 0.0237 at 0.40 0.4035 Precision Query 115: 0.7739 at 0.50 0.3691 Query 116: 0.0011 at 0.60 0.3095 0.4 Query 117: 0.0451 at 0.70 0.2533 Query 118: 0.4116 at 0.80 0.1959 Query 119: 0.8369 at 0.90 0.1468 Query 120: 0.0134 at 1.00 0.0442 Query 121: 0.0004 0.2 Query 122: 0.2404 Avg. prec. (non-interpolated) Query 123: 0.0238 for all rel. documents Query 124: 0.7597 0.3370 Query 125: 0.8764 Precision: At 5 docs: 0.5000 0.0 At 10 docs: 0.4792 0.0 0.2 0.4 0.6 0.8 1.0 At 15 docs: 0.4472 At 20 docs: 0.4167 Recall At 30 docs: 0.4042 At 100 docs: 0.2458 At 200 docs: 0.1560 Run BKGRBLGE5 At 500 docs: 0.0747 Comparison to median by topic At 1000 docs: 0.0403 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.3279 +0.5 0.0 Difference (average precision) −0.5 −1.0 101 105 110 115 120 125 Topic number UC Berkeley, GIRT English to English, Auto, TD Run BKGRMLEE1 Average precision Overall statistics Recall−Precision Values (individual queries): (for 24 queries): 1.0 Query 101: 0.0064 Total number of documents Query 102: 0.7936 over all queries Query 103: 0.0891 Retrieved: 24000 Query 104: 0.1997 Relevant: 1235 Query 105: 0.6470 Rel_ret: 1162 0.8 Query 106: 0.5990 Query 107: 0.1470 Interpolated Recall - Query 108: 0.6666 Precision Averages: Query 109: 0.0908 at 0.00 0.7644 Query 110: 0.1749 at 0.10 0.6066 0.6 Query 111: 0.0977 at 0.20 0.5131 Query 113: 0.3077 at 0.30 0.4577 Query 114: 0.7757 at 0.40 0.4205 Precision Query 115: 0.8503 at 0.50 0.3830 Query 116: 0.1707 at 0.60 0.3415 0.4 Query 117: 0.0234 at 0.70 0.2752 Query 118: 0.3991 at 0.80 0.2173 Query 119: 0.1834 at 0.90 0.1619 Query 120: 0.6136 at 1.00 0.0495 Query 121: 0.1608 0.2 Query 122: 0.1921 Avg. prec. (non-interpolated) Query 123: 0.0260 for all rel. documents Query 124: 0.9187 0.3732 Query 125: 0.8241 Precision: At 5 docs: 0.5917 0.0 At 10 docs: 0.5333 0.0 0.2 0.4 0.6 0.8 1.0 At 15 docs: 0.4972 At 20 docs: 0.4729 Recall At 30 docs: 0.4458 At 100 docs: 0.2696 At 200 docs: 0.1769 Run BKGRMLEE1 At 500 docs: 0.0891 Comparison to median by topic At 1000 docs: 0.0484 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.3589 +0.5 0.0 Difference (average precision) −0.5 −1.0 101 105 110 115 120 125 Topic number UC Berkeley, GIRT English to English, Auto, TD Run BKGRMLEE2 Average precision Overall statistics Recall−Precision Values (individual queries): (for 24 queries): 1.0 Query 101: 0.0069 Total number of documents Query 102: 0.6686 over all queries Query 103: 0.1297 Retrieved: 24000 Query 104: 0.2222 Relevant: 1235 Query 105: 0.6652 Rel_ret: 1170 0.8 Query 106: 0.4064 Query 107: 0.2286 Interpolated Recall - Query 108: 0.7099 Precision Averages: Query 109: 0.1202 at 0.00 0.7767 Query 110: 0.1511 at 0.10 0.6488 0.6 Query 111: 0.0725 at 0.20 0.5271 Query 113: 0.4353 at 0.30 0.4882 Query 114: 0.7089 at 0.40 0.4516 Precision Query 115: 0.9229 at 0.50 0.3936 Query 116: 0.1672 at 0.60 0.3486 0.4 Query 117: 0.0240 at 0.70 0.2933 Query 118: 0.4753 at 0.80 0.2275 Query 119: 0.3203 at 0.90 0.1592 Query 120: 0.5674 at 1.00 0.0593 Query 121: 0.3453 0.2 Query 122: 0.2580 Avg. prec. (non-interpolated) Query 123: 0.0431 for all rel. documents Query 124: 0.9095 0.3908 Query 125: 0.8205 Precision: At 5 docs: 0.5917 0.0 At 10 docs: 0.5375 0.0 0.2 0.4 0.6 0.8 1.0 At 15 docs: 0.5194 At 20 docs: 0.5000 Recall At 30 docs: 0.4583 At 100 docs: 0.2983 At 200 docs: 0.1940 Run BKGRMLEE2 At 500 docs: 0.0907 Comparison to median by topic At 1000 docs: 0.0488 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.3766 +0.5 0.0 Difference (average precision) −0.5 −1.0 101 105 110 115 120 125 Topic number FU Hagen, GIRT German to English, Auto, TD Run FUHe1 Average precision Overall statistics Recall−Precision Values (individual queries): (for 24 queries): 1.0 Query 101: 0.0000 Total number of documents Query 102: 0.0753 over all queries Query 103: 0.0000 Retrieved: 18006 Query 104: 0.0973 Relevant: 1235 0.8 Query 105: 0.0073 Rel_ret: 164 Query 106: 0.2444 Query 107: 0.0133 Interpolated Recall - Query 108: 0.1504 Precision Averages: Query 109: 0.0028 at 0.00 0.3208 Query 110: 0.0071 at 0.10 0.1361 0.6 Query 111: 0.0072 at 0.20 0.0628 Query 113: 0.0007 at 0.30 0.0135 Query 114: 0.0003 at 0.40 0.0054 Precision Query 115: 0.0086 at 0.50 0.0000 Query 116: 0.0088 at 0.60 0.0000 0.4 Query 117: 0.0043 at 0.70 0.0000 Query 118: 0.0323 at 0.80 0.0000 Query 119: 0.1224 at 0.90 0.0000 Query 120: 0.0012 at 1.00 0.0000 Query 121: 0.0003 0.2 Query 122: 0.0007 Avg. prec. (non-interpolated) Query 123: 0.0000 for all rel. documents Query 124: 0.0570 0.0351 Query 125: 0.0000 Precision: At 5 docs: 0.1750 0.0 At 10 docs: 0.1583 0.0 0.2 0.4 0.6 0.8 1.0 At 15 docs: 0.1222 At 20 docs: 0.0979 Recall At 30 docs: 0.0819 At 100 docs: 0.0346 At 200 docs: 0.0246 Run FUHe1 At 500 docs: 0.0115 Comparison to median by topic At 1000 docs: 0.0068 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.0528 +0.5 0.0 Difference (average precision) −0.5 −1.0 101 105 110 115 120 125 Topic number FU Hagen, GIRT German to English, Auto, TD Run FUHe2 Average precision Overall statistics Recall−Precision Values (individual queries): (for 24 queries): 1.0 Query 101: 0.0000 Total number of documents Query 102: 0.0633 over all queries Query 103: 0.0000 Retrieved: 18252 Query 104: 0.1192 Relevant: 1235 0.8 Query 105: 0.0068 Rel_ret: 164 Query 106: 0.2667 Query 107: 0.0129 Interpolated Recall - Query 108: 0.1607 Precision Averages: Query 109: 0.0028 at 0.00 0.3169 Query 110: 0.0071 at 0.10 0.1405 0.6 Query 111: 0.0067 at 0.20 0.0638 Query 113: 0.0007 at 0.30 0.0131 Query 114: 0.0003 at 0.40 0.0058 Precision Query 115: 0.0090 at 0.50 0.0000 Query 116: 0.0087 at 0.60 0.0000 0.4 Query 117: 0.0006 at 0.70 0.0000 Query 118: 0.0336 at 0.80 0.0000 Query 119: 0.1258 at 0.90 0.0000 Query 120: 0.0036 at 1.00 0.0000 Query 121: 0.0005 0.2 Query 122: 0.0012 Avg. prec. (non-interpolated) Query 123: 0.0000 for all rel. documents Query 124: 0.0549 0.0369 Query 125: 0.0000 Precision: At 5 docs: 0.2083 0.0 At 10 docs: 0.1667 0.0 0.2 0.4 0.6 0.8 1.0 At 15 docs: 0.1306 At 20 docs: 0.1062 Recall At 30 docs: 0.0778 At 100 docs: 0.0367 At 200 docs: 0.0242 Run FUHe2 At 500 docs: 0.0117 Comparison to median by topic At 1000 docs: 0.0068 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.0553 +0.5 0.0 Difference (average precision) −0.5 −1.0 101 105 110 115 120 125 Topic number FU Hagen, GIRT German to English, Auto, TD Run FUHe3 Average precision Overall statistics Recall−Precision Values (individual queries): (for 24 queries): 1.0 Query 101: 0.0000 Total number of documents Query 102: 0.0633 over all queries Query 103: 0.0000 Retrieved: 18911 Query 104: 0.1128 Relevant: 1235 0.8 Query 105: 0.0068 Rel_ret: 165 Query 106: 0.2667 Query 107: 0.0129 Interpolated Recall - Query 108: 0.1607 Precision Averages: Query 109: 0.0028 at 0.00 0.3146 Query 110: 0.0071 at 0.10 0.1395 0.6 Query 111: 0.0071 at 0.20 0.0652 Query 113: 0.0007 at 0.30 0.0132 Query 114: 0.0003 at 0.40 0.0057 Precision Query 115: 0.0082 at 0.50 0.0000 Query 116: 0.0103 at 0.60 0.0000 0.4 Query 117: 0.0006 at 0.70 0.0000 Query 118: 0.0336 at 0.80 0.0000 Query 119: 0.1258 at 0.90 0.0000 Query 120: 0.0027 at 1.00 0.0000 Query 121: 0.0003 0.2 Query 122: 0.0007 Avg. prec. (non-interpolated) Query 123: 0.0000 for all rel. documents Query 124: 0.0534 0.0365 Query 125: 0.0000 Precision: At 5 docs: 0.2083 0.0 At 10 docs: 0.1625 0.0 0.2 0.4 0.6 0.8 1.0 At 15 docs: 0.1278 At 20 docs: 0.1042 Recall At 30 docs: 0.0792 At 100 docs: 0.0358 At 200 docs: 0.0244 Run FUHe3 At 500 docs: 0.0118 Comparison to median by topic At 1000 docs: 0.0069 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.0548 +0.5 0.0 Difference (average precision) −0.5 −1.0 101 105 110 115 120 125 Topic number FU Hagen, GIRT German to English, Auto, TD Run FUHe4 Average precision Overall statistics Recall−Precision Values (individual queries): (for 24 queries): 1.0 Query 101: 0.0000 Total number of documents Query 102: 0.0633 over all queries Query 103: 0.0000 Retrieved: 18735 Query 104: 0.1128 Relevant: 1235 0.8 Query 105: 0.0068 Rel_ret: 165 Query 106: 0.2667 Query 107: 0.0129 Interpolated Recall - Query 108: 0.1607 Precision Averages: Query 109: 0.0028 at 0.00 0.3174 Query 110: 0.0071 at 0.10 0.1395 0.6 Query 111: 0.0071 at 0.20 0.0652 Query 113: 0.0007 at 0.30 0.0132 Query 114: 0.0003 at 0.40 0.0057 Precision Query 115: 0.0090 at 0.50 0.0000 Query 116: 0.0103 at 0.60 0.0000 0.4 Query 117: 0.0006 at 0.70 0.0000 Query 118: 0.0336 at 0.80 0.0000 Query 119: 0.1258 at 0.90 0.0000 Query 120: 0.0036 at 1.00 0.0000 Query 121: 0.0005 0.2 Query 122: 0.0012 Avg. prec. (non-interpolated) Query 123: 0.0000 for all rel. documents Query 124: 0.0534 0.0366 Query 125: 0.0000 Precision: At 5 docs: 0.2083 0.0 At 10 docs: 0.1667 0.0 0.2 0.4 0.6 0.8 1.0 At 15 docs: 0.1306 At 20 docs: 0.1062 Recall At 30 docs: 0.0792 At 100 docs: 0.0367 At 200 docs: 0.0246 Run FUHe4 At 500 docs: 0.0118 Comparison to median by topic At 1000 docs: 0.0069 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.0553 +0.5 0.0 Difference (average precision) −0.5 −1.0 101 105 110 115 120 125 Topic number FU Hagen, GIRT German to English, Auto, TD Run FUHe5 Average precision Overall statistics Recall−Precision Values (individual queries): (for 24 queries): 1.0 Query 101: 0.0000 Total number of documents Query 102: 0.1269 over all queries Query 103: 0.0000 Retrieved: 12766 Query 104: 0.0991 Relevant: 1235 Query 105: 0.0592 Rel_ret: 156 0.8 Query 106: 0.0020 Query 107: 0.0024 Interpolated Recall - Query 108: 0.1397 Precision Averages: Query 109: 0.0012 at 0.00 0.3192 Query 110: 0.0005 at 0.10 0.0950 0.6 Query 111: 0.0027 at 0.20 0.0325 Query 113: 0.0007 at 0.30 0.0116 Query 114: 0.0102 at 0.40 0.0078 Precision Query 115: 0.0104 at 0.50 0.0000 Query 116: 0.0010 at 0.60 0.0000 0.4 Query 117: 0.0034 at 0.70 0.0000 Query 118: 0.0132 at 0.80 0.0000 Query 119: 0.0497 at 0.90 0.0000 Query 120: 0.0016 at 1.00 0.0000 Query 121: 0.0002 0.2 Query 122: 0.0013 Avg. prec. (non-interpolated) Query 123: 0.0000 for all rel. documents Query 124: 0.0249 0.0229 Query 125: 0.0002 Precision: At 5 docs: 0.1167 0.0 At 10 docs: 0.1167 0.0 0.2 0.4 0.6 0.8 1.0 At 15 docs: 0.1083 At 20 docs: 0.1021 Recall At 30 docs: 0.0764 At 100 docs: 0.0387 At 200 docs: 0.0258 Run FUHe5 At 500 docs: 0.0129 Comparison to median by topic At 1000 docs: 0.0065 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.0477 +0.5 0.0 Difference (average precision) −0.5 −1.0 101 105 110 115 120 125 Topic number IRIT, GIRT English to English, Auto, T Run run1T Average precision Overall statistics Recall−Precision Values (individual queries): (for 24 queries): 1.0 Query 101: 0.0238 Total number of documents Query 102: 0.4941 over all queries Query 103: 0.0122 Retrieved: 21681 Query 104: 0.3279 Relevant: 1235 0.8 Query 105: 0.4775 Rel_ret: 1013 Query 106: 1.0000 Query 107: 0.0214 Interpolated Recall - Query 108: 0.5247 Precision Averages: Query 109: 0.3295 at 0.00 0.7741 Query 110: 0.2722 at 0.10 0.6067 0.6 Query 111: 0.2782 at 0.20 0.5644 Query 113: 0.6721 at 0.30 0.5073 Query 114: 0.7412 at 0.40 0.4438 Precision Query 115: 0.7088 at 0.50 0.4024 Query 116: 0.0289 at 0.60 0.3264 0.4 Query 117: 0.0563 at 0.70 0.2513 Query 118: 0.2732 at 0.80 0.1973 Query 119: 0.1239 at 0.90 0.1223 Query 120: 0.1619 at 1.00 0.0616 Query 121: 0.3744 0.2 Query 122: 0.1419 Avg. prec. (non-interpolated) Query 123: 0.2955 for all rel. documents Query 124: 0.9233 0.3740 Query 125: 0.7140 Precision: At 5 docs: 0.6000 0.0 At 10 docs: 0.5625 0.0 0.2 0.4 0.6 0.8 1.0 At 15 docs: 0.5250 At 20 docs: 0.4917 Recall At 30 docs: 0.4444 At 100 docs: 0.2475 At 200 docs: 0.1448 Run run1T At 500 docs: 0.0743 Comparison to median by topic At 1000 docs: 0.0422 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.3974 +0.5 0.0 Difference (average precision) −0.5 −1.0 101 105 110 115 120 125 Topic number IRIT, GIRT English to English, Auto, TD Run run2TD Average precision Overall statistics Recall−Precision Values (individual queries): (for 24 queries): 1.0 Query 101: 0.0130 Total number of documents Query 102: 0.4803 over all queries Query 103: 0.0096 Retrieved: 24000 Query 104: 0.4040 Relevant: 1235 0.8 Query 105: 0.5007 Rel_ret: 1097 Query 106: 1.0000 Query 107: 0.0969 Interpolated Recall - Query 108: 0.5278 Precision Averages: Query 109: 0.2183 at 0.00 0.7612 Query 110: 0.3102 at 0.10 0.6161 0.6 Query 111: 0.2218 at 0.20 0.5437 Query 113: 0.5887 at 0.30 0.5162 Query 114: 0.7484 at 0.40 0.4580 Precision Query 115: 0.7893 at 0.50 0.4127 Query 116: 0.1422 at 0.60 0.3671 0.4 Query 117: 0.1079 at 0.70 0.3029 Query 118: 0.4848 at 0.80 0.2176 Query 119: 0.0815 at 0.90 0.1253 Query 120: 0.4658 at 1.00 0.0564 Query 121: 0.0568 0.2 Query 122: 0.2820 Avg. prec. (non-interpolated) Query 123: 0.0421 for all rel. documents Query 124: 0.9266 0.3855 Query 125: 0.7524 Precision: At 5 docs: 0.5750 0.0 At 10 docs: 0.5375 0.0 0.2 0.4 0.6 0.8 1.0 At 15 docs: 0.5306 At 20 docs: 0.5125 Recall At 30 docs: 0.4556 At 100 docs: 0.2650 At 200 docs: 0.1650 Run run2TD At 500 docs: 0.0831 Comparison to median by topic At 1000 docs: 0.0457 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.3836 +0.5 0.0 Difference (average precision) −0.5 −1.0 101 105 110 115 120 125 Topic number IRIT, GIRT English to English, Auto, TD Run run3TDfc Average precision Overall statistics Recall−Precision Values (individual queries): (for 24 queries): 1.0 Query 101: 0.0130 Total number of documents Query 102: 0.3019 over all queries Query 103: 0.0110 Retrieved: 24000 Query 104: 0.4222 Relevant: 1235 0.8 Query 105: 0.4990 Rel_ret: 1080 Query 106: 1.0000 Query 107: 0.0948 Interpolated Recall - Query 108: 0.5278 Precision Averages: Query 109: 0.2183 at 0.00 0.7592 Query 110: 0.3102 at 0.10 0.6135 0.6 Query 111: 0.2218 at 0.20 0.5372 Query 113: 0.5887 at 0.30 0.4717 Query 114: 0.7142 at 0.40 0.4275 Precision Query 115: 0.7893 at 0.50 0.3967 Query 116: 0.1422 at 0.60 0.3473 0.4 Query 117: 0.0908 at 0.70 0.2907 Query 118: 0.4848 at 0.80 0.2306 Query 119: 0.0831 at 0.90 0.1361 Query 120: 0.3233 at 1.00 0.0682 Query 121: 0.0568 0.2 Query 122: 0.2820 Avg. prec. (non-interpolated) Query 123: 0.0421 for all rel. documents Query 124: 0.9260 0.3764 Query 125: 0.8915 Precision: At 5 docs: 0.5750 0.0 At 10 docs: 0.5292 0.0 0.2 0.4 0.6 0.8 1.0 At 15 docs: 0.5111 At 20 docs: 0.4938 Recall At 30 docs: 0.4389 At 100 docs: 0.2621 At 200 docs: 0.1648 Run run3TDfc At 500 docs: 0.0825 Comparison to median by topic At 1000 docs: 0.0450 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.3817 +0.5 0.0 Difference (average precision) −0.5 −1.0 101 105 110 115 120 125 Topic number IRIT, GIRT English to English, Auto, TD Run run4TDWN Average precision Overall statistics Recall−Precision Values (individual queries): (for 24 queries): 1.0 Query 101: 0.0101 Total number of documents Query 102: 0.4819 over all queries Query 103: 0.0280 Retrieved: 24000 Query 104: 0.2655 Relevant: 1235 0.8 Query 105: 0.6110 Rel_ret: 1106 Query 106: 1.0000 Query 107: 0.1405 Interpolated Recall - Query 108: 0.4354 Precision Averages: Query 109: 0.2183 at 0.00 0.7817 Query 110: 0.3315 at 0.10 0.6164 0.6 Query 111: 0.2123 at 0.20 0.5030 Query 113: 0.1767 at 0.30 0.4806 Query 114: 0.7483 at 0.40 0.4101 Precision Query 115: 0.7859 at 0.50 0.3753 Query 116: 0.1040 at 0.60 0.3389 0.4 Query 117: 0.1136 at 0.70 0.2723 Query 118: 0.4532 at 0.80 0.1946 Query 119: 0.0830 at 0.90 0.1096 Query 120: 0.4722 at 1.00 0.0588 Query 121: 0.0916 0.2 Query 122: 0.2820 Avg. prec. (non-interpolated) Query 123: 0.0380 for all rel. documents Query 124: 0.8995 0.3640 Query 125: 0.7524 Precision: At 5 docs: 0.5917 0.0 At 10 docs: 0.5333 0.0 0.2 0.4 0.6 0.8 1.0 At 15 docs: 0.5083 At 20 docs: 0.4833 Recall At 30 docs: 0.4333 At 100 docs: 0.2587 At 200 docs: 0.1633 Run run4TDWN At 500 docs: 0.0839 Comparison to median by topic At 1000 docs: 0.0461 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.3663 +0.5 0.0 Difference (average precision) −0.5 −1.0 101 105 110 115 120 125 Topic number IRIT, GIRT English to English, Auto, T Run run4TWN Average precision Overall statistics Recall−Precision Values (individual queries): (for 24 queries): 1.0 Query 101: 0.0238 Total number of documents Query 102: 0.4941 over all queries Query 103: 0.0106 Retrieved: 21907 Query 104: 0.3279 Relevant: 1235 0.8 Query 105: 0.4775 Rel_ret: 1014 Query 106: 1.0000 Query 107: 0.0170 Interpolated Recall - Query 108: 0.5247 Precision Averages: Query 109: 0.3592 at 0.00 0.7665 Query 110: 0.3012 at 0.10 0.6145 0.6 Query 111: 0.2782 at 0.20 0.5691 Query 113: 0.6794 at 0.30 0.5073 Query 114: 0.7412 at 0.40 0.4493 Precision Query 115: 0.7110 at 0.50 0.3981 Query 116: 0.0289 at 0.60 0.3256 0.4 Query 117: 0.0563 at 0.70 0.2525 Query 118: 0.2716 at 0.80 0.1970 Query 119: 0.1236 at 0.90 0.1207 Query 120: 0.1658 at 1.00 0.0603 Query 121: 0.3788 0.2 Query 122: 0.1418 Avg. prec. (non-interpolated) Query 123: 0.2803 for all rel. documents Query 124: 0.9233 0.3764 Query 125: 0.7172 Precision: At 5 docs: 0.6083 0.0 At 10 docs: 0.5667 0.0 0.2 0.4 0.6 0.8 1.0 At 15 docs: 0.5250 At 20 docs: 0.4917 Recall At 30 docs: 0.4444 At 100 docs: 0.2467 At 200 docs: 0.1446 Run run4TWN At 500 docs: 0.0745 Comparison to median by topic At 1000 docs: 0.0422 +1.0 R-Precision (prec. after R (=num_rel) docs. retrieved): Exact: 0.3961 +0.5 0.0 Difference (average precision) −0.5 −1.0 101 105 110 115 120 125 Topic number