Institution Country Run Tag Task Top. Lang. Top. Fld. Run Type Judged?
Université de Neuchâtel Switzerland UniNEBpt1 Bi-PT EN TD Auto Y
Université de Neuchâtel Switzerland UniNEBpt2 Bi-PT EN TD Auto Y
Université de Neuchâtel Switzerland UniNEBru1 Bi-RU EN TD Auto
Université de Neuchâtel Switzerland UniNEBru2 Bi-RU EN TD Auto
Université de Neuchâtel Switzerland UniNEfi1 Mono FI TD Auto Y
Université de Neuchâtel Switzerland UniNEfi2 Mono FI TD Auto Y
Université de Neuchâtel Switzerland UniNEfi3 Mono FI TDN Auto
Université de Neuchâtel Switzerland UniNEfr1 Mono FR TD Auto
Université de Neuchâtel Switzerland UniNEfr2 Mono FR TD Auto
Université de Neuchâtel Switzerland UniNEfr3 Mono FR TDN Auto Y
Université de Neuchâtel Switzerland UniNEmulti1 Multi EN TD Auto Y
Université de Neuchâtel Switzerland UniNEmulti2 Multi EN TD Auto Y
Université de Neuchâtel Switzerland UniNEmulti3 Multi EN TD Auto Y
Université de Neuchâtel Switzerland UniNEmulti4 Multi EN TD Auto
Université de Neuchâtel Switzerland UniNEmulti5 Multi EN TD Auto
Université de Neuchâtel Switzerland UniNEpt1 Mono PT TD Auto Y
Université de Neuchâtel Switzerland UniNEpt2 Mono PT TD Auto Y
Université de Neuchâtel Switzerland UniNEpt3 Mono PT TD Auto
Université de Neuchâtel Switzerland UniNEru1 Mono RU TD Auto
Université de Neuchâtel Switzerland UniNEru2 Mono RU TD Auto
Université de Neuchâtel Switzerland UniNEru3 Mono RU TDN Auto Y
Thomson Legal USA tlrde2fr1 Bi-FR DE TD Auto Y
Thomson Legal USA tlrde2fr2 Bi-FR DE TD Auto
Thomson Legal USA tlrde2fr3 Bi-FR DE TD Auto
Thomson Legal USA tlrde2fr4 Bi-FR DE TD Auto
Thomson Legal USA tlrfi1 Mono FI TD Auto Y
Thomson Legal USA tlrfi2 Mono FI TD Auto
Thomson Legal USA tlrpt1 Mono PT TD Auto Y
Thomson Legal USA tlrpt2 Mono PT TD Auto
Thomson Legal USA tlrru1 Mono RU TD Auto Y
Thomson Legal USA tlrru2 Mono RU TD Auto
SICS Sweden stockholmAmEnA Bi-EN AM TD Manual Y
SICS Sweden stockholmAmEnI Bi-EN AM TD Manual Y
SICS Sweden SICSsvfrQF Bi-FR SV TD Auto Y
CEA/LIC2M France lic2men1 Multi EN TD Auto Y
CEA/LIC2M France lic2men2 Multi EN TDN Auto
CEA/LIC2M France lic2mfr1 Multi FR TDN Auto Y
Universidad de Evora Portugal alentejo1 Mono PT T Auto Y
Universidad de Evora Portugal alentejo2 Mono PT T Auto Y
ILTG Canada ltrcbifren1 Bi-EN FR TDN Auto Y
ILTG Canada ltrcbifren2 Bi-EN FR TDN Auto Y
ILTG Canada ltrcbifren3 Bi-EN FR TDN Auto Y
ILTG Canada ltrcbifren4 Bi-EN FR TDN Auto Y
ILTG Canada ltrcbifren5 Bi-EN FR TDN Auto Y
ILTG Canada ltrcmonofr1 Mono FR TDN Auto
ILTG Canada ltrcmonofr2 Mono FR TDN Auto
ILTG Canada ltrcmonofr3 Mono FR TDN Auto Y
ILTG Canada ltrcmonofr4 Mono FR TDN Auto
U Jaen/SINAI Spain UJAMLRL Multi EN TD Auto
U Jaen/SINAI Spain UJAMLRL2P Multi EN TD Auto Y
U Jaen/SINAI Spain UJAMLRL3P Multi EN TD Auto Y
U Jaen/SINAI Spain UJAMLRLRP Multi EN TD Auto
U Jaen/SINAI Spain UJAMLRSV2 Multi EN TD Auto Y
CLIPS France CLIPS04ENFI1 Bi-FI EN TDN Auto Y
CLIPS France CLIPS04ENRU1 Bi-RU EN TDN Auto
CLIPS France CLIPS04ENRU2 Bi-RU EN TDN Auto
CLIPS France CLIPS04FRFI1 Bi-FI FR TDN Auto Y
CLIPS France CLIPS04FRRU1 Bi-RU FR TDN Auto
CLIPS France CLIPS04FRRU2 Bi-RU FR TDN Auto
CLIPS France CLIPS04MNFI1 Mono FI TDN Auto Y
CLIPS France CLIPS04MNFR1 Mono FR TDN Auto Y
CLIPS France CLIPS04MNRU1 Mono RU TDN Auto Y
Hummingbird Canada humFI04t Mono FI T Auto Y
Hummingbird Canada humFI04td Mono FI TD Auto Y
Hummingbird Canada humFI04tde Mono FI TD Auto
Hummingbird Canada humFR04t Mono FR T Auto Y
Hummingbird Canada humFR04td Mono FR TD Auto
Hummingbird Canada humFR04tde Mono FR TD Auto
Hummingbird Canada humPT04t Mono PT T Auto Y
Hummingbird Canada humPT04td Mono PT TD Auto Y
Hummingbird Canada humPT04tde Mono PT TD Auto
Institution Country Run Tag Task Top. Lang. Top. Fld. Run Type Judged?
Hummingbird Canada humRU04t Mono RU T Auto Y
Hummingbird Canada humRU04td Mono RU TD Auto
Hummingbird Canada humRU04tde Mono RU TD Auto
U Oviedo Spain uoviESEN Bi-EN ES TD Auto Y
U Oviedo Spain uoviRU Mono RU TD Auto Y
U Amsterdam Netherlands UAmsC04AmEn4GiSb Bi-EN AM TD Auto Y
U Amsterdam Netherlands UAmsC04AmEnAll Bi-EN AM TD Auto Y
U Amsterdam Netherlands UAmsC04AmEnWrd Bi-EN AM TD Auto Y
U Amsterdam Netherlands UAmsC04EnMu3Way Multi EN TD Auto Y
U Amsterdam Netherlands UAmsC04EnMu4Gr Multi EN TD Auto Y
U Amsterdam Netherlands UAmsC04EnMuAll Multi EN TD Auto Y
U Amsterdam Netherlands UAmsC04EnMuAll2 Multi EN TD Auto
U Amsterdam Netherlands UAmsC04EnMuWSLM Multi EN TD Auto
U Amsterdam Netherlands UAmsC04EnPo4GiSb Bi-PT EN TD Auto Y
U Amsterdam Netherlands UAmsC04EnPo4iSPC Bi-PT EN TD Auto Y
U Amsterdam Netherlands UAmsC04EnPo4iSWL Bi-PT EN TD Auto
U Amsterdam Netherlands UAmsC04EnPoAll Bi-PT EN TD Auto Y
U Amsterdam Netherlands UAmsC04FiFi4GiSb Mono FI TD Auto Y
U Amsterdam Netherlands UAmsC04FiFi4GiWd Mono FI TD Auto
U Amsterdam Netherlands UAmsC04FiFiAll Mono FI TD Auto
U Amsterdam Netherlands UAmsC04FrFr4GiSb Mono FR TD Auto Y
U Amsterdam Netherlands UAmsC04FrFr4GiWd Mono FR TD Auto
U Amsterdam Netherlands UAmsC04FrFrAll Mono FR TD Auto
U Amsterdam Netherlands UAmsC04PoPo4GiSb Mono PT TD Auto Y
U Amsterdam Netherlands UAmsC04PoPo4GiWd Mono PT TD Auto Y
U Amsterdam Netherlands UAmsC04PoPoAll Mono PT TD Auto
U Amsterdam Netherlands UAmsC04RuRu4GiSb Mono RU TD Auto Y
U Amsterdam Netherlands UAmsC04RuRu4GiWd Mono RU TD Auto
U Amsterdam Netherlands UAmsC04RuRuAll Mono RU TD Auto
FU Hagen Germany FUHdm GIRT-DE DE TD Auto Y
FU Hagen Germany FUHdrw GIRT-DE DE TD Auto Y
FU Hagen Germany FUHds1 GIRT-DE DE TD Auto Y
FU Hagen Germany FUHdw1 GIRT-DE DE TD Auto Y
FU Hagen Germany FUHdw2 GIRT-DE DE TD Auto Y
FU Hagen Germany FUHe1 GIRT-EN DE TD Auto Y
FU Hagen Germany FUHe2 GIRT-EN DE TD Auto Y
FU Hagen Germany FUHe3 GIRT-EN DE TD Auto Y
FU Hagen Germany FUHe4 GIRT-EN DE TD Auto Y
FU Hagen Germany FUHe5 GIRT-EN DE TD Auto Y
Daedalus Spain de2frR2FWnormal Bi-FR DE TD Auto
Daedalus Spain de2frR3FWnormal Bi-FR DE TD Auto Y
Daedalus Spain de2frcomb1s101 Bi-FR DE TD Auto
Daedalus Spain de2frcomb2s201 Bi-FR DE TD Auto
Daedalus Spain frav7 Mono FR TD Auto Y
Daedalus Spain frav8 Mono FR TD Auto
Daedalus Spain frcomb1s201 Mono FR TD Auto
Daedalus Spain frcomb2s201 Mono FR TD Auto
Daedalus Spain nl2frR4FWnormal Bi-FR NL TD Auto Y
Daedalus Spain nl2frR5FWnormal Bi-FR NL TD Auto
Daedalus Spain nl2frav Bi-FR NL TD Auto
Daedalus Spain nl2frcomb1s101 Bi-FR NL TD Auto
Daedalus Spain ruR1FWnormal Mono RU TD Auto Y
Daedalus Spain ruav7 Mono RU TD Auto
Daedalus Spain ruav8 Mono RU TD Auto Y
Daedalus Spain rucomb1s101 Mono RU TD Auto
U Padua Italy IMSBDEFRN100 Bi-FR DE TD Auto
U Padua Italy IMSBDEFRN50 Bi-FR DE TD Auto
U Padua Italy IMSBDEFRP100 Bi-FR DE TD Auto
U Padua Italy IMSBDEFRP50 Bi-FR DE TD Auto
U Padua Italy IMSBDEFRUd651 Bi-FR DE TD Auto
U Padua Italy IMSBDEFRUd655 Bi-FR DE TD Auto Y
U Padua Italy IMSMFIN Mono FI TD Auto
U Padua Italy IMSMFIP Mono FI TD Auto
U Padua Italy IMSMFIPqe Mono FI TD Auto
U Padua Italy IMSMFIUa65 Mono FI TD Auto Y
U Padua Italy IMSMFIUd65 Mono FI TD Auto Y
U Padua Italy IMSMFRN Mono FR TD Auto
U Padua Italy IMSMFRP Mono FR TD Auto
U Padua Italy IMSMFRPqe Mono FR TD Auto
U Padua Italy IMSMFRUd65 Mono FR TD Auto Y
U Padua Italy IMSMRUN Mono RU TD Auto Y
Institution Country Run Tag Task Top. Lang. Top. Fld. Run Type Judged?
U Padua Italy IMSMRUUd65 Mono RU TD Auto
U Padua Italy IMSMRUUd65qe Mono RU TD Auto
U Alicante Spain IRn-MR-Dexp Mono RU TD Auto Y
U Alicante Spain IRn-MR-Pexp Mono RU TD Auto
U Alicante Spain IRn-MR-nexp Mono RU TD Auto
U Alicante Spain IRn-BEnR-Dexp Bi-RU EN TD Auto
U Alicante Spain IRn-BEnR-nexp Bi-RU EN TD Auto
U Alicante Spain IRn-BEsR-Dexp Bi-RU ES TD Auto
U Alicante Spain IRn-BEsR-nexp Bi-RU ES TD Auto
U Alicante Spain IRn-BEnPM-Pexp Bi-PT EN TD Auto Y
U Alicante Spain IRn-BEnPF-Pexp Bi-PT EN TD Auto Y
U Alicante Spain IRn-BEnPM-nexp Bi-PT EN TD Auto Y
U Alicante Spain IRn-BEnPF-nexp Bi-PT EN TD Auto Y
U Alicante Spain IRn-BEsPM-Pexp Bi-PT ES TD Auto
U Alicante Spain IRn-BEsPM-nexp Bi-PT ES TD Auto
U Alicante Spain IRn-MP-Pexp Mono PT TD Auto Y
U Alicante Spain IRn-MP-Dexp Mono PT TD Auto Y
U Alicante Spain IRn-MF-Dexp Mono FI TD Auto Y
U Alicante Spain IRn-MF-Pexp Mono FI TD Auto
U Alicante Spain IRn-MF-nexp Mono FI TD Auto
U Alicante Spain IRn-MFr-Dexp Mono FR TD Auto Y
U Alicante Spain IRn-MFr-Pexp Mono FR TD Auto
U Alicante Spain IRn-MFr-nexp Mono FR TD Auto
U Alicante Spain IRn-Mu-Pexp Multi EN TD Auto Y
U Alicante Spain IRn-Mu-Dexp Multi EN TD Auto Y
U Alicante Spain IRn-Mu-nexp Multi EN TD Auto
U Alicante Spain IRn-MP-nexp Mono PT TD Auto Y
NII Group Japan NiiDic03 Bi-FR DE TD Auto
NII Group Japan NiiDic04 Bi-FR DE TD Auto
NII Group Japan NiiDic05 Bi-FR DE TD Auto
NII Group Japan NiiFF01 Mono FR TD Auto Y
NII Group Japan NiiMt02 Bi-FR DE TD Auto Y
U Hildesheim Germany UHIenru1 Bi-RU EN TD Auto
U Hildesheim Germany UHIenru2 Bi-RU EN TD Auto
U Hildesheim Germany UHIenru3 Bi-RU EN TD Auto
U Hildesheim Germany UHIfi1 Mono FI TD Auto Y
U Hildesheim Germany UHIfi2 Mono FI TD Auto Y
U Hildesheim Germany UHImlt1 Multi EN TD Auto Y
U Hildesheim Germany UHImlt2 Multi EN TD Auto Y
U Hildesheim Germany UHIru1 Mono RU TD Auto Y
U Hildesheim Germany UHIru2 Mono RU TD Auto
U Hildesheim Germany UHIru3 Mono RU TD Auto
FCUL Lisbon Portugal XLDBTumba01 Mono PT missing Manual Y
FCUL Lisbon Portugal XLDBTumba02 Mono PT missing Manual Y
FCUL Lisbon Portugal XLDBTumba04 Mono PT missing Manual
FCUL Lisbon Portugal XLDBTumba05 Mono PT missing Manual
IRIT France run1T GIRT-EN EN T Auto Y
IRIT France run2TD GIRT-EN EN TD Auto Y
IRIT France run3TDfc GIRT-EN EN TD Auto Y
IRIT France run4TDWN GIRT-EN EN TD Auto Y
IRIT France run4TWN GIRT-EN EN T Auto Y
UC Berkeley USA BKGRBLEG1 GIRT-DE EN TD Auto Y
UC Berkeley USA BKGRBLEG2 GIRT-DE EN TD Auto Y
UC Berkeley USA BKGRBLEG3 GIRT-DE EN TD Auto Y
UC Berkeley USA BKGRBLEG4 GIRT-DE EN TD Auto Y
UC Berkeley USA BKGRBLEG5 GIRT-DE EN TD Auto Y
UC Berkeley USA BKGRBLGE1 GIRT-EN DE TD Auto Y
UC Berkeley USA BKGRBLGE2 GIRT-EN DE TD Auto Y
UC Berkeley USA BKGRBLGE3 GIRT-EN DE TD Auto Y
UC Berkeley USA BKGRBLGE4 GIRT-EN DE TD Auto Y
UC Berkeley USA BKGRBLGE5 GIRT-EN DE TD Auto Y
UC Berkeley USA BKGRMLEE1 GIRT-EN EN TD Auto Y
UC Berkeley USA BKGRMLEE2 GIRT-EN EN TD Auto Y
UC Berkeley USA BKGRMLGG0 GIRT-DE DE TD Auto Y
UC Berkeley USA BKGRMLGG1 GIRT-DE DE TD Auto Y
UC Berkeley USA BKGRMLGG2 GIRT-DE DE TD Auto Y
UC Berkeley USA BKRUBLER1 Bi-RU EN TDN Auto
UC Berkeley USA BKRUBLER2 Bi-RU EN TDN Auto
UC Berkeley USA BKRUBLER3 Bi-RU EN TD Auto
UC Berkeley USA BKRUBLER4 Bi-RU EN TDN Auto Y
UC Berkeley USA BKRUBLJR1 Bi-RU JP TD Auto
Institution Country Run Tag Task Top. Lang. Top. Fld. Run Type Judged?
UC Berkeley USA BKRUBLJR2 Bi-RU JP TDN Auto
UC Berkeley USA BKRUBLCR1 Bi-RU ZH TD Auto
UC Berkeley USA BKRUBLCR2 Bi-RU ZH TDN Auto
UC Berkeley USA BKRUMLRR1 Mono RU TD Auto
UC Berkeley USA BKRUMLRR2 Mono RU TDN Auto Y
Dublin City University Ireland exefinmono04a Mono FI TD Auto Y
Dublin City University Ireland exefinmono04l Mono FI TD Auto Y
Dublin City University Ireland exefinmono04q Mono FI TD Auto Y
Dublin City University Ireland exefinmono04t Mono FI TD Auto
Dublin City University Ireland exefrde04a Bi-FR DE TD Auto
Dublin City University Ireland exefrde04q Bi-FR DE TD Auto Y
Dublin City University Ireland exefrde04t Bi-FR DE TD Auto
Dublin City University Ireland exefrmono04a Mono FR TD Auto
Dublin City University Ireland exefrmono04q Mono FR TD Auto Y
Dublin City University Ireland exefrmono04t Mono FR TD Auto
Dublin City University Ireland exefrmonosys04a Mono FR TD Auto
Dublin City University Ireland exefrnl04a Bi-FR NL TD Auto
Dublin City University Ireland exefrnl04t Bi-FR NL TD Auto
Dublin City University Ireland exemult1s Multi EN TD Auto Y
Dublin City University Ireland exemult2s Multi EN TD Auto Y
Dublin City University Ireland exemult3s Multi EN TD Auto Y
Dublin City University Ireland exemult4s Multi EN TD Auto
Dublin City University Ireland exemult5s Multi EN TD Auto
Dublin City University Ireland exerussbi04a Bi-RU EN TD Auto Y
Dublin City University Ireland exerussbi04l Bi-RU EN TD Auto
Dublin City University Ireland exerussbi04q Bi-RU EN TD Auto
Dublin City University Ireland exerussbi04t Bi-RU EN TD Auto
Dublin City University Ireland exerussmono04a Mono RU TD Auto Y
Dublin City University Ireland exerussmono04l Mono RU TD Auto
Dublin City University Ireland exerussmono04q Mono RU TD Auto
Dublin City University Ireland exerussmono04t1 Mono RU TD Auto
Dublin City University Ireland exerussbi04amg Bi-RU EN TD Auto
Ricoh Japan rdedetde04 GIRT-DE DE TD Auto Y
Ricoh Japan rendetde04 GIRT-DE EN TD Auto Y
SUNY Buffalo USA UBmonoEN01 Mono EN TD Auto Y
SUNY Buffalo USA UBmonoFI01 Mono FI TD Auto Y
SUNY Buffalo USA UBmonoFR01 Mono FR TD Auto Y
SUNY Buffalo USA UBmonoRU01 Mono RU TD Auto Y
SUNY Buffalo USA UBmult01 Multi EN TD Auto Y
SUNY Buffalo USA UBmult02 Multi EN TD Auto Y
SUNY Buffalo USA UBmulti03 Multi EN TD Auto
JHU/APL USA aplbibgrub Bi-RU BG TD Auto Y
JHU/APL USA aplbidefra Bi-FR DE TD Auto Y
JHU/APL USA aplbienpta Bi-PT EN TD Auto Y
JHU/APL USA aplbiesfia Bi-FI ES TD Auto Y
JHU/APL USA aplbiespta Bi-PT ES TD Auto Y
JHU/APL USA aplbiesptb Bi-PT ES TD Auto Y
JHU/APL USA aplbifrfia Bi-FI FR TD Auto
JHU/APL USA aplbinlfra Bi-FR NL TD Auto Y
JHU/APL USA aplmofia Mono FI TD Auto Y
JHU/APL USA aplmofib Mono FI TD Auto
JHU/APL USA aplmofic Mono FI TD Auto
JHU/APL USA aplmofra Mono FR TD Auto Y
JHU/APL USA aplmofrb Mono FR TD Auto
JHU/APL USA aplmofrc Mono FR TD Auto
JHU/APL USA aplmopta Mono PT TD Auto Y
JHU/APL USA aplmoptb Mono PT TD Auto Y
JHU/APL USA aplmoptc Mono PT TD Auto
JHU/APL USA aplmorua Mono RU TD Auto Y
JHU/APL USA aplmorub Mono RU TD Auto
JHU/APL USA aplmoruc Mono RU TD Auto
U Chicago USA UCEMULT2 Multi EN T Auto Y
U Chicago USA UCEMULTD1 Multi EN TD Auto Y
U Chicago USA UCEMULdecT3 Multi EN T Auto
U Chicago USA UCEMULlppT4 Multi EN T Auto
U Chicago USA UCERBiT1 Bi-RU EN T Auto Y
U Glasgow UK UOGLQ Mono FR TDN Auto
U Glasgow UK UOGLQQE Mono FR TDN Auto Y
U Glasgow UK UOGSQ Mono FR T Auto
U Glasgow UK UOGSQQE Mono FR T Auto
Multilingual; Recall−Precision Graph
Top performing experiments by the best five groups; TD topic fields; Automatic
1.0
0.3427 U Amsterdam
0.3341 U Jaen/SINAI
0.8 0.3090 U Neuchâtel
0.2748 SUNY Buffalo
0.2745 Dublin City U
0.6
Precision
0.4
0.2
0.0
0.0 0.2 0.4 0.6 0.8 1.0
Recall
Bilingual to EN; Recall−Precision Graph
Top performing experiments by the best five groups; TD topic fields; Automatic
1.0
0.3470 U Amsterdam
0.0644 U Oviedo
0.8
0.6
Precision
0.4
0.2
0.0
0.0 0.2 0.4 0.6 0.8 1.0
Recall
Bilingual to FI; Recall−Precision Graph
Top performing experiments by the best five groups; TD topic fields; Automatic
1.0
0.2982 JHU/APL
0.8
0.6
Precision
0.4
0.2
0.0
0.0 0.2 0.4 0.6 0.8 1.0
Recall
Bilingual to FR; Recall−Precision Graph
Top performing experiments by the best five groups; TD topic fields; Automatic
1.0
0.3753 JHU/APL
0.3750 Thomson Legal
0.8 0.3505 Daedalus
0.3368 NII Group
0.3339 Dublin City U
0.6
Precision
0.4
0.2
0.0
0.0 0.2 0.4 0.6 0.8 1.0
Recall
Bilingual to PT; Recall−Precision Graph
Top performing experiments by the best five groups; TD topic fields; Automatic
1.0
0.4704 U Neuchâtel
0.4537 JHU/APL
0.8
0.4366 U Amsterdam
0.3243 U Alicante
0.6
Precision
0.4
0.2
0.0
0.0 0.2 0.4 0.6 0.8 1.0
Recall
Bilingual to RU; Recall−Precision Graph
Top performing experiments by the best five groups; TD topic fields; Automatic
1.0
0.3357 U Alicante
0.3291 UC Berkeley
0.8 0.3210 Dublin City U
0.3007 U Neuchâtel
0.1407 JHU/APL
0.6
Precision
0.4
0.2
0.0
0.0 0.2 0.4 0.6 0.8 1.0
Recall
Monolingual EN; Recall−Precision Graph
Top performing experiments by the best five groups; TD topic fields; Automatic
1.0
0.5167 SUNY Buffalo
0.8
0.6
Precision
0.4
0.2
0.0
0.0 0.2 0.4 0.6 0.8 1.0
Recall
Monolingual FI; Recall−Precision Graph
Top performing experiments by the best five groups; TD topic fields; Automatic
1.0
0.6367 Hummingbird
0.5562 Thomson Legal
0.8 0.5453 U Neuchâtel
0.5443 JHU/APL
0.5203 U Amsterdam
0.6
Precision
0.4
0.2
0.0
0.0 0.2 0.4 0.6 0.8 1.0
Recall
Monolingual FR; Recall−Precision Graph
Top performing experiments by the best five groups; TD topic fields; Automatic
1.0
0.4926 Hummingbird
0.4849 U Neuchâtel
0.8 0.4673 Daedalus
0.4629 SUNY Buffalo
0.4581 JHU/APL
0.6
Precision
0.4
0.2
0.0
0.0 0.2 0.4 0.6 0.8 1.0
Recall
Monolingual PT; Recall−Precision Graph
Top performing experiments by the best five groups; TD topic fields; Automatic
1.0
0.5188 U Neuchâtel
0.4750 Hummingbird
0.8 0.4691 JHU/APL
0.4469 Thomson Legal
0.4326 U Amsterdam
0.6
Precision
0.4
0.2
0.0
0.0 0.2 0.4 0.6 0.8 1.0
Recall
Monolingual RU; Recall−Precision Graph
Top performing experiments by the best five groups; TD topic fields; Automatic
1.0
0.4809 U Alicante
0.4431 Hummingbird
0.8 0.4412 U Amsterdam
0.4204 UC Berkeley
0.3790 Dublin City U
0.6
Precision
0.4
0.2
0.0
0.0 0.2 0.4 0.6 0.8 1.0
Recall
GIRT to DE; Recall−Precision Graph
Top performing experiments by the best five groups; TD topic fields; Automatic
1.0
0.4177 UC Berkeley
0.2482 FU Hagen
0.8 0.2381 Ricoh
0.6
Precision
0.4
0.2
0.0
0.0 0.2 0.4 0.6 0.8 1.0
Recall
GIRT to EN; Recall−Precision Graph
Top performing experiments by the best five groups; TD topic fields; Automatic
1.0
0.4053 UC Berkeley
0.3855 IRIT
0.8 0.0369 FU Hagen
0.6
Precision
0.4
0.2
0.0
0.0 0.2 0.4 0.6 0.8 1.0
Recall
Dublin City University, Multilingual English, Auto, TD Run exemult1s
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 50 queries): 1.0
Query 201: 0.0168 Total number of documents
Query 202: 0.6188 over all queries
Query 203: 0.2400 Retrieved: 50000
Query 204: 0.3655 Relevant: 1826
Query 205: 0.2451 Rel_ret: 1244
0.8
Query 206: 0.4209
Query 207: 0.1509 Interpolated Recall -
Query 208: 0.3036 Precision Averages:
Query 209: 0.0644 at 0.00 0.5587
Query 210: 0.1058 at 0.10 0.4829 0.6
Query 211: 0.8375 at 0.20 0.4151
Query 212: 0.1212 at 0.30 0.3570
Query 213: 0.5757 at 0.40 0.2961
Precision
Query 214: 0.0001 at 0.50 0.2474
Query 215: 0.0314 at 0.60 0.2115 0.4
Query 216: 0.0030 at 0.70 0.1790
Query 217: 0.2025 at 0.80 0.1360
Query 218: 0.8338 at 0.90 0.0971
Query 219: 0.0063 at 1.00 0.0290
Query 220: 0.0344 0.2
Query 221: 0.4257 Avg. prec. (non-interpolated)
Query 222: 0.0263 for all rel. documents
Query 223: 0.0907 0.2626
Query 224: 0.8160 Precision:
Query 225: 0.5328 At 5 docs: 0.3880 0.0
Query 226: 0.0054 At 10 docs: 0.3540 0.0 0.2 0.4 0.6 0.8 1.0
Query 227: 0.0094 At 15 docs: 0.3160
Query 228: 0.2341 At 20 docs: 0.3020 Recall
Query 229: 0.3706 At 30 docs: 0.2580
Query 230: 0.6629 At 100 docs: 0.1572
Query 231: 0.1193 At 200 docs: 0.0987 Run exemult1s
Query 232: 0.0179 At 500 docs: 0.0464 Comparison to median by topic
Query 233: 0.4403 At 1000 docs: 0.0249
Query 234: 0.0183 +1.0
Query 235: 0.0045 R-Precision (prec. after R
Query 236: 0.2464 (=num_rel) docs. retrieved):
Query 237: 0.5349 Exact: 0.2747
Query 238: 0.3109
Query 239: 0.0474
Query 240: 0.8048 +0.5
Query 241: 0.0124
Query 242: 0.1766
Query 243: 0.2872
Query 244: 0.3472
Query 245: 0.6897
Query 246: 0.0858
Query 247: 0.2498
0.0
Query 248: 0.3241
Query 249: 0.0162
Query 250: 0.0425
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Dublin City University, Multilingual English, Auto, TD Run exemult2s
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 50 queries): 1.0
Query 201: 0.0389 Total number of documents
Query 202: 0.6315 over all queries
Query 203: 0.0258 Retrieved: 50000
Query 204: 0.2331 Relevant: 1826
Query 205: 0.2408 Rel_ret: 1119
0.8
Query 206: 0.5065
Query 207: 0.0915 Interpolated Recall -
Query 208: 0.2007 Precision Averages:
Query 209: 0.0644 at 0.00 0.5510
Query 210: 0.1035 at 0.10 0.4363 0.6
Query 211: 0.7854 at 0.20 0.3703
Query 212: 0.1190 at 0.30 0.3252
Query 213: 0.5328 at 0.40 0.2659
Precision
Query 214: 0.0002 at 0.50 0.2439
Query 215: 0.0227 at 0.60 0.2217 0.4
Query 216: 0.0246 at 0.70 0.1866
Query 217: 0.1477 at 0.80 0.1453
Query 218: 0.6926 at 0.90 0.1023
Query 219: 0.0037 at 1.00 0.0438
Query 220: 0.0005 0.2
Query 221: 0.6059 Avg. prec. (non-interpolated)
Query 222: 0.0263 for all rel. documents
Query 223: 0.0867 0.2479
Query 224: 0.8039 Precision:
Query 225: 0.5447 At 5 docs: 0.3600 0.0
Query 226: 0.0069 At 10 docs: 0.3300 0.0 0.2 0.4 0.6 0.8 1.0
Query 227: 0.0094 At 15 docs: 0.3107
Query 228: 0.0008 At 20 docs: 0.2920 Recall
Query 229: 0.0132 At 30 docs: 0.2540
Query 230: 0.5924 At 100 docs: 0.1478
Query 231: 0.1155 At 200 docs: 0.0894 Run exemult2s
Query 232: 0.0159 At 500 docs: 0.0413 Comparison to median by topic
Query 233: 0.3669 At 1000 docs: 0.0224
Query 234: 0.1750 +1.0
Query 235: 0.0045 R-Precision (prec. after R
Query 236: 0.7253 (=num_rel) docs. retrieved):
Query 237: 0.5624 Exact: 0.2786
Query 238: 0.3764
Query 239: 0.0221
Query 240: 0.8510 +0.5
Query 241: 0.0136
Query 242: 0.1002
Query 243: 0.2701
Query 244: 0.3430
Query 245: 0.5299
Query 246: 0.1103
Query 247: 0.2793
0.0
Query 248: 0.3674
Query 249: 0.0088
Query 250: 0.0000
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Dublin City University, Multilingual English, Auto, TD Run exemult3s
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 50 queries): 1.0
Query 201: 0.0397 Total number of documents
Query 202: 0.6374 over all queries
Query 203: 0.0656 Retrieved: 50000
Query 204: 0.6372 Relevant: 1826
Query 205: 0.2313 Rel_ret: 1232
0.8
Query 206: 0.4287
Query 207: 0.1551 Interpolated Recall -
Query 208: 0.2473 Precision Averages:
Query 209: 0.1066 at 0.00 0.6192
Query 210: 0.1024 at 0.10 0.4659 0.6
Query 211: 0.7800 at 0.20 0.4110
Query 212: 0.0759 at 0.30 0.3579
Query 213: 0.5223 at 0.40 0.2868
Precision
Query 214: 0.0009 at 0.50 0.2677
Query 215: 0.0227 at 0.60 0.2363 0.4
Query 216: 0.0326 at 0.70 0.2075
Query 217: 0.1477 at 0.80 0.1602
Query 218: 0.6035 at 0.90 0.1190
Query 219: 0.0038 at 1.00 0.0459
Query 220: 0.0006 0.2
Query 221: 0.6569 Avg. prec. (non-interpolated)
Query 222: 0.0178 for all rel. documents
Query 223: 0.0885 0.2715
Query 224: 0.7901 Precision:
Query 225: 0.5449 At 5 docs: 0.3720 0.0
Query 226: 0.0068 At 10 docs: 0.3500 0.0 0.2 0.4 0.6 0.8 1.0
Query 227: 0.0094 At 15 docs: 0.3280
Query 228: 0.0475 At 20 docs: 0.3160 Recall
Query 229: 0.0388 At 30 docs: 0.2667
Query 230: 0.5496 At 100 docs: 0.1542
Query 231: 0.2023 At 200 docs: 0.0967 Run exemult3s
Query 232: 0.0445 At 500 docs: 0.0460 Comparison to median by topic
Query 233: 0.4629 At 1000 docs: 0.0246
Query 234: 0.2281 +1.0
Query 235: 0.0016 R-Precision (prec. after R
Query 236: 0.7983 (=num_rel) docs. retrieved):
Query 237: 0.5536 Exact: 0.2846
Query 238: 0.4027
Query 239: 0.0398
Query 240: 0.8643 +0.5
Query 241: 0.0152
Query 242: 0.1056
Query 243: 0.2418
Query 244: 0.3476
Query 245: 0.7625
Query 246: 0.0998
Query 247: 0.4108
0.0
Query 248: 0.3828
Query 249: 0.0188
Query 250: 0.0000
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Dublin City University, Multilingual English, Auto, TD Run exemult4s
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 50 queries): 1.0
Query 201: 0.0397 Total number of documents
Query 202: 0.6388 over all queries
Query 203: 0.0671 Retrieved: 50000
Query 204: 0.5573 Relevant: 1826
Query 205: 0.2668 Rel_ret: 1244
0.8
Query 206: 0.3837
Query 207: 0.0033 Interpolated Recall -
Query 208: 0.2699 Precision Averages:
Query 209: 0.1136 at 0.00 0.6117
Query 210: 0.1037 at 0.10 0.4712 0.6
Query 211: 0.7851 at 0.20 0.3996
Query 212: 0.1154 at 0.30 0.3500
Query 213: 0.5111 at 0.40 0.2946
Precision
Query 214: 0.0016 at 0.50 0.2730
Query 215: 0.0202 at 0.60 0.2378 0.4
Query 216: 0.0479 at 0.70 0.2049
Query 217: 0.1104 at 0.80 0.1586
Query 218: 0.6587 at 0.90 0.1157
Query 219: 0.0063 at 1.00 0.0442
Query 220: 0.0003 0.2
Query 221: 0.6777 Avg. prec. (non-interpolated)
Query 222: 0.0372 for all rel. documents
Query 223: 0.0845 0.2725
Query 224: 0.7686 Precision:
Query 225: 0.5465 At 5 docs: 0.3800 0.0
Query 226: 0.0081 At 10 docs: 0.3520 0.0 0.2 0.4 0.6 0.8 1.0
Query 227: 0.0094 At 15 docs: 0.3267
Query 228: 0.0916 At 20 docs: 0.3060 Recall
Query 229: 0.0342 At 30 docs: 0.2633
Query 230: 0.5432 At 100 docs: 0.1546
Query 231: 0.1234 At 200 docs: 0.0973 Run exemult4s
Query 232: 0.0311 At 500 docs: 0.0457 Comparison to median by topic
Query 233: 0.4552 At 1000 docs: 0.0249
Query 234: 0.2431 +1.0
Query 235: 0.0013 R-Precision (prec. after R
Query 236: 0.7808 (=num_rel) docs. retrieved):
Query 237: 0.6123 Exact: 0.2937
Query 238: 0.3304
Query 239: 0.0485
Query 240: 0.8520 +0.5
Query 241: 0.0160
Query 242: 0.1787
Query 243: 0.2287
Query 244: 0.3536
Query 245: 0.7939
Query 246: 0.1436
Query 247: 0.4594
0.0
Query 248: 0.3915
Query 249: 0.0783
Query 250: 0.0000
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Dublin City University, Multilingual English, Auto, TD Run exemult5s
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 50 queries): 1.0
Query 201: 0.0495 Total number of documents
Query 202: 0.6620 over all queries
Query 203: 0.0657 Retrieved: 50000
Query 204: 0.6505 Relevant: 1826
Query 205: 0.2406 Rel_ret: 1216
0.8
Query 206: 0.4997
Query 207: 0.1571 Interpolated Recall -
Query 208: 0.2749 Precision Averages:
Query 209: 0.1032 at 0.00 0.5964
Query 210: 0.1085 at 0.10 0.4770 0.6
Query 211: 0.7785 at 0.20 0.3993
Query 212: 0.0717 at 0.30 0.3567
Query 213: 0.5326 at 0.40 0.2915
Precision
Query 214: 0.0006 at 0.50 0.2732
Query 215: 0.0245 at 0.60 0.2468 0.4
Query 216: 0.0484 at 0.70 0.2153
Query 217: 0.1496 at 0.80 0.1639
Query 218: 0.6893 at 0.90 0.1271
Query 219: 0.0040 at 1.00 0.0520
Query 220: 0.0007 0.2
Query 221: 0.6689 Avg. prec. (non-interpolated)
Query 222: 0.0139 for all rel. documents
Query 223: 0.0907 0.2745
Query 224: 0.7678 Precision:
Query 225: 0.5390 At 5 docs: 0.3640 0.0
Query 226: 0.0067 At 10 docs: 0.3560 0.0 0.2 0.4 0.6 0.8 1.0
Query 227: 0.0094 At 15 docs: 0.3307
Query 228: 0.0114 At 20 docs: 0.3150 Recall
Query 229: 0.0190 At 30 docs: 0.2753
Query 230: 0.5848 At 100 docs: 0.1566
Query 231: 0.1948 At 200 docs: 0.0976 Run exemult5s
Query 232: 0.0635 At 500 docs: 0.0458 Comparison to median by topic
Query 233: 0.4645 At 1000 docs: 0.0243
Query 234: 0.1644 +1.0
Query 235: 0.0014 R-Precision (prec. after R
Query 236: 0.7121 (=num_rel) docs. retrieved):
Query 237: 0.5591 Exact: 0.2890
Query 238: 0.4019
Query 239: 0.0285
Query 240: 0.9038 +0.5
Query 241: 0.0133
Query 242: 0.0986
Query 243: 0.2635
Query 244: 0.3437
Query 245: 0.7542
Query 246: 0.0913
Query 247: 0.4304
0.0
Query 248: 0.3951
Query 249: 0.0191
Query 250: 0.0000
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Alicante, Multilingual English, Auto, TD Run IRn−Mu−Dexp
Average precision Overall statistics
(individual queries): (for 50 queries):
Recall−Precision Values
1.0
Query 201: 0.0591 Total number of documents
Query 202: 0.4645 over all queries
Query 203: 0.5426 Retrieved: 50000
Query 204: 0.3881 Relevant: 1826
Query 205: 0.4279 Rel_ret: 1337 0.8
Query 206: 0.1440
Query 207: 0.1457 Interpolated Recall -
Query 208: 0.1731 Precision Averages:
Query 209: 0.0557 at 0.00 0.5581
Query 210: 0.1748 at 0.10 0.4167 0.6
Query 211: 0.7880 at 0.20 0.3395
Query 212: 0.0570 at 0.30 0.2885
Query 213: 0.4545 at 0.40 0.2525
Precision
Query 214: 0.0463 at 0.50 0.2238
Query 215: 0.0555 at 0.60 0.2070 0.4
Query 216: 0.0433 at 0.70 0.1799
Query 217: 0.1386 at 0.80 0.1487
Query 218: 0.8496 at 0.90 0.1065
Query 219: 0.0451 at 1.00 0.0378
Query 220: 0.0018 0.2
Query 221: 0.4329 Avg. prec. (non-interpolated)
Query 222: 0.0196 for all rel. documents
Query 223: 0.0069 0.2330
Query 224: 0.6071 Precision:
Query 225: 0.1090 At 5 docs: 0.3280 0.0
Query 226: 0.0232 At 10 docs: 0.3100 0.0 0.2 0.4 0.6 0.8 1.0
Query 227: 0.0010 At 15 docs: 0.3093
Query 228: 0.0953 At 20 docs: 0.2900 Recall
Query 229: 0.1578 At 30 docs: 0.2620
Query 230: 0.5664 At 100 docs: 0.1600
Query 231: 0.2199 At 200 docs: 0.1025 Run IRn−Mu−Dexp
Query 232: 0.0625 At 500 docs: 0.0494
Query 233: 0.2858 At 1000 docs: 0.0267 Comparison to median by topic
Query 234: 0.0452 +1.0
Query 235: 0.0183 R-Precision (prec. after R
Query 236: 0.4006 (=num_rel) docs. retrieved):
Query 237: 0.7501 Exact: 0.2713
Query 238: 0.1847
Query 239: 0.0791
Query 240: 0.3450 +0.5
Query 241: 0.0550
Query 242: 0.2250
Query 243: 0.1056
Query 244: 0.1968
Query 245: 0.5942
Query 246: 0.0917
Query 247: 0.5116 0.0
Query 248: 0.3486
Query 249: 0.0249
Query 250: 0.0330
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Alicante, Multilingual English, Auto, TD Run IRn−Mu−nexp
Average precision Overall statistics
(individual queries): (for 50 queries):
Recall−Precision Values
1.0
Query 201: 0.0235 Total number of documents
Query 202: 0.4834 over all queries
Query 203: 0.4645 Retrieved: 50000
Query 204: 0.3163 Relevant: 1826
Query 205: 0.5034 Rel_ret: 1252 0.8
Query 206: 0.2012
Query 207: 0.1368 Interpolated Recall -
Query 208: 0.1729 Precision Averages:
Query 209: 0.0831 at 0.00 0.5432
Query 210: 0.2733 at 0.10 0.4074 0.6
Query 211: 0.7863 at 0.20 0.3349
Query 212: 0.0273 at 0.30 0.2816
Query 213: 0.3419 at 0.40 0.2428
Precision
Query 214: 0.0499 at 0.50 0.2148
Query 215: 0.0242 at 0.60 0.1836 0.4
Query 216: 0.0437 at 0.70 0.1607
Query 217: 0.1253 at 0.80 0.1276
Query 218: 0.8297 at 0.90 0.0774
Query 219: 0.0485 at 1.00 0.0321
Query 220: 0.0014 0.2
Query 221: 0.3583 Avg. prec. (non-interpolated)
Query 222: 0.0059 for all rel. documents
Query 223: 0.0085 0.2204
Query 224: 0.4897 Precision:
Query 225: 0.1125 At 5 docs: 0.3400 0.0
Query 226: 0.0128 At 10 docs: 0.3120 0.0 0.2 0.4 0.6 0.8 1.0
Query 227: 0.0013 At 15 docs: 0.2867
Query 228: 0.0861 At 20 docs: 0.2710 Recall
Query 229: 0.1824 At 30 docs: 0.2447
Query 230: 0.5356 At 100 docs: 0.1442
Query 231: 0.0882 At 200 docs: 0.0937 Run IRn−Mu−nexp
Query 232: 0.0227 At 500 docs: 0.0457
Query 233: 0.2106 At 1000 docs: 0.0250 Comparison to median by topic
Query 234: 0.0685 +1.0
Query 235: 0.0130 R-Precision (prec. after R
Query 236: 0.1698 (=num_rel) docs. retrieved):
Query 237: 0.7498 Exact: 0.2585
Query 238: 0.1611
Query 239: 0.0692
Query 240: 0.3485 +0.5
Query 241: 0.0398
Query 242: 0.1402
Query 243: 0.1108
Query 244: 0.2154
Query 245: 0.8301
Query 246: 0.1270
Query 247: 0.4779 0.0
Query 248: 0.3842
Query 249: 0.0180
Query 250: 0.0439
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Alicante, Multilingual English, Auto, TD Run IRn−Mu−Pexp
Average precision Overall statistics
(individual queries): (for 50 queries):
Recall−Precision Values
1.0
Query 201: 0.0514 Total number of documents
Query 202: 0.4645 over all queries
Query 203: 0.5461 Retrieved: 50000
Query 204: 0.4044 Relevant: 1826
Query 205: 0.4242 Rel_ret: 1338 0.8
Query 206: 0.1451
Query 207: 0.1581 Interpolated Recall -
Query 208: 0.1731 Precision Averages:
Query 209: 0.0529 at 0.00 0.5408
Query 210: 0.1748 at 0.10 0.4138 0.6
Query 211: 0.7713 at 0.20 0.3399
Query 212: 0.0555 at 0.30 0.2971
Query 213: 0.4339 at 0.40 0.2611
Precision
Query 214: 0.0412 at 0.50 0.2294
Query 215: 0.0514 at 0.60 0.2104 0.4
Query 216: 0.0518 at 0.70 0.1836
Query 217: 0.1388 at 0.80 0.1505
Query 218: 0.8363 at 0.90 0.1074
Query 219: 0.0456 at 1.00 0.0418
Query 220: 0.0017 0.2
Query 221: 0.4224 Avg. prec. (non-interpolated)
Query 222: 0.0186 for all rel. documents
Query 223: 0.0069 0.2353
Query 224: 0.5957 Precision:
Query 225: 0.1371 At 5 docs: 0.3440 0.0
Query 226: 0.0202 At 10 docs: 0.3180 0.0 0.2 0.4 0.6 0.8 1.0
Query 227: 0.0009 At 15 docs: 0.3040
Query 228: 0.0856 At 20 docs: 0.2880 Recall
Query 229: 0.1457 At 30 docs: 0.2633
Query 230: 0.5662 At 100 docs: 0.1574
Query 231: 0.2215 At 200 docs: 0.1021 Run IRn−Mu−Pexp
Query 232: 0.0532 At 500 docs: 0.0492
Query 233: 0.2908 At 1000 docs: 0.0268 Comparison to median by topic
Query 234: 0.0448 +1.0
Query 235: 0.0193 R-Precision (prec. after R
Query 236: 0.4139 (=num_rel) docs. retrieved):
Query 237: 0.7542 Exact: 0.2714
Query 238: 0.2099
Query 239: 0.0832
Query 240: 0.3594 +0.5
Query 241: 0.0465
Query 242: 0.2097
Query 243: 0.1057
Query 244: 0.1974
Query 245: 0.6017
Query 246: 0.1004
Query 247: 0.5989 0.0
Query 248: 0.3734
Query 249: 0.0263
Query 250: 0.0324
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
CEA/LIC2M, Multilingual English, Auto, TD Run lic2men1
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 50 queries): 1.0
Query 201: 0.0000 Total number of documents
Query 202: 0.3181 over all queries
Query 203: 0.0410 Retrieved: 50000
Query 204: 0.0309 Relevant: 1826 0.8
Query 205: 0.1282 Rel_ret: 736
Query 206: 0.2408
Query 207: 0.0077 Interpolated Recall -
Query 208: 0.4000 Precision Averages:
Query 209: 0.0004 at 0.00 0.5402
Query 210: 0.0567 at 0.10 0.3357 0.6
Query 211: 0.0356 at 0.20 0.2453
Query 212: 0.0214 at 0.30 0.1750
Query 213: 0.0507 at 0.40 0.1503
Precision
Query 214: 0.0312 at 0.50 0.0923
Query 215: 0.0655 at 0.60 0.0597 0.4
Query 216: 0.1022 at 0.70 0.0418
Query 217: 0.0073 at 0.80 0.0216
Query 218: 0.2545 at 0.90 0.0048
Query 219: 0.0009 at 1.00 0.0000
Query 220: 0.0002 0.2
Query 221: 0.1192 Avg. prec. (non-interpolated)
Query 222: 0.0032 for all rel. documents
Query 223: 0.1131 0.1281
Query 224: 0.4957 Precision:
Query 225: 0.0000 At 5 docs: 0.2880 0.0
Query 226: 0.0649 At 10 docs: 0.2320 0.0 0.2 0.4 0.6 0.8 1.0
Query 227: 0.0007 At 15 docs: 0.2080
Query 228: 0.1943 At 20 docs: 0.1790 Recall
Query 229: 0.1342 At 30 docs: 0.1473
Query 230: 0.1631 At 100 docs: 0.0792
Query 231: 0.0229 At 200 docs: 0.0522 Run lic2men1
Query 232: 0.1379 At 500 docs: 0.0256 Comparison to median by topic
Query 233: 0.3412 At 1000 docs: 0.0147
Query 234: 0.0018 +1.0
Query 235: 0.1095 R-Precision (prec. after R
Query 236: 0.0296 (=num_rel) docs. retrieved):
Query 237: 0.0799 Exact: 0.1669
Query 238: 0.1263
Query 239: 0.0363
Query 240: 0.4750 +0.5
Query 241: 0.0011
Query 242: 0.1083
Query 243: 0.2866
Query 244: 0.0000
Query 245: 0.5783
Query 246: 0.2185
0.0
Query 247: 0.5473
Query 248: 0.0514
Query 249: 0.1707
Query 250: 0.0024
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
CEA/LIC2M, Multilingual English, Auto, TDN Run lic2men2
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 50 queries): 1.0
Query 201: 0.0000 Total number of documents
Query 202: 0.3310 over all queries
Query 203: 0.1258 Retrieved: 50000
Query 204: 0.0826 Relevant: 1826 0.8
Query 205: 0.1310 Rel_ret: 777
Query 206: 0.1662
Query 207: 0.0379 Interpolated Recall -
Query 208: 0.4000 Precision Averages:
Query 209: 0.0004 at 0.00 0.5338
Query 210: 0.1046 at 0.10 0.3595 0.6
Query 211: 0.0366 at 0.20 0.2483
Query 212: 0.0364 at 0.30 0.1807
Query 213: 0.0415 at 0.40 0.1518
Precision
Query 214: 0.0333 at 0.50 0.1182
Query 215: 0.0764 at 0.60 0.0925 0.4
Query 216: 0.0122 at 0.70 0.0548
Query 217: 0.0596 at 0.80 0.0129
Query 218: 0.5056 at 0.90 0.0061
Query 219: 0.0050 at 1.00 0.0061
Query 220: 0.0001 0.2
Query 221: 0.2497 Avg. prec. (non-interpolated)
Query 222: 0.0116 for all rel. documents
Query 223: 0.1406 0.1364
Query 224: 0.6217 Precision:
Query 225: 0.0000 At 5 docs: 0.2920 0.0
Query 226: 0.0132 At 10 docs: 0.2220 0.0 0.2 0.4 0.6 0.8 1.0
Query 227: 0.0008 At 15 docs: 0.2040
Query 228: 0.1918 At 20 docs: 0.1810 Recall
Query 229: 0.1247 At 30 docs: 0.1640
Query 230: 0.1476 At 100 docs: 0.0850
Query 231: 0.0229 At 200 docs: 0.0577 Run lic2men2
Query 232: 0.0741 At 500 docs: 0.0277 Comparison to median by topic
Query 233: 0.3599 At 1000 docs: 0.0155
Query 234: 0.0023 +1.0
Query 235: 0.1102 R-Precision (prec. after R
Query 236: 0.0363 (=num_rel) docs. retrieved):
Query 237: 0.2500 Exact: 0.1683
Query 238: 0.1269
Query 239: 0.0396
Query 240: 0.6076 +0.5
Query 241: 0.0009
Query 242: 0.0531
Query 243: 0.1723
Query 244: 0.0018
Query 245: 0.5624
Query 246: 0.2135
0.0
Query 247: 0.2951
Query 248: 0.0455
Query 249: 0.1511
Query 250: 0.0073
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
CEA/LIC2M, Multilingual French, Auto, TDN Run lic2mfr1
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 50 queries): 1.0
Query 201: 0.0020 Total number of documents
Query 202: 0.0450 over all queries
Query 203: 0.0104 Retrieved: 50000
Query 204: 0.0121 Relevant: 1826 0.8
Query 205: 0.2232 Rel_ret: 753
Query 206: 0.3350
Query 207: 0.0080 Interpolated Recall -
Query 208: 0.3660 Precision Averages:
Query 209: 0.0697 at 0.00 0.4438
Query 210: 0.0838 at 0.10 0.3053 0.6
Query 211: 0.2546 at 0.20 0.2530
Query 212: 0.0322 at 0.30 0.1850
Query 213: 0.2814 at 0.40 0.1440
Precision
Query 214: 0.0001 at 0.50 0.0970
Query 215: 0.0457 at 0.60 0.0734 0.4
Query 216: 0.0001 at 0.70 0.0500
Query 217: 0.0541 at 0.80 0.0237
Query 218: 0.5548 at 0.90 0.0030
Query 219: 0.0002 at 1.00 0.0005
Query 220: 0.0000 0.2
Query 221: 0.1491 Avg. prec. (non-interpolated)
Query 222: 0.0271 for all rel. documents
Query 223: 0.0045 0.1261
Query 224: 0.1445 Precision:
Query 225: 0.0049 At 5 docs: 0.2600 0.0
Query 226: 0.0689 At 10 docs: 0.2360 0.0 0.2 0.4 0.6 0.8 1.0
Query 227: 0.0000 At 15 docs: 0.2120
Query 228: 0.0320 At 20 docs: 0.1970 Recall
Query 229: 0.0587 At 30 docs: 0.1673
Query 230: 0.4579 At 100 docs: 0.0872
Query 231: 0.0281 At 200 docs: 0.0516 Run lic2mfr1
Query 232: 0.0181 At 500 docs: 0.0261 Comparison to median by topic
Query 233: 0.3226 At 1000 docs: 0.0151
Query 234: 0.0000 +1.0
Query 235: 0.0125 R-Precision (prec. after R
Query 236: 0.0475 (=num_rel) docs. retrieved):
Query 237: 0.1608 Exact: 0.1657
Query 238: 0.1231
Query 239: 0.0245
Query 240: 0.2966 +0.5
Query 241: 0.0056
Query 242: 0.0028
Query 243: 0.3033
Query 244: 0.0000
Query 245: 0.5394
Query 246: 0.0032
0.0
Query 247: 0.6624
Query 248: 0.4099
Query 249: 0.0199
Query 250: 0.0008
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Amsterdam, Multilingual English, Auto, TD Run UAmsC04EnMu3Way
Average precision Overall statistics
(individual queries): (for 50 queries):
Recall−Precision Values
1.0
Query 201: 0.0651 Total number of documents
Query 202: 0.6218 over all queries
Query 203: 0.6517 Retrieved: 50000
Query 204: 0.5185 Relevant: 1826
Query 205: 0.2820 Rel_ret: 1416 0.8
Query 206: 0.5162
Query 207: 0.2021 Interpolated Recall -
Query 208: 0.4544 Precision Averages:
Query 209: 0.0467 at 0.00 0.6937
Query 210: 0.0410 at 0.10 0.5393 0.6
Query 211: 0.8738 at 0.20 0.4859
Query 212: 0.1075 at 0.30 0.4342
Query 213: 0.6020 at 0.40 0.3696
Precision
Query 214: 0.1661 at 0.50 0.3301
Query 215: 0.0942 at 0.60 0.2731 0.4
Query 216: 0.1245 at 0.70 0.2391
Query 217: 0.4342 at 0.80 0.2004
Query 218: 0.8479 at 0.90 0.1362
Query 219: 0.0074 at 1.00 0.0553
Query 220: 0.0296 0.2
Query 221: 0.6058 Avg. prec. (non-interpolated)
Query 222: 0.0110 for all rel. documents
Query 223: 0.0809 0.3258
Query 224: 0.6264 Precision:
Query 225: 0.0886 At 5 docs: 0.4680 0.0
Query 226: 0.0482 At 10 docs: 0.4200 0.0 0.2 0.4 0.6 0.8 1.0
Query 227: 0.5000 At 15 docs: 0.3933
Query 228: 0.3613 At 20 docs: 0.3660 Recall
Query 229: 0.2795 At 30 docs: 0.3147
Query 230: 0.6353 At 100 docs: 0.1878
Query 231: 0.4086 At 200 docs: 0.1163 Run UAmsC04EnMu3Way
Query 232: 0.1375 At 500 docs: 0.0534
Query 233: 0.5002 At 1000 docs: 0.0283 Comparison to median by topic
Query 234: 0.0812 +1.0
Query 235: 0.1428 R-Precision (prec. after R
Query 236: 0.3780 (=num_rel) docs. retrieved):
Query 237: 0.7234 Exact: 0.3393
Query 238: 0.3056
Query 239: 0.0848
Query 240: 0.8413 +0.5
Query 241: 0.0519
Query 242: 0.1627
Query 243: 0.2618
Query 244: 0.0680
Query 245: 0.7549
Query 246: 0.1113
Query 247: 0.8763 0.0
Query 248: 0.4066
Query 249: 0.0180
Query 250: 0.0516
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Amsterdam, Multilingual English, Auto, TD Run UAmsC04EnMu4Gr
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 50 queries): 1.0
Query 201: 0.0360 Total number of documents
Query 202: 0.4819 over all queries
Query 203: 0.1550 Retrieved: 50000
Query 204: 0.5441 Relevant: 1826
Query 205: 0.3402 Rel_ret: 1185
0.8
Query 206: 0.3705
Query 207: 0.1770 Interpolated Recall -
Query 208: 0.2503 Precision Averages:
Query 209: 0.0113 at 0.00 0.5689
Query 210: 0.0653 at 0.10 0.4264 0.6
Query 211: 0.8440 at 0.20 0.3527
Query 212: 0.0476 at 0.30 0.3085
Query 213: 0.0381 at 0.40 0.2646
Precision
Query 214: 0.2349 at 0.50 0.2334
Query 215: 0.3023 at 0.60 0.1953 0.4
Query 216: 0.0274 at 0.70 0.1715
Query 217: 0.0188 at 0.80 0.1401
Query 218: 0.8501 at 0.90 0.0769
Query 219: 0.0035 at 1.00 0.0260
Query 220: 0.0180 0.2
Query 221: 0.3463 Avg. prec. (non-interpolated)
Query 222: 0.0108 for all rel. documents
Query 223: 0.0539 0.2333
Query 224: 0.3288 Precision:
Query 225: 0.0415 At 5 docs: 0.3400 0.0
Query 226: 0.0029 At 10 docs: 0.3340 0.0 0.2 0.4 0.6 0.8 1.0
Query 227: 0.0417 At 15 docs: 0.3040
Query 228: 0.2660 At 20 docs: 0.2820 Recall
Query 229: 0.1035 At 30 docs: 0.2533
Query 230: 0.6053 At 100 docs: 0.1468
Query 231: 0.4305 At 200 docs: 0.0916 Run UAmsC04EnMu4Gr
Query 232: 0.0709 At 500 docs: 0.0435 Comparison to median by topic
Query 233: 0.3751 At 1000 docs: 0.0237
Query 234: 0.0065 +1.0
Query 235: 0.0028 R-Precision (prec. after R
Query 236: 0.3449 (=num_rel) docs. retrieved):
Query 237: 0.6050 Exact: 0.2462
Query 238: 0.2615
Query 239: 0.0768
Query 240: 0.3645 +0.5
Query 241: 0.0366
Query 242: 0.1622
Query 243: 0.2529
Query 244: 0.0201
Query 245: 0.7038
Query 246: 0.0809
Query 247: 0.7825
0.0
Query 248: 0.4534
Query 249: 0.0153
Query 250: 0.0043
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Amsterdam, Multilingual English, Auto, TD Run UAmsC04EnMuAll
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 50 queries): 1.0
Query 201: 0.0549 Total number of documents
Query 202: 0.6291 over all queries
Query 203: 0.6831 Retrieved: 50000
Query 204: 0.5587 Relevant: 1826
Query 205: 0.4317 Rel_ret: 1395
0.8
Query 206: 0.5103
Query 207: 0.2129 Interpolated Recall -
Query 208: 0.6073 Precision Averages:
Query 209: 0.0351 at 0.00 0.7025
Query 210: 0.0585 at 0.10 0.5676 0.6
Query 211: 0.8954 at 0.20 0.5130
Query 212: 0.0965 at 0.30 0.4569
Query 213: 0.6079 at 0.40 0.3923
Precision
Query 214: 0.1869 at 0.50 0.3596
Query 215: 0.1657 at 0.60 0.2879 0.4
Query 216: 0.0907 at 0.70 0.2503
Query 217: 0.4131 at 0.80 0.2097
Query 218: 0.8872 at 0.90 0.1428
Query 219: 0.0083 at 1.00 0.0539
Query 220: 0.0341 0.2
Query 221: 0.5475 Avg. prec. (non-interpolated)
Query 222: 0.0073 for all rel. documents
Query 223: 0.0805 0.3427
Query 224: 0.6831 Precision:
Query 225: 0.1759 At 5 docs: 0.4800 0.0
Query 226: 0.0253 At 10 docs: 0.4420 0.0 0.2 0.4 0.6 0.8 1.0
Query 227: 0.5000 At 15 docs: 0.4053
Query 228: 0.3522 At 20 docs: 0.3780 Recall
Query 229: 0.2800 At 30 docs: 0.3273
Query 230: 0.6589 At 100 docs: 0.1864
Query 231: 0.4851 At 200 docs: 0.1179 Run UAmsC04EnMuAll
Query 232: 0.1205 At 500 docs: 0.0529 Comparison to median by topic
Query 233: 0.4832 At 1000 docs: 0.0279
Query 234: 0.1492 +1.0
Query 235: 0.0720 R-Precision (prec. after R
Query 236: 0.4365 (=num_rel) docs. retrieved):
Query 237: 0.7519 Exact: 0.3538
Query 238: 0.3500
Query 239: 0.0840
Query 240: 0.7763 +0.5
Query 241: 0.0487
Query 242: 0.1786
Query 243: 0.2740
Query 244: 0.0839
Query 245: 0.7400
Query 246: 0.1529
Query 247: 0.9472
0.0
Query 248: 0.4573
Query 249: 0.0185
Query 250: 0.0452
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Amsterdam, Multilingual English, Auto, TD Run UAmsC04EnMuAll2
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 50 queries): 1.0
Query 201: 0.0250 Total number of documents
Query 202: 0.6224 over all queries
Query 203: 0.5160 Retrieved: 50000
Query 204: 0.4673 Relevant: 1826
Query 205: 0.4110 Rel_ret: 1350
0.8
Query 206: 0.2436
Query 207: 0.1978 Interpolated Recall -
Query 208: 0.5003 Precision Averages:
Query 209: 0.0250 at 0.00 0.5548
Query 210: 0.0753 at 0.10 0.4453 0.6
Query 211: 0.8307 at 0.20 0.3739
Query 212: 0.0639 at 0.30 0.3359
Query 213: 0.3720 at 0.40 0.2869
Precision
Query 214: 0.1990 at 0.50 0.2635
Query 215: 0.1354 at 0.60 0.2122 0.4
Query 216: 0.0298 at 0.70 0.1922
Query 217: 0.2310 at 0.80 0.1599
Query 218: 0.8369 at 0.90 0.1007
Query 219: 0.0025 at 1.00 0.0334
Query 220: 0.0395 0.2
Query 221: 0.2836 Avg. prec. (non-interpolated)
Query 222: 0.0019 for all rel. documents
Query 223: 0.0353 0.2520
Query 224: 0.1843 Precision:
Query 225: 0.0636 At 5 docs: 0.3160 0.0
Query 226: 0.0043 At 10 docs: 0.3040 0.0 0.2 0.4 0.6 0.8 1.0
Query 227: 0.5000 At 15 docs: 0.2840
Query 228: 0.2191 At 20 docs: 0.2840 Recall
Query 229: 0.1304 At 30 docs: 0.2567
Query 230: 0.5234 At 100 docs: 0.1634
Query 231: 0.3274 At 200 docs: 0.1048 Run UAmsC04EnMuAll2
Query 232: 0.0832 At 500 docs: 0.0498 Comparison to median by topic
Query 233: 0.2942 At 1000 docs: 0.0270
Query 234: 0.0263 +1.0
Query 235: 0.0424 R-Precision (prec. after R
Query 236: 0.3621 (=num_rel) docs. retrieved):
Query 237: 0.7398 Exact: 0.2762
Query 238: 0.2077
Query 239: 0.0444
Query 240: 0.6562 +0.5
Query 241: 0.0512
Query 242: 0.0892
Query 243: 0.2271
Query 244: 0.1190
Query 245: 0.6621
Query 246: 0.0478
Query 247: 0.5125
0.0
Query 248: 0.2971
Query 249: 0.0091
Query 250: 0.0302
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Amsterdam, Multilingual English, Auto, TD Run UAmsC04EnMuWSLM
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 50 queries): 1.0
Query 201: 0.0386 Total number of documents
Query 202: 0.5950 over all queries
Query 203: 0.3541 Retrieved: 50000
Query 204: 0.3741 Relevant: 1826
Query 205: 0.4677 Rel_ret: 1375
0.8
Query 206: 0.3442
Query 207: 0.1623 Interpolated Recall -
Query 208: 0.7566 Precision Averages:
Query 209: 0.0165 at 0.00 0.7673
Query 210: 0.2285 at 0.10 0.5527 0.6
Query 211: 0.8164 at 0.20 0.4214
Query 212: 0.1267 at 0.30 0.3623
Query 213: 0.5384 at 0.40 0.3303
Precision
Query 214: 0.1018 at 0.50 0.3012
Query 215: 0.0935 at 0.60 0.2589 0.4
Query 216: 0.2333 at 0.70 0.2281
Query 217: 0.5421 at 0.80 0.1894
Query 218: 0.7430 at 0.90 0.1231
Query 219: 0.1865 at 1.00 0.0480
Query 220: 0.0403 0.2
Query 221: 0.2515 Avg. prec. (non-interpolated)
Query 222: 0.0013 for all rel. documents
Query 223: 0.0539 0.3040
Query 224: 0.7167 Precision:
Query 225: 0.2965 At 5 docs: 0.4440 0.0
Query 226: 0.0498 At 10 docs: 0.4060 0.0 0.2 0.4 0.6 0.8 1.0
Query 227: 0.0179 At 15 docs: 0.3627
Query 228: 0.1586 At 20 docs: 0.3270 Recall
Query 229: 0.1156 At 30 docs: 0.2887
Query 230: 0.5307 At 100 docs: 0.1728
Query 231: 0.4036 At 200 docs: 0.1081 Run UAmsC04EnMuWSLM
Query 232: 0.0794 At 500 docs: 0.0502 Comparison to median by topic
Query 233: 0.3292 At 1000 docs: 0.0275
Query 234: 0.1813 +1.0
Query 235: 0.0814 R-Precision (prec. after R
Query 236: 0.3331 (=num_rel) docs. retrieved):
Query 237: 0.8127 Exact: 0.3325
Query 238: 0.2410
Query 239: 0.0738
Query 240: 0.8905 +0.5
Query 241: 0.1011
Query 242: 0.2339
Query 243: 0.3097
Query 244: 0.2020
Query 245: 0.5567
Query 246: 0.1490
Query 247: 0.9620
0.0
Query 248: 0.1655
Query 249: 0.0244
Query 250: 0.1192
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
SUNY Buffalo, Multilingual English, Auto, TD Run UBmult01
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 50 queries): 1.0
Query 201: 0.0009 Total number of documents
Query 202: 0.4502 over all queries
Query 203: 0.0001 Retrieved: 50000
Query 204: 0.6187 Relevant: 1826
Query 205: 0.3978 Rel_ret: 1092
0.8
Query 206: 0.2048
Query 207: 0.0553 Interpolated Recall -
Query 208: 0.0409 Precision Averages:
Query 209: 0.0007 at 0.00 0.4635
Query 210: 0.0142 at 0.10 0.3245 0.6
Query 211: 0.7026 at 0.20 0.2627
Query 212: 0.0259 at 0.30 0.2094
Query 213: 0.4634 at 0.40 0.1908
Precision
Query 214: 0.1472 at 0.50 0.1674
Query 215: 0.1321 at 0.60 0.1392 0.4
Query 216: 0.2628 at 0.70 0.1186
Query 217: 0.1239 at 0.80 0.0930
Query 218: 0.8202 at 0.90 0.0548
Query 219: 0.0107 at 1.00 0.0189
Query 220: 0.0105 0.2
Query 221: 0.0613 Avg. prec. (non-interpolated)
Query 222: 0.0037 for all rel. documents
Query 223: 0.0862 0.1709
Query 224: 0.0534 Precision:
Query 225: 0.0535 At 5 docs: 0.2320 0.0
Query 226: 0.0302 At 10 docs: 0.2360 0.0 0.2 0.4 0.6 0.8 1.0
Query 227: 0.0000 At 15 docs: 0.2280
Query 228: 0.0269 At 20 docs: 0.2210 Recall
Query 229: 0.0074 At 30 docs: 0.1987
Query 230: 0.5837 At 100 docs: 0.1218
Query 231: 0.0472 At 200 docs: 0.0783 Run UBmult01
Query 232: 0.0446 At 500 docs: 0.0390 Comparison to median by topic
Query 233: 0.2444 At 1000 docs: 0.0218
Query 234: 0.0164 +1.0
Query 235: 0.0319 R-Precision (prec. after R
Query 236: 0.7050 (=num_rel) docs. retrieved):
Query 237: 0.0863 Exact: 0.2003
Query 238: 0.2001
Query 239: 0.0052
Query 240: 0.4264 +0.5
Query 241: 0.0013
Query 242: 0.0989
Query 243: 0.1319
Query 244: 0.0000
Query 245: 0.6956
Query 246: 0.2087
Query 247: 0.1189
0.0
Query 248: 0.0654
Query 249: 0.0066
Query 250: 0.0213
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
SUNY Buffalo, Multilingual English, Auto, TD Run UBmult02
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 50 queries): 1.0
Query 201: 0.0235 Total number of documents
Query 202: 0.5203 over all queries
Query 203: 0.0000 Retrieved: 50000
Query 204: 0.4570 Relevant: 1826
Query 205: 0.2561 Rel_ret: 1135
0.8
Query 206: 0.0837
Query 207: 0.1372 Interpolated Recall -
Query 208: 0.0439 Precision Averages:
Query 209: 0.0032 at 0.00 0.4771
Query 210: 0.0150 at 0.10 0.3102 0.6
Query 211: 0.3776 at 0.20 0.2306
Query 212: 0.0570 at 0.30 0.1861
Query 213: 0.4267 at 0.40 0.1583
Precision
Query 214: 0.0825 at 0.50 0.1312
Query 215: 0.1152 at 0.60 0.0981 0.4
Query 216: 0.2036 at 0.70 0.0816
Query 217: 0.0970 at 0.80 0.0626
Query 218: 0.4522 at 0.90 0.0365
Query 219: 0.0109 at 1.00 0.0122
Query 220: 0.0104 0.2
Query 221: 0.0539 Avg. prec. (non-interpolated)
Query 222: 0.0062 for all rel. documents
Query 223: 0.0284 0.1453
Query 224: 0.2111 Precision:
Query 225: 0.1408 At 5 docs: 0.2800 0.0
Query 226: 0.0699 At 10 docs: 0.2400 0.0 0.2 0.4 0.6 0.8 1.0
Query 227: 0.0000 At 15 docs: 0.2227
Query 228: 0.0737 At 20 docs: 0.2080 Recall
Query 229: 0.0890 At 30 docs: 0.1920
Query 230: 0.2846 At 100 docs: 0.1126
Query 231: 0.0505 At 200 docs: 0.0773 Run UBmult02
Query 232: 0.0647 At 500 docs: 0.0403 Comparison to median by topic
Query 233: 0.1975 At 1000 docs: 0.0227
Query 234: 0.1374 +1.0
Query 235: 0.0209 R-Precision (prec. after R
Query 236: 0.5295 (=num_rel) docs. retrieved):
Query 237: 0.0822 Exact: 0.1884
Query 238: 0.2501
Query 239: 0.0251
Query 240: 0.4224 +0.5
Query 241: 0.0006
Query 242: 0.1242
Query 243: 0.2100
Query 244: 0.0000
Query 245: 0.5611
Query 246: 0.0748
Query 247: 0.0888
0.0
Query 248: 0.0707
Query 249: 0.0086
Query 250: 0.0174
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
SUNY Buffalo, Multilingual English, Auto, TD Run UBmulti03
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 50 queries): 1.0
Query 201: 0.1083 Total number of documents
Query 202: 0.5239 over all queries
Query 203: 0.2554 Retrieved: 50000
Query 204: 0.4787 Relevant: 1826
Query 205: 0.5209 Rel_ret: 1463
0.8
Query 206: 0.2514
Query 207: 0.1734 Interpolated Recall -
Query 208: 0.6023 Precision Averages:
Query 209: 0.1676 at 0.00 0.7095
Query 210: 0.0678 at 0.10 0.5358 0.6
Query 211: 0.5157 at 0.20 0.4385
Query 212: 0.1865 at 0.30 0.3554
Query 213: 0.3894 at 0.40 0.2990
Precision
Query 214: 0.0708 at 0.50 0.2553
Query 215: 0.0265 at 0.60 0.2093 0.4
Query 216: 0.2620 at 0.70 0.1617
Query 217: 0.3280 at 0.80 0.1246
Query 218: 0.5660 at 0.90 0.0983
Query 219: 0.1872 at 1.00 0.0324
Query 220: 0.0194 0.2
Query 221: 0.2078 Avg. prec. (non-interpolated)
Query 222: 0.0256 for all rel. documents
Query 223: 0.1392 0.2748
Query 224: 0.4235 Precision:
Query 225: 0.2704 At 5 docs: 0.4360 0.0
Query 226: 0.2861 At 10 docs: 0.3720 0.0 0.2 0.4 0.6 0.8 1.0
Query 227: 0.0833 At 15 docs: 0.3493
Query 228: 0.0789 At 20 docs: 0.3160 Recall
Query 229: 0.1203 At 30 docs: 0.2733
Query 230: 0.4966 At 100 docs: 0.1604
Query 231: 0.3270 At 200 docs: 0.1065 Run UBmulti03
Query 232: 0.0440 At 500 docs: 0.0538 Comparison to median by topic
Query 233: 0.4259 At 1000 docs: 0.0293
Query 234: 0.1854 +1.0
Query 235: 0.2306 R-Precision (prec. after R
Query 236: 0.5908 (=num_rel) docs. retrieved):
Query 237: 0.5448 Exact: 0.2817
Query 238: 0.2171
Query 239: 0.0880
Query 240: 0.4863 +0.5
Query 241: 0.0062
Query 242: 0.3729
Query 243: 0.2786
Query 244: 0.3900
Query 245: 0.6019
Query 246: 0.2794
Query 247: 0.4323
0.0
Query 248: 0.3798
Query 249: 0.0074
Query 250: 0.0171
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Chicago, Multilingual English, Auto, T Run UCEMULdecT3
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 50 queries): 1.0
Query 201: 0.1028 Total number of documents
Query 202: 0.4060 over all queries
Query 203: 0.0156 Retrieved: 50000
Query 204: 0.2997 Relevant: 1826
Query 205: 0.2304 Rel_ret: 1142
0.8
Query 206: 0.1653
Query 207: 0.0798 Interpolated Recall -
Query 208: 0.0877 Precision Averages:
Query 209: 0.0710 at 0.00 0.5437
Query 210: 0.0220 at 0.10 0.3378 0.6
Query 211: 0.4354 at 0.20 0.2748
Query 212: 0.2934 at 0.30 0.2026
Query 213: 0.1407 at 0.40 0.1680
Precision
Query 214: 0.0384 at 0.50 0.1387
Query 215: 0.0070 at 0.60 0.1034 0.4
Query 216: 0.0584 at 0.70 0.0762
Query 217: 0.0813 at 0.80 0.0441
Query 218: 0.4153 at 0.90 0.0117
Query 219: 0.0087 at 1.00 0.0006
Query 220: 0.0000 0.2
Query 221: 0.2553 Avg. prec. (non-interpolated)
Query 222: 0.0070 for all rel. documents
Query 223: 0.0192 0.1545
Query 224: 0.4157 Precision:
Query 225: 0.1329 At 5 docs: 0.2920 0.0
Query 226: 0.0042 At 10 docs: 0.2480 0.0 0.2 0.4 0.6 0.8 1.0
Query 227: 0.0086 At 15 docs: 0.2307
Query 228: 0.0000 At 20 docs: 0.2260 Recall
Query 229: 0.0587 At 30 docs: 0.2013
Query 230: 0.3056 At 100 docs: 0.1222
Query 231: 0.2010 At 200 docs: 0.0806 Run UCEMULdecT3
Query 232: 0.1299 At 500 docs: 0.0408 Comparison to median by topic
Query 233: 0.2513 At 1000 docs: 0.0228
Query 234: 0.1108 +1.0
Query 235: 0.1769 R-Precision (prec. after R
Query 236: 0.3246 (=num_rel) docs. retrieved):
Query 237: 0.4429 Exact: 0.1916
Query 238: 0.2885
Query 239: 0.0080
Query 240: 0.3150 +0.5
Query 241: 0.0178
Query 242: 0.2583
Query 243: 0.0141
Query 244: 0.0259
Query 245: 0.3916
Query 246: 0.2410
Query 247: 0.2089
0.0
Query 248: 0.1515
Query 249: 0.0011
Query 250: 0.0001
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Chicago, Multilingual English, Auto, T Run UCEMULlppT4
Average precision Overall statistics
(individual queries): (for 50 queries): Recall−Precision Values
1.0
Query 201: 0.0913 Total number of documents
Query 202: 0.3811 over all queries
Query 203: 0.0018 Retrieved: 50000
Query 204: 0.1831 Relevant: 1826
Query 205: 0.1750 Rel_ret: 1022 0.8
Query 206: 0.1669
Query 207: 0.0751 Interpolated Recall -
Query 208: 0.1153 Precision Averages:
Query 209: 0.0638 at 0.00 0.5264
Query 210: 0.0093 at 0.10 0.2954 0.6
Query 211: 0.3385 at 0.20 0.2231
Query 212: 0.1778 at 0.30 0.1655
Query 213: 0.0838 at 0.40 0.1418
Precision
Query 214: 0.0395 at 0.50 0.1151
Query 215: 0.0069 at 0.60 0.0866 0.4
Query 216: 0.0375 at 0.70 0.0632
Query 217: 0.0703 at 0.80 0.0388
Query 218: 0.3873 at 0.90 0.0115
Query 219: 0.0031 at 1.00 0.0006
Query 220: 0.0000 0.2
Query 221: 0.1491 Avg. prec. (non-interpolated)
Query 222: 0.0091 for all rel. documents
Query 223: 0.0260 0.1307
Query 224: 0.4754 Precision:
Query 225: 0.0715 At 5 docs: 0.2640 0.0
Query 226: 0.0053 At 10 docs: 0.2180 0.0 0.2 0.4 0.6 0.8 1.0
Query 227: 0.0007 At 15 docs: 0.2040
Query 228: 0.0000 At 20 docs: 0.1890 Recall
Query 229: 0.0611 At 30 docs: 0.1727
Query 230: 0.2031 At 100 docs: 0.1088
Query 231: 0.1450 At 200 docs: 0.0717 Run UCEMULlppT4
Query 232: 0.1423 At 500 docs: 0.0364
Query 233: 0.1885 At 1000 docs: 0.0204 Comparison to median by topic
Query 234: 0.0609 +1.0
Query 235: 0.1140 R-Precision (prec. after R
Query 236: 0.3113 (=num_rel) docs. retrieved):
Query 237: 0.2913 Exact: 0.1753
Query 238: 0.2511
Query 239: 0.0076
Query 240: 0.3318 +0.5
Query 241: 0.0002
Query 242: 0.2404
Query 243: 0.0137
Query 244: 0.0007
Query 245: 0.4359
Query 246: 0.2240
Query 247: 0.2108 0.0
Query 248: 0.1569
Query 249: 0.0013
Query 250: 0.0001
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Chicago, Multilingual English, Auto, T Run UCEMULT2
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 50 queries): 1.0
Query 201: 0.0908 Total number of documents
Query 202: 0.3821 over all queries
Query 203: 0.0098 Retrieved: 50000
Query 204: 0.1831 Relevant: 1826
Query 205: 0.1750 Rel_ret: 1086
0.8
Query 206: 0.1669
Query 207: 0.0838 Interpolated Recall -
Query 208: 0.1153 Precision Averages:
Query 209: 0.0744 at 0.00 0.5442
Query 210: 0.0211 at 0.10 0.3268 0.6
Query 211: 0.3812 at 0.20 0.2511
Query 212: 0.2536 at 0.30 0.1793
Query 213: 0.1256 at 0.40 0.1536
Precision
Query 214: 0.0400 at 0.50 0.1236
Query 215: 0.0069 at 0.60 0.0971 0.4
Query 216: 0.0408 at 0.70 0.0774
Query 217: 0.0703 at 0.80 0.0477
Query 218: 0.3932 at 0.90 0.0151
Query 219: 0.0031 at 1.00 0.0006
Query 220: 0.0000 0.2
Query 221: 0.1980 Avg. prec. (non-interpolated)
Query 222: 0.0091 for all rel. documents
Query 223: 0.0260 0.1464
Query 224: 0.4989 Precision:
Query 225: 0.0761 At 5 docs: 0.2880 0.0
Query 226: 0.0053 At 10 docs: 0.2440 0.0 0.2 0.4 0.6 0.8 1.0
Query 227: 0.0094 At 15 docs: 0.2267
Query 228: 0.0000 At 20 docs: 0.2110 Recall
Query 229: 0.0611 At 30 docs: 0.1913
Query 230: 0.3109 At 100 docs: 0.1178
Query 231: 0.2123 At 200 docs: 0.0774 Run UCEMULT2
Query 232: 0.1483 At 500 docs: 0.0390 Comparison to median by topic
Query 233: 0.2478 At 1000 docs: 0.0217
Query 234: 0.0617 +1.0
Query 235: 0.1171 R-Precision (prec. after R
Query 236: 0.3113 (=num_rel) docs. retrieved):
Query 237: 0.4111 Exact: 0.1860
Query 238: 0.3021
Query 239: 0.0096
Query 240: 0.3318 +0.5
Query 241: 0.0212
Query 242: 0.2510
Query 243: 0.0137
Query 244: 0.0270
Query 245: 0.4491
Query 246: 0.2240
Query 247: 0.2108
0.0
Query 248: 0.1569
Query 249: 0.0013
Query 250: 0.0001
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Chicago, Multilingual English, Auto, TD Run UCEMULTD1
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 50 queries): 1.0
Query 201: 0.1184 Total number of documents
Query 202: 0.4363 over all queries
Query 203: 0.0239 Retrieved: 50000
Query 204: 0.1460 Relevant: 1826
Query 205: 0.2035 Rel_ret: 1103
0.8
Query 206: 0.1706
Query 207: 0.0814 Interpolated Recall -
Query 208: 0.2144 Precision Averages:
Query 209: 0.0707 at 0.00 0.5886
Query 210: 0.0207 at 0.10 0.3813 0.6
Query 211: 0.3888 at 0.20 0.2679
Query 212: 0.0925 at 0.30 0.2064
Query 213: 0.1047 at 0.40 0.1657
Precision
Query 214: 0.1268 at 0.50 0.1350
Query 215: 0.0043 at 0.60 0.1064 0.4
Query 216: 0.0604 at 0.70 0.0829
Query 217: 0.1062 at 0.80 0.0554
Query 218: 0.3594 at 0.90 0.0157
Query 219: 0.0096 at 1.00 0.0013
Query 220: 0.0000 0.2
Query 221: 0.2667 Avg. prec. (non-interpolated)
Query 222: 0.0118 for all rel. documents
Query 223: 0.0139 0.1628
Query 224: 0.5565 Precision:
Query 225: 0.0905 At 5 docs: 0.3080 0.0
Query 226: 0.0004 At 10 docs: 0.2520 0.0 0.2 0.4 0.6 0.8 1.0
Query 227: 0.0556 At 15 docs: 0.2400
Query 228: 0.0000 At 20 docs: 0.2180 Recall
Query 229: 0.1170 At 30 docs: 0.1947
Query 230: 0.2702 At 100 docs: 0.1204
Query 231: 0.3988 At 200 docs: 0.0800 Run UCEMULTD1
Query 232: 0.1786 At 500 docs: 0.0399 Comparison to median by topic
Query 233: 0.2515 At 1000 docs: 0.0221
Query 234: 0.0473 +1.0
Query 235: 0.1477 R-Precision (prec. after R
Query 236: 0.2844 (=num_rel) docs. retrieved):
Query 237: 0.4064 Exact: 0.2001
Query 238: 0.3686
Query 239: 0.0225
Query 240: 0.3705 +0.5
Query 241: 0.0234
Query 242: 0.0641
Query 243: 0.0315
Query 244: 0.1716
Query 245: 0.4619
Query 246: 0.2501
Query 247: 0.3598
0.0
Query 248: 0.1631
Query 249: 0.0132
Query 250: 0.0044
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Hildesheim, Multilingual English, Auto, TD Run UHImlt1
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 50 queries): 1.0
Query 201: 0.0356 Total number of documents
Query 202: 0.4700 over all queries
Query 203: 0.5531 Retrieved: 50000
Query 204: 0.3975 Relevant: 1826
Query 205: 0.1867 Rel_ret: 1031
0.8
Query 206: 0.1973
Query 207: 0.0954 Interpolated Recall -
Query 208: 0.1589 Precision Averages:
Query 209: 0.0013 at 0.00 0.5503
Query 210: 0.1294 at 0.10 0.3603 0.6
Query 211: 0.7103 at 0.20 0.3170
Query 212: 0.0290 at 0.30 0.2801
Query 213: 0.3307 at 0.40 0.2525
Precision
Query 214: 0.0071 at 0.50 0.2201
Query 215: 0.0435 at 0.60 0.1534 0.4
Query 216: 0.0010 at 0.70 0.1157
Query 217: 0.0097 at 0.80 0.0739
Query 218: 0.6347 at 0.90 0.0339
Query 219: 0.0004 at 1.00 0.0036
Query 220: 0.0008 0.2
Query 221: 0.4649 Avg. prec. (non-interpolated)
Query 222: 0.0193 for all rel. documents
Query 223: 0.0057 0.1974
Query 224: 0.1194 Precision:
Query 225: 0.0136 At 5 docs: 0.3360 0.0
Query 226: 0.0219 At 10 docs: 0.3040 0.0 0.2 0.4 0.6 0.8 1.0
Query 227: 0.0312 At 15 docs: 0.2760
Query 228: 0.0013 At 20 docs: 0.2600 Recall
Query 229: 0.1439 At 30 docs: 0.2253
Query 230: 0.5822 At 100 docs: 0.1260
Query 231: 0.3632 At 200 docs: 0.0782 Run UHImlt1
Query 232: 0.0207 At 500 docs: 0.0370 Comparison to median by topic
Query 233: 0.2105 At 1000 docs: 0.0206
Query 234: 0.0302 +1.0
Query 235: 0.0735 R-Precision (prec. after R
Query 236: 0.7007 (=num_rel) docs. retrieved):
Query 237: 0.4162 Exact: 0.2300
Query 238: 0.2105
Query 239: 0.0272
Query 240: 0.5887 +0.5
Query 241: 0.0163
Query 242: 0.0661
Query 243: 0.0722
Query 244: 0.3333
Query 245: 0.4739
Query 246: 0.0189
Query 247: 0.3438
0.0
Query 248: 0.5044
Query 249: 0.0057
Query 250: 0.0000
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Hildesheim, Multilingual English, Auto, TD Run UHImlt2
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 50 queries): 1.0
Query 201: 0.0214 Total number of documents
Query 202: 0.4334 over all queries
Query 203: 0.4682 Retrieved: 50000
Query 204: 0.4693 Relevant: 1826
Query 205: 0.1553 Rel_ret: 973
0.8
Query 206: 0.1681
Query 207: 0.0748 Interpolated Recall -
Query 208: 0.0740 Precision Averages:
Query 209: 0.0023 at 0.00 0.5521
Query 210: 0.1691 at 0.10 0.3538 0.6
Query 211: 0.6178 at 0.20 0.2990
Query 212: 0.0387 at 0.30 0.2615
Query 213: 0.3026 at 0.40 0.2368
Precision
Query 214: 0.0043 at 0.50 0.2085
Query 215: 0.0216 at 0.60 0.1377 0.4
Query 216: 0.0005 at 0.70 0.0855
Query 217: 0.0020 at 0.80 0.0620
Query 218: 0.6689 at 0.90 0.0187
Query 219: 0.0001 at 1.00 0.0004
Query 220: 0.0009 0.2
Query 221: 0.3834 Avg. prec. (non-interpolated)
Query 222: 0.0142 for all rel. documents
Query 223: 0.0035 0.1849
Query 224: 0.0643 Precision:
Query 225: 0.0009 At 5 docs: 0.3280 0.0
Query 226: 0.0511 At 10 docs: 0.2840 0.0 0.2 0.4 0.6 0.8 1.0
Query 227: 0.0082 At 15 docs: 0.2613
Query 228: 0.0016 At 20 docs: 0.2370 Recall
Query 229: 0.1409 At 30 docs: 0.2053
Query 230: 0.5320 At 100 docs: 0.1174
Query 231: 0.1553 At 200 docs: 0.0728 Run UHImlt2
Query 232: 0.0272 At 500 docs: 0.0346 Comparison to median by topic
Query 233: 0.1679 At 1000 docs: 0.0195
Query 234: 0.0213 +1.0
Query 235: 0.0501 R-Precision (prec. after R
Query 236: 0.7600 (=num_rel) docs. retrieved):
Query 237: 0.4495 Exact: 0.2165
Query 238: 0.1709
Query 239: 0.0184
Query 240: 0.5280 +0.5
Query 241: 0.0058
Query 242: 0.1205
Query 243: 0.0677
Query 244: 0.6667
Query 245: 0.5054
Query 246: 0.0233
Query 247: 0.2188
0.0
Query 248: 0.3930
Query 249: 0.0029
Query 250: 0.0000
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Jaen/SINAI, Multilingual English, Auto, TD Run UJAMLRL
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 50 queries): 1.0
Query 201: 0.0382 Total number of documents
Query 202: 0.5970 over all queries
Query 203: 0.1963 Retrieved: 50000
Query 204: 0.5736 Relevant: 1826 0.8
Query 205: 0.4829 Rel_ret: 1346
Query 206: 0.3124
Query 207: 0.1907 Interpolated Recall -
Query 208: 0.4907 Precision Averages:
Query 209: 0.1800 at 0.00 0.6168
Query 210: 0.1908 at 0.10 0.4768 0.6
Query 211: 0.7902 at 0.20 0.4077
Query 212: 0.0776 at 0.30 0.3738
Query 213: 0.5421 at 0.40 0.3205
Precision
Query 214: 0.0309 at 0.50 0.2972
Query 215: 0.0394 at 0.60 0.2609 0.4
Query 216: 0.0866 at 0.70 0.2138
Query 217: 0.2215 at 0.80 0.1787
Query 218: 0.8073 at 0.90 0.1123
Query 219: 0.0975 at 1.00 0.0242
Query 220: 0.0442 0.2
Query 221: 0.1960 Avg. prec. (non-interpolated)
Query 222: 0.0205 for all rel. documents
Query 223: 0.0302 0.2773
Query 224: 0.7497 Precision:
Query 225: 0.2840 At 5 docs: 0.3720 0.0
Query 226: 0.0240 At 10 docs: 0.3920 0.0 0.2 0.4 0.6 0.8 1.0
Query 227: 0.0006 At 15 docs: 0.3613
Query 228: 0.0704 At 20 docs: 0.3360 Recall
Query 229: 0.1638 At 30 docs: 0.2880
Query 230: 0.6445 At 100 docs: 0.1702
Query 231: 0.3460 At 200 docs: 0.1064 Run UJAMLRL
Query 232: 0.0304 At 500 docs: 0.0492 Comparison to median by topic
Query 233: 0.3360 At 1000 docs: 0.0269
Query 234: 0.1852 +1.0
Query 235: 0.2943 R-Precision (prec. after R
Query 236: 0.1416 (=num_rel) docs. retrieved):
Query 237: 0.8407 Exact: 0.3279
Query 238: 0.2339
Query 239: 0.0625
Query 240: 0.6337 +0.5
Query 241: 0.0200
Query 242: 0.4085
Query 243: 0.1495
Query 244: 0.0236
Query 245: 0.4828
Query 246: 0.1762
0.0
Query 247: 0.7140
Query 248: 0.5935
Query 249: 0.0148
Query 250: 0.0061
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Jaen/SINAI, Multilingual English, Auto, TD Run UJAMLRL2P
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 50 queries): 1.0
Query 201: 0.0651 Total number of documents
Query 202: 0.5631 over all queries
Query 203: 0.1818 Retrieved: 50000
Query 204: 0.6561 Relevant: 1826 0.8
Query 205: 0.4967 Rel_ret: 1339
Query 206: 0.5305
Query 207: 0.2470 Interpolated Recall -
Query 208: 0.6791 Precision Averages:
Query 209: 0.0638 at 0.00 0.7611
Query 210: 0.2458 at 0.10 0.5813 0.6
Query 211: 0.8772 at 0.20 0.4979
Query 212: 0.0677 at 0.30 0.4256
Query 213: 0.6332 at 0.40 0.3681
Precision
Query 214: 0.0316 at 0.50 0.3325
Query 215: 0.0683 at 0.60 0.2780 0.4
Query 216: 0.2105 at 0.70 0.2337
Query 217: 0.3527 at 0.80 0.1972
Query 218: 0.8482 at 0.90 0.1137
Query 219: 0.1277 at 1.00 0.0313
Query 220: 0.0996 0.2
Query 221: 0.2675 Avg. prec. (non-interpolated)
Query 222: 0.0137 for all rel. documents
Query 223: 0.0612 0.3336
Query 224: 0.7427 Precision:
Query 225: 0.4796 At 5 docs: 0.5440 0.0
Query 226: 0.0368 At 10 docs: 0.4520 0.0 0.2 0.4 0.6 0.8 1.0
Query 227: 0.0006 At 15 docs: 0.3947
Query 228: 0.1457 At 20 docs: 0.3620 Recall
Query 229: 0.3233 At 30 docs: 0.3100
Query 230: 0.6203 At 100 docs: 0.1740
Query 231: 0.4637 At 200 docs: 0.1072 Run UJAMLRL2P
Query 232: 0.0652 At 500 docs: 0.0491 Comparison to median by topic
Query 233: 0.4055 At 1000 docs: 0.0268
Query 234: 0.4005 +1.0
Query 235: 0.2629 R-Precision (prec. after R
Query 236: 0.1862 (=num_rel) docs. retrieved):
Query 237: 0.7781 Exact: 0.3501
Query 238: 0.2741
Query 239: 0.0585
Query 240: 0.9481 +0.5
Query 241: 0.0058
Query 242: 0.4448
Query 243: 0.2107
Query 244: 0.0185
Query 245: 0.6602
Query 246: 0.1670
0.0
Query 247: 0.8668
Query 248: 0.6884
Query 249: 0.0143
Query 250: 0.0240
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Jaen/SINAI, Multilingual English, Auto, TD Run UJAMLRL3P
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 50 queries): 1.0
Query 201: 0.0482 Total number of documents
Query 202: 0.5732 over all queries
Query 203: 0.2581 Retrieved: 50000
Query 204: 0.6122 Relevant: 1826 0.8
Query 205: 0.4600 Rel_ret: 1358
Query 206: 0.4074
Query 207: 0.1948 Interpolated Recall -
Query 208: 0.6038 Precision Averages:
Query 209: 0.1712 at 0.00 0.6557
Query 210: 0.2207 at 0.10 0.5037 0.6
Query 211: 0.8805 at 0.20 0.4455
Query 212: 0.0832 at 0.30 0.4022
Query 213: 0.6221 at 0.40 0.3546
Precision
Query 214: 0.0292 at 0.50 0.3170
Query 215: 0.0408 at 0.60 0.2744 0.4
Query 216: 0.1378 at 0.70 0.2266
Query 217: 0.2393 at 0.80 0.1962
Query 218: 0.8386 at 0.90 0.1162
Query 219: 0.0813 at 1.00 0.0290
Query 220: 0.0838 0.2
Query 221: 0.2452 Avg. prec. (non-interpolated)
Query 222: 0.0168 for all rel. documents
Query 223: 0.0619 0.3005
Query 224: 0.7163 Precision:
Query 225: 0.2693 At 5 docs: 0.4160 0.0
Query 226: 0.0198 At 10 docs: 0.4200 0.0 0.2 0.4 0.6 0.8 1.0
Query 227: 0.0022 At 15 docs: 0.3813
Query 228: 0.1010 At 20 docs: 0.3520 Recall
Query 229: 0.2698 At 30 docs: 0.3013
Query 230: 0.6034 At 100 docs: 0.1774
Query 231: 0.5242 At 200 docs: 0.1095 Run UJAMLRL3P
Query 232: 0.0549 At 500 docs: 0.0500 Comparison to median by topic
Query 233: 0.4022 At 1000 docs: 0.0272
Query 234: 0.2386 +1.0
Query 235: 0.2248 R-Precision (prec. after R
Query 236: 0.1316 (=num_rel) docs. retrieved):
Query 237: 0.8224 Exact: 0.3380
Query 238: 0.2918
Query 239: 0.0701
Query 240: 0.6337 +0.5
Query 241: 0.0062
Query 242: 0.3868
Query 243: 0.2316
Query 244: 0.0216
Query 245: 0.5778
Query 246: 0.2017
0.0
Query 247: 0.6690
Query 248: 0.6068
Query 249: 0.0144
Query 250: 0.0227
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Jaen/SINAI, Multilingual English, Auto, TD Run UJAMLRLRP
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 50 queries): 1.0
Query 201: 0.0475 Total number of documents
Query 202: 0.5719 over all queries
Query 203: 0.2568 Retrieved: 50000
Query 204: 0.6123 Relevant: 1826 0.8
Query 205: 0.4598 Rel_ret: 1362
Query 206: 0.4072
Query 207: 0.2070 Interpolated Recall -
Query 208: 0.6054 Precision Averages:
Query 209: 0.1724 at 0.00 0.6554
Query 210: 0.2204 at 0.10 0.5024 0.6
Query 211: 0.8792 at 0.20 0.4465
Query 212: 0.0833 at 0.30 0.4034
Query 213: 0.6209 at 0.40 0.3551
Precision
Query 214: 0.0293 at 0.50 0.3176
Query 215: 0.0403 at 0.60 0.2751 0.4
Query 216: 0.1333 at 0.70 0.2265
Query 217: 0.2393 at 0.80 0.1969
Query 218: 0.8384 at 0.90 0.1156
Query 219: 0.0816 at 1.00 0.0290
Query 220: 0.0828 0.2
Query 221: 0.2453 Avg. prec. (non-interpolated)
Query 222: 0.0169 for all rel. documents
Query 223: 0.0618 0.3008
Query 224: 0.7175 Precision:
Query 225: 0.2768 At 5 docs: 0.4160 0.0
Query 226: 0.0198 At 10 docs: 0.4160 0.0 0.2 0.4 0.6 0.8 1.0
Query 227: 0.0018 At 15 docs: 0.3800
Query 228: 0.1008 At 20 docs: 0.3560 Recall
Query 229: 0.2700 At 30 docs: 0.3020
Query 230: 0.6030 At 100 docs: 0.1766
Query 231: 0.5277 At 200 docs: 0.1092 Run UJAMLRLRP
Query 232: 0.0587 At 500 docs: 0.0500 Comparison to median by topic
Query 233: 0.4006 At 1000 docs: 0.0272
Query 234: 0.2381 +1.0
Query 235: 0.2271 R-Precision (prec. after R
Query 236: 0.1332 (=num_rel) docs. retrieved):
Query 237: 0.8216 Exact: 0.3362
Query 238: 0.2913
Query 239: 0.0697
Query 240: 0.6337 +0.5
Query 241: 0.0055
Query 242: 0.3866
Query 243: 0.2316
Query 244: 0.0208
Query 245: 0.5768
Query 246: 0.2048
0.0
Query 247: 0.6641
Query 248: 0.6094
Query 249: 0.0140
Query 250: 0.0227
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Jaen/SINAI, Multilingual English, Auto, TD Run UJAMLRSV2
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 50 queries): 1.0
Query 201: 0.0864 Total number of documents
Query 202: 0.5667 over all queries
Query 203: 0.2161 Retrieved: 50000
Query 204: 0.6625 Relevant: 1826 0.8
Query 205: 0.5455 Rel_ret: 1322
Query 206: 0.5553
Query 207: 0.2246 Interpolated Recall -
Query 208: 0.6478 Precision Averages:
Query 209: 0.0763 at 0.00 0.7501
Query 210: 0.2198 at 0.10 0.5801 0.6
Query 211: 0.8608 at 0.20 0.4930
Query 212: 0.0511 at 0.30 0.4260
Query 213: 0.6252 at 0.40 0.3759
Precision
Query 214: 0.0643 at 0.50 0.3425
Query 215: 0.0842 at 0.60 0.2858 0.4
Query 216: 0.1960 at 0.70 0.2319
Query 217: 0.3256 at 0.80 0.2030
Query 218: 0.8661 at 0.90 0.1137
Query 219: 0.1089 at 1.00 0.0379
Query 220: 0.1323 0.2
Query 221: 0.2423 Avg. prec. (non-interpolated)
Query 222: 0.0148 for all rel. documents
Query 223: 0.0481 0.3341
Query 224: 0.7691 Precision:
Query 225: 0.4724 At 5 docs: 0.5160 0.0
Query 226: 0.0638 At 10 docs: 0.4460 0.0 0.2 0.4 0.6 0.8 1.0
Query 227: 0.0000 At 15 docs: 0.3920
Query 228: 0.1504 At 20 docs: 0.3680 Recall
Query 229: 0.3261 At 30 docs: 0.3233
Query 230: 0.7124 At 100 docs: 0.1778
Query 231: 0.4247 At 200 docs: 0.1074 Run UJAMLRSV2
Query 232: 0.0785 At 500 docs: 0.0493 Comparison to median by topic
Query 233: 0.3914 At 1000 docs: 0.0264
Query 234: 0.3340 +1.0
Query 235: 0.2387 R-Precision (prec. after R
Query 236: 0.1430 (=num_rel) docs. retrieved):
Query 237: 0.7499 Exact: 0.3447
Query 238: 0.2819
Query 239: 0.0573
Query 240: 0.9481 +0.5
Query 241: 0.0030
Query 242: 0.4268
Query 243: 0.2290
Query 244: 0.0058
Query 245: 0.6716
Query 246: 0.1561
0.0
Query 247: 0.9259
Query 248: 0.6805
Query 249: 0.0132
Query 250: 0.0303
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Université de Neuchâtel, Multilingual English, Auto, TD Run UniNEmulti1
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 50 queries): 1.0
Query 201: 0.0723 Total number of documents
Query 202: 0.5124 over all queries
Query 203: 0.3789 Retrieved: 50000
Query 204: 0.5866 Relevant: 1826 0.8
Query 205: 0.2576 Rel_ret: 1327
Query 206: 0.4474
Query 207: 0.2164 Interpolated Recall -
Query 208: 0.4017 Precision Averages:
Query 209: 0.0967 at 0.00 0.6236
Query 210: 0.0668 at 0.10 0.5318 0.6
Query 211: 0.7627 at 0.20 0.4743
Query 212: 0.1052 at 0.30 0.4009
Query 213: 0.4424 at 0.40 0.3481
Precision
Query 214: 0.0772 at 0.50 0.3047
Query 215: 0.1096 at 0.60 0.2683 0.4
Query 216: 0.1287 at 0.70 0.2339
Query 217: 0.2073 at 0.80 0.1986
Query 218: 0.8703 at 0.90 0.1477
Query 219: 0.0864 at 1.00 0.0627
Query 220: 0.0222 0.2
Query 221: 0.3914 Avg. prec. (non-interpolated)
Query 222: 0.0537 for all rel. documents
Query 223: 0.0698 0.3090
Query 224: 0.7080 Precision:
Query 225: 0.1726 At 5 docs: 0.4400 0.0
Query 226: 0.0358 At 10 docs: 0.3700 0.0 0.2 0.4 0.6 0.8 1.0
Query 227: 0.0000 At 15 docs: 0.3520
Query 228: 0.3760 At 20 docs: 0.3410 Recall
Query 229: 0.1583 At 30 docs: 0.3020
Query 230: 0.5240 At 100 docs: 0.1812
Query 231: 0.3757 At 200 docs: 0.1135 Run UniNEmulti1
Query 232: 0.0398 At 500 docs: 0.0504 Comparison to median by topic
Query 233: 0.3644 At 1000 docs: 0.0265
Query 234: 0.1051 +1.0
Query 235: 0.0445 R-Precision (prec. after R
Query 236: 0.8630 (=num_rel) docs. retrieved):
Query 237: 0.5875 Exact: 0.3398
Query 238: 0.3064
Query 239: 0.0756
Query 240: 0.6173 +0.5
Query 241: 0.0073
Query 242: 0.5775
Query 243: 0.3727
Query 244: 0.1146
Query 245: 0.7250
Query 246: 0.2957
0.0
Query 247: 0.9823
Query 248: 0.6089
Query 249: 0.0078
Query 250: 0.0410
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Université de Neuchâtel, Multilingual English, Auto, TD Run UniNEmulti2
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 50 queries): 1.0
Query 201: 0.0851 Total number of documents
Query 202: 0.7031 over all queries
Query 203: 0.3720 Retrieved: 50000
Query 204: 0.5119 Relevant: 1826 0.8
Query 205: 0.3514 Rel_ret: 1423
Query 206: 0.3210
Query 207: 0.1843 Interpolated Recall -
Query 208: 0.4481 Precision Averages:
Query 209: 0.1602 at 0.00 0.6156
Query 210: 0.0699 at 0.10 0.5133 0.6
Query 211: 0.8510 at 0.20 0.4316
Query 212: 0.1483 at 0.30 0.3768
Query 213: 0.3773 at 0.40 0.3398
Precision
Query 214: 0.0839 at 0.50 0.3090
Query 215: 0.1302 at 0.60 0.2712 0.4
Query 216: 0.1532 at 0.70 0.2352
Query 217: 0.2422 at 0.80 0.2055
Query 218: 0.7577 at 0.90 0.1557
Query 219: 0.0692 at 1.00 0.0676
Query 220: 0.0184 0.2
Query 221: 0.3479 Avg. prec. (non-interpolated)
Query 222: 0.0404 for all rel. documents
Query 223: 0.0712 0.2969
Query 224: 0.7198 Precision:
Query 225: 0.2609 At 5 docs: 0.3520 0.0
Query 226: 0.0614 At 10 docs: 0.3440 0.0 0.2 0.4 0.6 0.8 1.0
Query 227: 0.0027 At 15 docs: 0.3413
Query 228: 0.2576 At 20 docs: 0.3270 Recall
Query 229: 0.1461 At 30 docs: 0.2907
Query 230: 0.4331 At 100 docs: 0.1868
Query 231: 0.4166 At 200 docs: 0.1158 Run UniNEmulti2
Query 232: 0.0542 At 500 docs: 0.0532 Comparison to median by topic
Query 233: 0.3499 At 1000 docs: 0.0285
Query 234: 0.1217 +1.0
Query 235: 0.0720 R-Precision (prec. after R
Query 236: 0.6234 (=num_rel) docs. retrieved):
Query 237: 0.4467 Exact: 0.3215
Query 238: 0.3072
Query 239: 0.0576
Query 240: 0.7221 +0.5
Query 241: 0.0135
Query 242: 0.5278
Query 243: 0.2722
Query 244: 0.0589
Query 245: 0.7331
Query 246: 0.2803
0.0
Query 247: 0.8755
Query 248: 0.4942
Query 249: 0.0117
Query 250: 0.0293
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Université de Neuchâtel, Multilingual English, Auto, TD Run UniNEmulti3
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 50 queries): 1.0
Query 201: 0.0676 Total number of documents
Query 202: 0.6581 over all queries
Query 203: 0.4721 Retrieved: 50000
Query 204: 0.5233 Relevant: 1826 0.8
Query 205: 0.5011 Rel_ret: 1309
Query 206: 0.2112
Query 207: 0.1331 Interpolated Recall -
Query 208: 0.1690 Precision Averages:
Query 209: 0.1318 at 0.00 0.6254
Query 210: 0.0280 at 0.10 0.5300 0.6
Query 211: 0.8852 at 0.20 0.4712
Query 212: 0.1642 at 0.30 0.3980
Query 213: 0.3774 at 0.40 0.3529
Precision
Query 214: 0.0824 at 0.50 0.3070
Query 215: 0.1445 at 0.60 0.2751 0.4
Query 216: 0.1037 at 0.70 0.2227
Query 217: 0.2428 at 0.80 0.1856
Query 218: 0.8142 at 0.90 0.1186
Query 219: 0.5094 at 1.00 0.0395
Query 220: 0.0090 0.2
Query 221: 0.3070 Avg. prec. (non-interpolated)
Query 222: 0.0241 for all rel. documents
Query 223: 0.1311 0.3067
Query 224: 0.8895 Precision:
Query 225: 0.4536 At 5 docs: 0.4440 0.0
Query 226: 0.0470 At 10 docs: 0.4100 0.0 0.2 0.4 0.6 0.8 1.0
Query 227: 0.0000 At 15 docs: 0.3707
Query 228: 0.3938 At 20 docs: 0.3480 Recall
Query 229: 0.1241 At 30 docs: 0.2927
Query 230: 0.5365 At 100 docs: 0.1726
Query 231: 0.2021 At 200 docs: 0.1067 Run UniNEmulti3
Query 232: 0.0023 At 500 docs: 0.0489 Comparison to median by topic
Query 233: 0.2567 At 1000 docs: 0.0262
Query 234: 0.2739 +1.0
Query 235: 0.0494 R-Precision (prec. after R
Query 236: 0.7136 (=num_rel) docs. retrieved):
Query 237: 0.5924 Exact: 0.3261
Query 238: 0.2128
Query 239: 0.0343
Query 240: 0.7768 +0.5
Query 241: 0.0009
Query 242: 0.6001
Query 243: 0.2825
Query 244: 0.0211
Query 245: 0.3930
Query 246: 0.3155
0.0
Query 247: 0.8896
Query 248: 0.5602
Query 249: 0.0089
Query 250: 0.0142
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Université de Neuchâtel, Multilingual English, Auto, TD Run UniNEmulti4
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 50 queries): 1.0
Query 201: 0.0723 Total number of documents
Query 202: 0.5124 over all queries
Query 203: 0.3732 Retrieved: 50000
Query 204: 0.5866 Relevant: 1826 0.8
Query 205: 0.3067 Rel_ret: 1240
Query 206: 0.4474
Query 207: 0.2164 Interpolated Recall -
Query 208: 0.4017 Precision Averages:
Query 209: 0.0967 at 0.00 0.6255
Query 210: 0.0668 at 0.10 0.5343 0.6
Query 211: 0.3389 at 0.20 0.4781
Query 212: 0.1052 at 0.30 0.4044
Query 213: 0.4424 at 0.40 0.3381
Precision
Query 214: 0.0772 at 0.50 0.2890
Query 215: 0.0903 at 0.60 0.2525 0.4
Query 216: 0.1287 at 0.70 0.2184
Query 217: 0.2073 at 0.80 0.1835
Query 218: 0.8703 at 0.90 0.1314
Query 219: 0.0864 at 1.00 0.0594
Query 220: 0.0222 0.2
Query 221: 0.3914 Avg. prec. (non-interpolated)
Query 222: 0.0537 for all rel. documents
Query 223: 0.0698 0.3010
Query 224: 0.7080 Precision:
Query 225: 0.1726 At 5 docs: 0.4400 0.0
Query 226: 0.0358 At 10 docs: 0.3700 0.0 0.2 0.4 0.6 0.8 1.0
Query 227: 0.0000 At 15 docs: 0.3547
Query 228: 0.3760 At 20 docs: 0.3450 Recall
Query 229: 0.1583 At 30 docs: 0.3053
Query 230: 0.5240 At 100 docs: 0.1762
Query 231: 0.3757 At 200 docs: 0.1066 Run UniNEmulti4
Query 232: 0.0398 At 500 docs: 0.0470 Comparison to median by topic
Query 233: 0.3644 At 1000 docs: 0.0248
Query 234: 0.1051 +1.0
Query 235: 0.0445 R-Precision (prec. after R
Query 236: 0.8630 (=num_rel) docs. retrieved):
Query 237: 0.5875 Exact: 0.3346
Query 238: 0.3064
Query 239: 0.0756
Query 240: 0.6173 +0.5
Query 241: 0.0074
Query 242: 0.5775
Query 243: 0.3727
Query 244: 0.1146
Query 245: 0.7250
Query 246: 0.2957
0.0
Query 247: 0.9823
Query 248: 0.6089
Query 249: 0.0078
Query 250: 0.0410
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Université de Neuchâtel, Multilingual English, Auto, TD Run UniNEmulti5
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 50 queries): 1.0
Query 201: 0.0948 Total number of documents
Query 202: 0.6611 over all queries
Query 203: 0.3382 Retrieved: 50000
Query 204: 0.4931 Relevant: 1826 0.8
Query 205: 0.2961 Rel_ret: 1388
Query 206: 0.4255
Query 207: 0.2394 Interpolated Recall -
Query 208: 0.4278 Precision Averages:
Query 209: 0.0667 at 0.00 0.6445
Query 210: 0.0637 at 0.10 0.5310 0.6
Query 211: 0.8111 at 0.20 0.4487
Query 212: 0.1671 at 0.30 0.3929
Query 213: 0.4310 at 0.40 0.3549
Precision
Query 214: 0.0690 at 0.50 0.3199
Query 215: 0.1659 at 0.60 0.2631 0.4
Query 216: 0.1955 at 0.70 0.2175
Query 217: 0.2482 at 0.80 0.1891
Query 218: 0.7701 at 0.90 0.1240
Query 219: 0.0298 at 1.00 0.0435
Query 220: 0.0223 0.2
Query 221: 0.2843 Avg. prec. (non-interpolated)
Query 222: 0.0368 for all rel. documents
Query 223: 0.0651 0.3019
Query 224: 0.8501 Precision:
Query 225: 0.0297 At 5 docs: 0.4280 0.0
Query 226: 0.0694 At 10 docs: 0.3820 0.0 0.2 0.4 0.6 0.8 1.0
Query 227: 0.0027 At 15 docs: 0.3600
Query 228: 0.3342 At 20 docs: 0.3340 Recall
Query 229: 0.2104 At 30 docs: 0.2907
Query 230: 0.5080 At 100 docs: 0.1756
Query 231: 0.3145 At 200 docs: 0.1135 Run UniNEmulti5
Query 232: 0.0458 At 500 docs: 0.0512 Comparison to median by topic
Query 233: 0.4176 At 1000 docs: 0.0278
Query 234: 0.0527 +1.0
Query 235: 0.0944 R-Precision (prec. after R
Query 236: 0.6235 (=num_rel) docs. retrieved):
Query 237: 0.4574 Exact: 0.3250
Query 238: 0.3006
Query 239: 0.0669
Query 240: 0.7708 +0.5
Query 241: 0.0134
Query 242: 0.6310
Query 243: 0.2529
Query 244: 0.0046
Query 245: 0.7902
Query 246: 0.2670
0.0
Query 247: 0.9823
Query 248: 0.5617
Query 249: 0.0161
Query 250: 0.0258
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
ILTG, Bilingual French to English, Auto, TDN Run ltrcbifren1
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 42 queries): 1.0
Query 201: 0.1765 Total number of documents
Query 202: 0.6391 over all queries
Query 204: 0.0504 Retrieved: 42000
Query 205: 0.1983 Relevant: 375
Query 206: 0.8667 Rel_ret: 257
0.8
Query 207: 0.0003
Query 208: 0.5000 Interpolated Recall -
Query 209: 0.0000 Precision Averages:
Query 210: 0.0345 at 0.00 0.4465
Query 211: 0.0055 at 0.10 0.4454 0.6
Query 212: 0.2478 at 0.20 0.4133
Query 213: 0.1049 at 0.30 0.3756
Query 214: 0.0186 at 0.40 0.3557
Precision
Query 215: 0.0013 at 0.50 0.3536
Query 216: 0.0032 at 0.60 0.2988 0.4
Query 217: 0.5909 at 0.70 0.2616
Query 218: 0.1628 at 0.80 0.2450
Query 219: 0.0000 at 0.90 0.2228
Query 221: 1.0000 at 1.00 0.2005
Query 222: 0.0205 0.2
Query 223: 0.2500 Avg. prec. (non-interpolated)
Query 224: 0.7733 for all rel. documents
Query 226: 0.2687 0.3137
Query 228: 0.0000 Precision:
Query 229: 0.0000 At 5 docs: 0.2571 0.0
Query 230: 0.4367 At 10 docs: 0.1738 0.0 0.2 0.4 0.6 0.8 1.0
Query 231: 0.0833 At 15 docs: 0.1460
Query 232: 0.0004 At 20 docs: 0.1298 Recall
Query 233: 0.0029 At 30 docs: 0.1095
Query 235: 0.0436 At 100 docs: 0.0457
Query 236: 1.0000 At 200 docs: 0.0273 Run ltrcbifren1
Query 237: 1.0000 At 500 docs: 0.0118 Comparison to median by topic
Query 238: 0.2572 At 1000 docs: 0.0061
Query 239: 0.1242 +1.0
Query 240: 0.7029 R-Precision (prec. after R
Query 241: 0.0000 (=num_rel) docs. retrieved):
Query 242: 1.0000 Exact: 0.3109
Query 245: 0.7926
Query 246: 1.0000
Query 247: 0.6792 +0.5
Query 248: 0.1226
Query 249: 0.0153
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
ILTG, Bilingual French to English, Auto, TDN Run ltrcbifren2
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 42 queries): 1.0
Query 201: 0.1608 Total number of documents
Query 202: 0.6391 over all queries
Query 204: 0.1185 Retrieved: 42000
Query 205: 0.4490 Relevant: 375
Query 206: 0.3833 Rel_ret: 262
0.8
Query 207: 0.0005
Query 208: 0.5000 Interpolated Recall -
Query 209: 0.0000 Precision Averages:
Query 210: 0.0099 at 0.00 0.4315
Query 211: 0.2350 at 0.10 0.4127 0.6
Query 212: 0.0856 at 0.20 0.3855
Query 213: 0.0580 at 0.30 0.3252
Query 214: 0.2167 at 0.40 0.3158
Precision
Query 215: 0.0000 at 0.50 0.3079
Query 216: 0.0037 at 0.60 0.2632 0.4
Query 217: 0.2614 at 0.70 0.2455
Query 218: 0.7095 at 0.80 0.2267
Query 219: 0.0135 at 0.90 0.1832
Query 221: 1.0000 at 1.00 0.1650
Query 222: 0.0431 0.2
Query 223: 0.2540 Avg. prec. (non-interpolated)
Query 224: 0.5633 for all rel. documents
Query 226: 0.2687 0.2768
Query 228: 0.0000 Precision:
Query 229: 0.0000 At 5 docs: 0.2381 0.0
Query 230: 0.5667 At 10 docs: 0.1833 0.0 0.2 0.4 0.6 0.8 1.0
Query 231: 0.0154 At 15 docs: 0.1587
Query 232: 0.0002 At 20 docs: 0.1429 Recall
Query 233: 0.0010 At 30 docs: 0.1135
Query 235: 0.1581 At 100 docs: 0.0440
Query 236: 1.0000 At 200 docs: 0.0257 Run ltrcbifren2
Query 237: 1.0000 At 500 docs: 0.0119 Comparison to median by topic
Query 238: 0.2636 At 1000 docs: 0.0062
Query 239: 0.0672 +1.0
Query 240: 0.7593 R-Precision (prec. after R
Query 241: 0.0000 (=num_rel) docs. retrieved):
Query 242: 0.0904 Exact: 0.2528
Query 245: 0.8088
Query 246: 0.5000
Query 247: 0.3742 +0.5
Query 248: 0.0222
Query 249: 0.0245
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
ILTG, Bilingual French to English, Auto, TDN Run ltrcbifren3
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 42 queries): 1.0
Query 201: 0.0619 Total number of documents
Query 202: 0.5579 over all queries
Query 204: 0.0556 Retrieved: 42000
Query 205: 0.1094 Relevant: 375
Query 206: 0.8667 Rel_ret: 289
0.8
Query 207: 0.2101
Query 208: 0.5000 Interpolated Recall -
Query 209: 0.0170 Precision Averages:
Query 210: 0.0063 at 0.00 0.4981
Query 211: 0.6968 at 0.10 0.4716 0.6
Query 212: 0.1949 at 0.20 0.4527
Query 213: 0.2327 at 0.30 0.4424
Query 214: 0.0186 at 0.40 0.4168
Precision
Query 215: 0.0000 at 0.50 0.3998
Query 216: 0.4167 at 0.60 0.3439 0.4
Query 217: 0.0307 at 0.70 0.3144
Query 218: 0.8046 at 0.80 0.2869
Query 219: 0.0044 at 0.90 0.2511
Query 221: 0.8333 at 1.00 0.2246
Query 222: 0.0207 0.2
Query 223: 0.0009 Avg. prec. (non-interpolated)
Query 224: 0.7774 for all rel. documents
Query 226: 0.0079 0.3597
Query 228: 0.1667 Precision:
Query 229: 0.2500 At 5 docs: 0.3238 0.0
Query 230: 0.6278 At 10 docs: 0.2429 0.0 0.2 0.4 0.6 0.8 1.0
Query 231: 0.1429 At 15 docs: 0.1968
Query 232: 0.0848 At 20 docs: 0.1702 Recall
Query 233: 0.8637 At 30 docs: 0.1278
Query 235: 0.0004 At 100 docs: 0.0479
Query 236: 1.0000 At 200 docs: 0.0298 Run ltrcbifren3
Query 237: 1.0000 At 500 docs: 0.0133 Comparison to median by topic
Query 238: 0.2456 At 1000 docs: 0.0069
Query 239: 0.0363 +1.0
Query 240: 0.6958 R-Precision (prec. after R
Query 241: 0.0034 (=num_rel) docs. retrieved):
Query 242: 1.0000 Exact: 0.3305
Query 245: 0.8657
Query 246: 0.5000
Query 247: 0.2734 +0.5
Query 248: 0.9167
Query 249: 0.0079
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
ILTG, Bilingual French to English, Auto, TDN Run ltrcbifren4
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 42 queries): 1.0
Query 201: 0.0636 Total number of documents
Query 202: 0.1188 over all queries
Query 204: 0.0556 Retrieved: 42000
Query 205: 0.4290 Relevant: 375
Query 206: 0.8667 Rel_ret: 254
0.8
Query 207: 0.0000
Query 208: 0.5000 Interpolated Recall -
Query 209: 0.0000 Precision Averages:
Query 210: 0.0303 at 0.00 0.4953
Query 211: 1.0000 at 0.10 0.4680 0.6
Query 212: 0.2228 at 0.20 0.4620
Query 213: 0.0879 at 0.30 0.4097
Query 214: 0.0929 at 0.40 0.4016
Precision
Query 215: 0.0000 at 0.50 0.3942
Query 216: 0.0253 at 0.60 0.3204 0.4
Query 217: 0.1875 at 0.70 0.2835
Query 218: 0.8046 at 0.80 0.2517
Query 219: 0.0000 at 0.90 0.2246
Query 221: 1.0000 at 1.00 0.2190
Query 222: 0.0870 0.2
Query 223: 0.2534 Avg. prec. (non-interpolated)
Query 224: 0.5511 for all rel. documents
Query 226: 0.2687 0.3467
Query 228: 0.1667 Precision:
Query 229: 0.2500 At 5 docs: 0.2762 0.0
Query 230: 0.7278 At 10 docs: 0.2143 0.0 0.2 0.4 0.6 0.8 1.0
Query 231: 0.0833 At 15 docs: 0.1714
Query 232: 0.0013 At 20 docs: 0.1417 Recall
Query 233: 0.7418 At 30 docs: 0.1119
Query 235: 0.0000 At 100 docs: 0.0460
Query 236: 1.0000 At 200 docs: 0.0258 Run ltrcbifren4
Query 237: 1.0000 At 500 docs: 0.0114 Comparison to median by topic
Query 238: 0.2408 At 1000 docs: 0.0060
Query 239: 0.0607 +1.0
Query 240: 0.7500 R-Precision (prec. after R
Query 241: 0.0019 (=num_rel) docs. retrieved):
Query 242: 1.0000 Exact: 0.3212
Query 245: 0.8187
Query 246: 0.5000
Query 247: 0.5592 +0.5
Query 248: 0.0042
Query 249: 0.0112
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
ILTG, Bilingual French to English, Auto, TDN Run ltrcbifren5
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 42 queries): 1.0
Query 201: 0.1317 Total number of documents
Query 202: 0.1231 over all queries
Query 204: 0.0556 Retrieved: 42000
Query 205: 0.3741 Relevant: 375
Query 206: 0.8667 Rel_ret: 284
0.8
Query 207: 0.1336
Query 208: 0.5000 Interpolated Recall -
Query 209: 0.0170 Precision Averages:
Query 210: 0.0049 at 0.00 0.6073
Query 211: 1.0000 at 0.10 0.5138 0.6
Query 212: 0.1873 at 0.20 0.4940
Query 213: 0.1987 at 0.30 0.4490
Query 214: 0.2000 at 0.40 0.4244
Precision
Query 215: 0.0000 at 0.50 0.4205
Query 216: 0.3988 at 0.60 0.3418 0.4
Query 217: 0.0211 at 0.70 0.3141
Query 218: 0.8046 at 0.80 0.2798
Query 219: 0.0044 at 0.90 0.2339
Query 221: 0.8333 at 1.00 0.2252
Query 222: 0.1005 0.2
Query 223: 0.0164 Avg. prec. (non-interpolated)
Query 224: 0.5511 for all rel. documents
Query 226: 0.2687 0.3749
Query 228: 0.1667 Precision:
Query 229: 0.2500 At 5 docs: 0.3286 0.0
Query 230: 0.6278 At 10 docs: 0.2452 0.0 0.2 0.4 0.6 0.8 1.0
Query 231: 0.0833 At 15 docs: 0.2016
Query 232: 0.1001 At 20 docs: 0.1667 Recall
Query 233: 0.8148 At 30 docs: 0.1190
Query 235: 0.0000 At 100 docs: 0.0460
Query 236: 1.0000 At 200 docs: 0.0277 Run ltrcbifren5
Query 237: 1.0000 At 500 docs: 0.0125 Comparison to median by topic
Query 238: 0.2408 At 1000 docs: 0.0068
Query 239: 0.1155 +1.0
Query 240: 0.6958 R-Precision (prec. after R
Query 241: 0.0019 (=num_rel) docs. retrieved):
Query 242: 1.0000 Exact: 0.3426
Query 245: 0.8657
Query 246: 0.5000
Query 247: 0.5592 +0.5
Query 248: 0.9167
Query 249: 0.0141
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
SICS, Bilingual Amharic to English, Manual, TD Run stockholmAmEnA
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 42 queries): 1.0
Query 201: 0.1938 Total number of documents
Query 202: 0.5525 over all queries
Query 204: 0.0552 Retrieved: 42000
Query 205: 0.5170 Relevant: 375
Query 206: 0.6250 Rel_ret: 307
0.8
Query 207: 0.0020
Query 208: 1.0000 Interpolated Recall -
Query 209: 0.0277 Precision Averages:
Query 210: 0.0417 at 0.00 0.5150
Query 211: 1.0000 at 0.10 0.4961 0.6
Query 212: 0.0355 at 0.20 0.4896
Query 213: 0.2619 at 0.30 0.4392
Query 214: 0.0056 at 0.40 0.4181
Precision
Query 215: 1.0000 at 0.50 0.4043
Query 216: 0.5076 at 0.60 0.3964 0.4
Query 217: 0.0019 at 0.70 0.3732
Query 218: 0.6315 at 0.80 0.3664
Query 219: 0.0179 at 0.90 0.3460
Query 221: 1.0000 at 1.00 0.3276
Query 222: 0.0199 0.2
Query 223: 0.0698 Avg. prec. (non-interpolated)
Query 224: 0.7661 for all rel. documents
Query 226: 0.2599 0.4009
Query 228: 0.0000 Precision:
Query 229: 0.5000 At 5 docs: 0.2571 0.0
Query 230: 0.4476 At 10 docs: 0.2024 0.0 0.2 0.4 0.6 0.8 1.0
Query 231: 0.2000 At 15 docs: 0.1810
Query 232: 0.0451 At 20 docs: 0.1619 Recall
Query 233: 0.0005 At 30 docs: 0.1270
Query 235: 0.1989 At 100 docs: 0.0521
Query 236: 0.9167 At 200 docs: 0.0287 Run stockholmAmEnA
Query 237: 1.0000 At 500 docs: 0.0135 Comparison to median by topic
Query 238: 0.2793 At 1000 docs: 0.0073
Query 239: 0.0024 +1.0
Query 240: 0.8139 R-Precision (prec. after R
Query 241: 0.0117 (=num_rel) docs. retrieved):
Query 242: 0.2041 Exact: 0.3663
Query 245: 0.7519
Query 246: 1.0000
Query 247: 1.0000 +0.5
Query 248: 0.8667
Query 249: 0.0070
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
SICS, Bilingual Amharic to English, Manual, TD Run stockholmAmEnI
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 42 queries): 1.0
Query 201: 0.0636 Total number of documents
Query 202: 0.5575 over all queries
Query 204: 0.0546 Retrieved: 42000
Query 205: 0.5170 Relevant: 375
Query 206: 0.5917 Rel_ret: 297
0.8
Query 207: 0.0013
Query 208: 0.7000 Interpolated Recall -
Query 209: 0.0276 Precision Averages:
Query 210: 0.0417 at 0.00 0.4799
Query 211: 1.0000 at 0.10 0.4597 0.6
Query 212: 0.0405 at 0.20 0.4535
Query 213: 0.2587 at 0.30 0.4074
Query 214: 0.0021 at 0.40 0.3863
Precision
Query 215: 1.0000 at 0.50 0.3724
Query 216: 0.5208 at 0.60 0.3458 0.4
Query 217: 0.0019 at 0.70 0.3356
Query 218: 0.6254 at 0.80 0.3273
Query 219: 0.0116 at 0.90 0.3109
Query 221: 0.3667 at 1.00 0.2961
Query 222: 0.0000 0.2
Query 223: 0.0686 Avg. prec. (non-interpolated)
Query 224: 0.7661 for all rel. documents
Query 226: 0.2630 0.3615
Query 228: 0.0000 Precision:
Query 229: 0.5000 At 5 docs: 0.2619 0.0
Query 230: 0.4476 At 10 docs: 0.1952 0.0 0.2 0.4 0.6 0.8 1.0
Query 231: 0.0526 At 15 docs: 0.1698
Query 232: 0.0444 At 20 docs: 0.1560 Recall
Query 233: 0.0009 At 30 docs: 0.1183
Query 235: 0.0000 At 100 docs: 0.0462
Query 236: 0.9167 At 200 docs: 0.0269 Run stockholmAmEnI
Query 237: 1.0000 At 500 docs: 0.0126 Comparison to median by topic
Query 238: 0.2448 At 1000 docs: 0.0071
Query 239: 0.0227 +1.0
Query 240: 0.8139 R-Precision (prec. after R
Query 241: 0.0178 (=num_rel) docs. retrieved):
Query 242: 0.2416 Exact: 0.3251
Query 245: 0.7519
Query 246: 1.0000
Query 247: 1.0000 +0.5
Query 248: 0.6389
Query 249: 0.0093
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Amsterdam, Bilingual Amharic to English, Auto, TD Run UAmsC04AmEn4GiSb
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 42 queries): 1.0
Query 201: 0.1987 Total number of documents
Query 202: 0.2073 over all queries
Query 204: 0.2661 Retrieved: 42000
Query 205: 0.3307 Relevant: 375
Query 206: 0.2241 Rel_ret: 330
0.8
Query 207: 0.1144
Query 208: 0.0486 Interpolated Recall -
Query 209: 0.0493 Precision Averages:
Query 210: 0.0526 at 0.00 0.4877
Query 211: 1.0000 at 0.10 0.4536 0.6
Query 212: 0.0150 at 0.20 0.4286
Query 213: 0.0533 at 0.30 0.3670
Query 214: 0.0276 at 0.40 0.3453
Precision
Query 215: 0.0333 at 0.50 0.3308
Query 216: 0.0133 at 0.60 0.3126 0.4
Query 217: 0.0173 at 0.70 0.2687
Query 218: 0.7852 at 0.80 0.2519
Query 219: 0.0000 at 0.90 0.2320
Query 221: 1.0000 at 1.00 0.2097
Query 222: 0.4259 0.2
Query 223: 0.2190 Avg. prec. (non-interpolated)
Query 224: 0.7951 for all rel. documents
Query 226: 0.0036 0.3207
Query 228: 0.0000 Precision:
Query 229: 0.8333 At 5 docs: 0.2905 0.0
Query 230: 0.8242 At 10 docs: 0.2310 0.0 0.2 0.4 0.6 0.8 1.0
Query 231: 0.5000 At 15 docs: 0.1841
Query 232: 0.3983 At 20 docs: 0.1571 Recall
Query 233: 0.3483 At 30 docs: 0.1167
Query 235: 0.6111 At 100 docs: 0.0514
Query 236: 0.0857 At 200 docs: 0.0312 Run UAmsC04AmEn4GiSb
Query 237: 1.0000 At 500 docs: 0.0147 Comparison to median by topic
Query 238: 0.1063 At 1000 docs: 0.0079
Query 239: 0.0253 +1.0
Query 240: 0.8734 R-Precision (prec. after R
Query 241: 0.0111 (=num_rel) docs. retrieved):
Query 242: 0.0183 Exact: 0.2863
Query 245: 0.6161
Query 246: 0.5000
Query 247: 0.4951 +0.5
Query 248: 0.3048
Query 249: 0.0380
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Amsterdam, Bilingual Amharic to English, Auto, TD Run UAmsC04AmEnAll
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 42 queries): 1.0
Query 201: 0.4261 Total number of documents
Query 202: 0.1153 over all queries
Query 204: 0.2789 Retrieved: 42000
Query 205: 0.4871 Relevant: 375
Query 206: 0.2106 Rel_ret: 345
0.8
Query 207: 0.2126
Query 208: 0.5833 Interpolated Recall -
Query 209: 0.0304 Precision Averages:
Query 210: 0.0769 at 0.00 0.5017
Query 211: 1.0000 at 0.10 0.4618 0.6
Query 212: 0.0102 at 0.20 0.4456
Query 213: 0.0200 at 0.30 0.3888
Query 214: 0.0230 at 0.40 0.3626
Precision
Query 215: 0.2500 at 0.50 0.3432
Query 216: 0.0142 at 0.60 0.3382 0.4
Query 217: 0.0101 at 0.70 0.3022
Query 218: 0.9421 at 0.80 0.2921
Query 219: 0.0000 at 0.90 0.2756
Query 221: 1.0000 at 1.00 0.2622
Query 222: 0.5900 0.2
Query 223: 0.2153 Avg. prec. (non-interpolated)
Query 224: 0.8028 for all rel. documents
Query 226: 0.0027 0.3470
Query 228: 0.0000 Precision:
Query 229: 1.0000 At 5 docs: 0.2905 0.0
Query 230: 0.8254 At 10 docs: 0.2167 0.0 0.2 0.4 0.6 0.8 1.0
Query 231: 1.0000 At 15 docs: 0.1794
Query 232: 0.3580 At 20 docs: 0.1476 Recall
Query 233: 0.0973 At 30 docs: 0.1111
Query 235: 0.1800 At 100 docs: 0.0483
Query 236: 0.1514 At 200 docs: 0.0304 Run UAmsC04AmEnAll
Query 237: 1.0000 At 500 docs: 0.0152 Comparison to median by topic
Query 238: 0.0618 At 1000 docs: 0.0082
Query 239: 0.0237 +1.0
Query 240: 0.9306 R-Precision (prec. after R
Query 241: 0.0169 (=num_rel) docs. retrieved):
Query 242: 0.0168 Exact: 0.3253
Query 245: 0.7464
Query 246: 0.0714
Query 247: 0.5000 +0.5
Query 248: 0.2106
Query 249: 0.0802
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Amsterdam, Bilingual Amharic to English, Auto, TD Run UAmsC04AmEnWrd
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 42 queries): 1.0
Query 201: 0.4407 Total number of documents
Query 202: 0.0064 over all queries
Query 204: 0.0257 Retrieved: 42000
Query 205: 0.0796 Relevant: 375
Query 206: 0.0159 Rel_ret: 187
0.8
Query 207: 0.0400
Query 208: 0.0625 Interpolated Recall -
Query 209: 0.0000 Precision Averages:
Query 210: 0.1111 at 0.00 0.3016
Query 211: 1.0000 at 0.10 0.2849 0.6
Query 212: 0.0009 at 0.20 0.2663
Query 213: 0.0003 at 0.30 0.2476
Query 214: 0.0138 at 0.40 0.2158
Precision
Query 215: 0.3333 at 0.50 0.2101
Query 216: 0.0000 at 0.60 0.1907 0.4
Query 217: 0.0012 at 0.70 0.1779
Query 218: 0.0250 at 0.80 0.1709
Query 219: 0.0000 at 0.90 0.1512
Query 221: 1.0000 at 1.00 0.1385
Query 222: 0.4167 0.2
Query 223: 0.1595 Avg. prec. (non-interpolated)
Query 224: 0.7805 for all rel. documents
Query 226: 0.0003 0.2071
Query 228: 0.0000 Precision:
Query 229: 0.8333 At 5 docs: 0.1905 0.0
Query 230: 0.8909 At 10 docs: 0.1405 0.0 0.2 0.4 0.6 0.8 1.0
Query 231: 0.1429 At 15 docs: 0.1127
Query 232: 0.5135 At 20 docs: 0.0976 Recall
Query 233: 0.0012 At 30 docs: 0.0738
Query 235: 0.0003 At 100 docs: 0.0307
Query 236: 0.1111 At 200 docs: 0.0171 Run UAmsC04AmEnWrd
Query 237: 0.3333 At 500 docs: 0.0080 Comparison to median by topic
Query 238: 0.0001 At 1000 docs: 0.0045
Query 239: 0.0154 +1.0
Query 240: 0.8972 R-Precision (prec. after R
Query 241: 0.0238 (=num_rel) docs. retrieved):
Query 242: 0.0000 Exact: 0.1876
Query 245: 0.0000
Query 246: 0.0000
Query 247: 0.3992 +0.5
Query 248: 0.0100
Query 249: 0.0103
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Oviedo, Bilingual Spanish to English, Auto, TD Run uoviESEN
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 42 queries): 1.0
Query 201: 0.0001 Total number of documents
Query 202: 0.1477 over all queries
Query 204: 0.0047 Retrieved: 42000
Query 205: 0.1246 Relevant: 375
Query 206: 0.0054 Rel_ret: 145
0.8
Query 207: 0.0008
Query 208: 0.4167 Interpolated Recall -
Query 209: 0.0247 Precision Averages:
Query 210: 0.0000 at 0.00 0.1868
Query 211: 0.1247 at 0.10 0.1314 0.6
Query 212: 0.0000 at 0.20 0.1166
Query 213: 0.0295 at 0.30 0.0818
Query 214: 0.0000 at 0.40 0.0770
Precision
Query 215: 0.0000 at 0.50 0.0676
Query 216: 0.0000 at 0.60 0.0495 0.4
Query 217: 0.0016 at 0.70 0.0219
Query 218: 0.3360 at 0.80 0.0177
Query 219: 0.0068 at 0.90 0.0150
Query 221: 0.0100 at 1.00 0.0150
Query 222: 0.0008 0.2
Query 223: 0.1006 Avg. prec. (non-interpolated)
Query 224: 0.1375 for all rel. documents
Query 226: 0.0000 0.0644
Query 228: 0.0054 Precision:
Query 229: 0.0000 At 5 docs: 0.0810 0.0
Query 230: 0.1076 At 10 docs: 0.0619 0.0 0.2 0.4 0.6 0.8 1.0
Query 231: 0.0172 At 15 docs: 0.0524
Query 232: 0.0017 At 20 docs: 0.0464 Recall
Query 233: 0.0053 At 30 docs: 0.0381
Query 235: 0.0000 At 100 docs: 0.0162
Query 236: 0.0000 At 200 docs: 0.0108 Run uoviESEN
Query 237: 0.0526 At 500 docs: 0.0057 Comparison to median by topic
Query 238: 0.1041 At 1000 docs: 0.0035
Query 239: 0.0546 +1.0
Query 240: 0.0083 R-Precision (prec. after R
Query 241: 0.0000 (=num_rel) docs. retrieved):
Query 242: 0.0357 Exact: 0.0816
Query 245: 0.1154
Query 246: 0.0095
Query 247: 0.0000 +0.5
Query 248: 0.7167
Query 249: 0.0000
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
JHU/APL, Bilingual German to French, Auto, TD Run aplbidefra
Average precision Overall statistics
(individual queries): (for 49 queries):
Recall−Precision Values
1.0
Query 201: 0.1463 Total number of documents
Query 202: 0.5612 over all queries
Query 203: 0.4642 Retrieved: 49000
Query 204: 0.7273 Relevant: 915
Query 205: 0.0495 Rel_ret: 770 0.8
Query 206: 0.4100
Query 207: 0.2295 Interpolated Recall -
Query 208: 0.0008 Precision Averages:
Query 209: 0.2049 at 0.00 0.4891
Query 210: 0.1036 at 0.10 0.4583 0.6
Query 211: 0.8121 at 0.20 0.4207
Query 212: 0.4823 at 0.30 0.3911
Query 213: 0.5456 at 0.40 0.3625
Precision
Query 214: 0.1845 at 0.50 0.3280
Query 215: 0.2557 at 0.60 0.3114 0.4
Query 216: 0.0140 at 0.70 0.2678
Query 217: 0.2561 at 0.80 0.2207
Query 218: 0.8703 at 0.90 0.1619
Query 219: 0.5500 at 1.00 0.1001
Query 220: 0.0047 0.2
Query 221: 0.7367 Avg. prec. (non-interpolated)
Query 222: 0.0282 for all rel. documents
Query 223: 0.0431 0.3030
Query 224: 0.0995 Precision:
Query 225: 0.0035 At 5 docs: 0.3388 0.0
Query 226: 0.0233 At 10 docs: 0.3122 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.0128 At 15 docs: 0.2966
Query 229: 0.5132 At 20 docs: 0.2704 Recall
Query 230: 0.7587 At 30 docs: 0.2476
Query 231: 0.1795 At 100 docs: 0.1220
Query 232: 0.0000 At 200 docs: 0.0700 Run aplbidefra
Query 233: 0.5688 At 500 docs: 0.0305
Query 234: 0.0704 At 1000 docs: 0.0157 Comparison to median by topic
Query 235: 0.4903 +1.0
Query 236: 0.5473 R-Precision (prec. after R
Query 237: 0.7984 (=num_rel) docs. retrieved):
Query 238: 0.3682 Exact: 0.2906
Query 239: 0.0022
Query 240: 0.0476
Query 241: 0.0001 +0.5
Query 242: 0.1724
Query 243: 0.4158
Query 244: 0.0043
Query 245: 0.7643
Query 246: 0.0264
Query 247: 0.4102
Query 248: 0.7183 0.0
Query 249: 0.0526
Query 250: 0.1166
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
JHU/APL, Bilingual Dutch to French, Auto, TD Run aplbinlfra
Average precision Overall statistics
(individual queries): (for 49 queries):
Recall−Precision Values
1.0
Query 201: 0.1987 Total number of documents
Query 202: 0.5772 over all queries
Query 203: 0.4565 Retrieved: 49000
Query 204: 0.8333 Relevant: 915
Query 205: 0.0511 Rel_ret: 845 0.8
Query 206: 0.3367
Query 207: 0.0838 Interpolated Recall -
Query 208: 0.8042 Precision Averages:
Query 209: 0.2325 at 0.00 0.5921
Query 210: 0.1738 at 0.10 0.5673 0.6
Query 211: 0.7898 at 0.20 0.5375
Query 212: 0.5795 at 0.30 0.4633
Query 213: 0.3344 at 0.40 0.4105
Precision
Query 214: 0.1355 at 0.50 0.3863
Query 215: 0.0488 at 0.60 0.3715 0.4
Query 216: 0.4308 at 0.70 0.3174
Query 217: 0.5191 at 0.80 0.2814
Query 218: 0.8829 at 0.90 0.2305
Query 219: 0.5206 at 1.00 0.1732
Query 220: 0.0065 0.2
Query 221: 0.7381 Avg. prec. (non-interpolated)
Query 222: 0.0186 for all rel. documents
Query 223: 0.0221 0.3753
Query 224: 0.6631 Precision:
Query 225: 0.0286 At 5 docs: 0.3837 0.0
Query 226: 0.0021 At 10 docs: 0.3143 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.1203 At 15 docs: 0.2871
Query 229: 0.0265 At 20 docs: 0.2724 Recall
Query 230: 0.6264 At 30 docs: 0.2463
Query 231: 0.1877 At 100 docs: 0.1255
Query 232: 0.2690 At 200 docs: 0.0748 Run aplbinlfra
Query 233: 0.6486 At 500 docs: 0.0332
Query 234: 0.5161 At 1000 docs: 0.0172 Comparison to median by topic
Query 235: 0.2773 +1.0
Query 236: 0.2970 R-Precision (prec. after R
Query 237: 0.7724 (=num_rel) docs. retrieved):
Query 238: 0.4661 Exact: 0.3769
Query 239: 0.0409
Query 240: 1.0000
Query 241: 0.0001 +0.5
Query 242: 0.1409
Query 243: 0.1212
Query 244: 1.0000
Query 245: 0.7900
Query 246: 0.1820
Query 247: 0.6782
Query 248: 0.6250 0.0
Query 249: 0.0455
Query 250: 0.0891
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Daedalus, Bilingual German to French, Auto, TD Run de2frcomb1s101
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 49 queries): 1.0
Query 201: 0.0054 Total number of documents
Query 202: 0.6255 over all queries
Query 203: 0.5256 Retrieved: 49000
Query 204: 0.5360 Relevant: 915
Query 205: 0.5160 Rel_ret: 749
0.8
Query 206: 0.4842
Query 207: 0.3473 Interpolated Recall -
Query 208: 0.7333 Precision Averages:
Query 209: 0.0150 at 0.00 0.5381
Query 210: 0.0754 at 0.10 0.4855 0.6
Query 211: 0.6640 at 0.20 0.4351
Query 212: 0.2042 at 0.30 0.4013
Query 213: 0.8145 at 0.40 0.3583
Precision
Query 214: 0.1020 at 0.50 0.3310
Query 215: 0.0715 at 0.60 0.2965 0.4
Query 216: 0.0072 at 0.70 0.2647
Query 217: 0.3516 at 0.80 0.2190
Query 218: 0.8768 at 0.90 0.1806
Query 219: 0.0101 at 1.00 0.1241
Query 220: 0.2317 0.2
Query 221: 0.3978 Avg. prec. (non-interpolated)
Query 222: 0.0060 for all rel. documents
Query 223: 0.0213 0.3166
Query 224: 0.7663 Precision:
Query 225: 0.0135 At 5 docs: 0.3347 0.0
Query 226: 0.0385 At 10 docs: 0.2959 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.0552 At 15 docs: 0.2667
Query 229: 0.5019 At 20 docs: 0.2500 Recall
Query 230: 0.0265 At 30 docs: 0.2156
Query 231: 0.2791 At 100 docs: 0.1051
Query 232: 0.0178 At 200 docs: 0.0621 Run de2frcomb1s101
Query 233: 0.4790 At 500 docs: 0.0288 Comparison to median by topic
Query 234: 0.3502 At 1000 docs: 0.0153
Query 235: 0.0000 +1.0
Query 236: 0.5736 R-Precision (prec. after R
Query 237: 0.8819 (=num_rel) docs. retrieved):
Query 238: 0.4226 Exact: 0.3013
Query 239: 0.0465
Query 240: 1.0000
Query 241: 0.0030 +0.5
Query 242: 0.3691
Query 243: 0.6333
Query 244: 0.0012
Query 245: 0.9167
Query 246: 0.1483
Query 247: 0.1301
Query 248: 0.2087
0.0
Query 249: 0.0294
Query 250: 0.0000
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Daedalus, Bilingual German to French, Auto, TD Run de2frcomb2s201
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 49 queries): 1.0
Query 201: 0.0092 Total number of documents
Query 202: 0.6184 over all queries
Query 203: 0.4833 Retrieved: 49000
Query 204: 0.5778 Relevant: 915
Query 205: 0.5075 Rel_ret: 759
0.8
Query 206: 0.4524
Query 207: 0.3144 Interpolated Recall -
Query 208: 0.6917 Precision Averages:
Query 209: 0.0099 at 0.00 0.5265
Query 210: 0.0944 at 0.10 0.4736 0.6
Query 211: 0.6661 at 0.20 0.4360
Query 212: 0.1219 at 0.30 0.4007
Query 213: 0.8043 at 0.40 0.3551
Precision
Query 214: 0.0715 at 0.50 0.3287
Query 215: 0.0717 at 0.60 0.2924 0.4
Query 216: 0.0146 at 0.70 0.2606
Query 217: 0.2948 at 0.80 0.2144
Query 218: 0.8792 at 0.90 0.1773
Query 219: 0.0136 at 1.00 0.1265
Query 220: 0.2630 0.2
Query 221: 0.4060 Avg. prec. (non-interpolated)
Query 222: 0.0096 for all rel. documents
Query 223: 0.0270 0.3116
Query 224: 0.6931 Precision:
Query 225: 0.0127 At 5 docs: 0.3388 0.0
Query 226: 0.0204 At 10 docs: 0.2939 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.0617 At 15 docs: 0.2680
Query 229: 0.4741 At 20 docs: 0.2500 Recall
Query 230: 0.0708 At 30 docs: 0.2129
Query 231: 0.2812 At 100 docs: 0.1108
Query 232: 0.0413 At 200 docs: 0.0651 Run de2frcomb2s201
Query 233: 0.4917 At 500 docs: 0.0290 Comparison to median by topic
Query 234: 0.3362 At 1000 docs: 0.0155
Query 235: 0.0002 +1.0
Query 236: 0.5586 R-Precision (prec. after R
Query 237: 0.8893 (=num_rel) docs. retrieved):
Query 238: 0.3975 Exact: 0.3051
Query 239: 0.0659
Query 240: 1.0000
Query 241: 0.0006 +0.5
Query 242: 0.3635
Query 243: 0.6105
Query 244: 0.0000
Query 245: 0.9167
Query 246: 0.1635
Query 247: 0.0937
Query 248: 0.2938
0.0
Query 249: 0.0286
Query 250: 0.0001
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Daedalus, Bilingual German to French, Auto, TD Run de2frR2FWnormal
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 49 queries): 1.0
Query 201: 0.0093 Total number of documents
Query 202: 0.6290 over all queries
Query 203: 0.5995 Retrieved: 49000
Query 204: 0.5510 Relevant: 915
Query 205: 0.5019 Rel_ret: 732
0.8
Query 206: 0.4780
Query 207: 0.3512 Interpolated Recall -
Query 208: 0.7708 Precision Averages:
Query 209: 0.0144 at 0.00 0.5485
Query 210: 0.1023 at 0.10 0.4988 0.6
Query 211: 0.6696 at 0.20 0.4469
Query 212: 0.1722 at 0.30 0.4067
Query 213: 0.8148 at 0.40 0.3608
Precision
Query 214: 0.1030 at 0.50 0.3360
Query 215: 0.0714 at 0.60 0.3028 0.4
Query 216: 0.0114 at 0.70 0.2640
Query 217: 0.3329 at 0.80 0.2185
Query 218: 0.8768 at 0.90 0.1825
Query 219: 0.0190 at 1.00 0.1263
Query 220: 0.3041 0.2
Query 221: 0.3876 Avg. prec. (non-interpolated)
Query 222: 0.0079 for all rel. documents
Query 223: 0.0226 0.3201
Query 224: 0.7663 Precision:
Query 225: 0.0137 At 5 docs: 0.3429 0.0
Query 226: 0.0370 At 10 docs: 0.2918 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.0574 At 15 docs: 0.2789
Query 229: 0.4643 At 20 docs: 0.2541 Recall
Query 230: 0.0423 At 30 docs: 0.2170
Query 231: 0.1560 At 100 docs: 0.1073
Query 232: 0.0012 At 200 docs: 0.0629 Run de2frR2FWnormal
Query 233: 0.4779 At 500 docs: 0.0281 Comparison to median by topic
Query 234: 0.3344 At 1000 docs: 0.0149
Query 235: 0.0000 +1.0
Query 236: 0.4839 R-Precision (prec. after R
Query 237: 0.8819 (=num_rel) docs. retrieved):
Query 238: 0.4226 Exact: 0.3059
Query 239: 0.0423
Query 240: 1.0000
Query 241: 0.0051 +0.5
Query 242: 0.4854
Query 243: 0.6277
Query 244: 0.0000
Query 245: 0.9167
Query 246: 0.1253
Query 247: 0.2597
Query 248: 0.2552
0.0
Query 249: 0.0270
Query 250: 0.0000
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Daedalus, Bilingual German to French, Auto, TD Run de2frR3FWnormal
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 49 queries): 1.0
Query 201: 0.0054 Total number of documents
Query 202: 0.6255 over all queries
Query 203: 0.5256 Retrieved: 49000
Query 204: 0.5360 Relevant: 915
Query 205: 0.5160 Rel_ret: 749
0.8
Query 206: 0.4842
Query 207: 0.3116 Interpolated Recall -
Query 208: 0.7333 Precision Averages:
Query 209: 0.0150 at 0.00 0.5340
Query 210: 0.0754 at 0.10 0.4957 0.6
Query 211: 0.6640 at 0.20 0.4419
Query 212: 0.2042 at 0.30 0.4081
Query 213: 0.8145 at 0.40 0.3651
Precision
Query 214: 0.1020 at 0.50 0.3378
Query 215: 0.0715 at 0.60 0.2965 0.4
Query 216: 0.0072 at 0.70 0.2647
Query 217: 0.3738 at 0.80 0.2190
Query 218: 0.8768 at 0.90 0.1806
Query 219: 0.0101 at 1.00 0.1241
Query 220: 0.2317 0.2
Query 221: 0.3978 Avg. prec. (non-interpolated)
Query 222: 0.0060 for all rel. documents
Query 223: 0.0213 0.3199
Query 224: 0.7663 Precision:
Query 225: 0.0135 At 5 docs: 0.3347 0.0
Query 226: 0.0385 At 10 docs: 0.2959 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.0552 At 15 docs: 0.2667
Query 229: 0.4662 At 20 docs: 0.2500 Recall
Query 230: 0.0265 At 30 docs: 0.2156
Query 231: 0.2791 At 100 docs: 0.1051
Query 232: 0.0178 At 200 docs: 0.0621 Run de2frR3FWnormal
Query 233: 0.4790 At 500 docs: 0.0288 Comparison to median by topic
Query 234: 0.3502 At 1000 docs: 0.0153
Query 235: 0.0000 +1.0
Query 236: 0.5736 R-Precision (prec. after R
Query 237: 0.8819 (=num_rel) docs. retrieved):
Query 238: 0.4226 Exact: 0.3013
Query 239: 0.0465
Query 240: 1.0000
Query 241: 0.0030 +0.5
Query 242: 0.5775
Query 243: 0.6333
Query 244: 0.0012
Query 245: 0.9167
Query 246: 0.1483
Query 247: 0.1301
Query 248: 0.2087
0.0
Query 249: 0.0294
Query 250: 0.0000
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Dublin City University, Bilingual German to French, Auto, TD Run exefrde04a
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 49 queries): 1.0
Query 201: 0.0006 Total number of documents
Query 202: 0.7088 over all queries
Query 203: 0.0054 Retrieved: 49000
Query 204: 0.7151 Relevant: 915
Query 205: 0.1464 Rel_ret: 704
0.8
Query 206: 0.4734
Query 207: 0.2345 Interpolated Recall -
Query 208: 0.8042 Precision Averages:
Query 209: 0.0000 at 0.00 0.4662
Query 210: 0.0082 at 0.10 0.4393 0.6
Query 211: 0.8649 at 0.20 0.4154
Query 212: 0.0904 at 0.30 0.3623
Query 213: 0.7347 at 0.40 0.3303
Precision
Query 214: 0.0896 at 0.50 0.3150
Query 215: 0.0435 at 0.60 0.2921 0.4
Query 216: 0.0065 at 0.70 0.2585
Query 217: 0.4321 at 0.80 0.2216
Query 218: 0.9062 at 0.90 0.1772
Query 219: 0.0114 at 1.00 0.1221
Query 220: 0.0697 0.2
Query 221: 0.5591 Avg. prec. (non-interpolated)
Query 222: 0.0008 for all rel. documents
Query 223: 0.0267 0.2990
Query 224: 0.8722 Precision:
Query 225: 0.0000 At 5 docs: 0.3265 0.0
Query 226: 0.0270 At 10 docs: 0.2653 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.0115 At 15 docs: 0.2503
Query 229: 0.5147 At 20 docs: 0.2347 Recall
Query 230: 0.0184 At 30 docs: 0.1980
Query 231: 0.0343 At 100 docs: 0.0998
Query 232: 0.0048 At 200 docs: 0.0590 Run exefrde04a
Query 233: 0.5572 At 500 docs: 0.0267 Comparison to median by topic
Query 234: 0.3435 At 1000 docs: 0.0144
Query 235: 0.0002 +1.0
Query 236: 0.3718 R-Precision (prec. after R
Query 237: 0.8118 (=num_rel) docs. retrieved):
Query 238: 0.3510 Exact: 0.2830
Query 239: 0.0298
Query 240: 1.0000
Query 241: 0.0000 +0.5
Query 242: 0.2958
Query 243: 0.5241
Query 244: 0.0000
Query 245: 0.8750
Query 246: 0.2143
Query 247: 0.1779
Query 248: 0.5394
0.0
Query 249: 0.1429
Query 250: 0.0000
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Dublin City University, Bilingual German to French, Auto, TD Run exefrde04q
Average precision Overall statistics
(individual queries): (for 49 queries): Recall−Precision Values
1.0
Query 201: 0.0006 Total number of documents
Query 202: 0.7020 over all queries
Query 203: 0.0127 Retrieved: 49000
Query 204: 0.7254 Relevant: 915
Query 205: 0.1552 Rel_ret: 713 0.8
Query 206: 0.4646
Query 207: 0.2422 Interpolated Recall -
Query 208: 0.8042 Precision Averages:
Query 209: 0.0000 at 0.00 0.4483
Query 210: 0.0127 at 0.10 0.4250 0.6
Query 211: 0.8731 at 0.20 0.4002
Query 212: 0.0986 at 0.30 0.3726
Query 213: 0.7486 at 0.40 0.3333
Precision
Query 214: 0.0024 at 0.50 0.3183
Query 215: 0.0415 at 0.60 0.2930 0.4
Query 216: 0.0095 at 0.70 0.2662
Query 217: 0.4083 at 0.80 0.2275
Query 218: 0.9023 at 0.90 0.1707
Query 219: 0.0115 at 1.00 0.1180
Query 220: 0.0761 0.2
Query 221: 0.5392 Avg. prec. (non-interpolated)
Query 222: 0.0007 for all rel. documents
Query 223: 0.0286 0.2963
Query 224: 0.8722 Precision:
Query 225: 0.0000 At 5 docs: 0.3102 0.0
Query 226: 0.0179 At 10 docs: 0.2653 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.0123 At 15 docs: 0.2408
Query 229: 0.5234 At 20 docs: 0.2224 Recall
Query 230: 0.0536 At 30 docs: 0.1918
Query 231: 0.0083 At 100 docs: 0.0990
Query 232: 0.0113 At 200 docs: 0.0593 Run exefrde04q
Query 233: 0.5615 At 500 docs: 0.0270
Query 234: 0.3486 At 1000 docs: 0.0146 Comparison to median by topic
Query 235: 0.0000 +1.0
Query 236: 0.4658 R-Precision (prec. after R
Query 237: 0.8113 (=num_rel) docs. retrieved):
Query 238: 0.3318 Exact: 0.2771
Query 239: 0.0114
Query 240: 1.0000
Query 241: 0.0000 +0.5
Query 242: 0.3080
Query 243: 0.5347
Query 244: 0.0000
Query 245: 0.8750
Query 246: 0.2144
Query 247: 0.0183
Query 248: 0.5368 0.0
Query 249: 0.1429
Query 250: 0.0000
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Dublin City University, Bilingual German to French, Auto, TD Run exefrde04t
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 49 queries): 1.0
Query 201: 0.0018 Total number of documents
Query 202: 0.7314 over all queries
Query 203: 0.0090 Retrieved: 49000
Query 204: 0.7277 Relevant: 915
Query 205: 0.2294 Rel_ret: 727
0.8
Query 206: 0.4973
Query 207: 0.2478 Interpolated Recall -
Query 208: 0.7095 Precision Averages:
Query 209: 0.0000 at 0.00 0.4579
Query 210: 0.0082 at 0.10 0.4251 0.6
Query 211: 0.8532 at 0.20 0.4054
Query 212: 0.0875 at 0.30 0.3637
Query 213: 0.7372 at 0.40 0.3317
Precision
Query 214: 0.0029 at 0.50 0.3076
Query 215: 0.0399 at 0.60 0.2841 0.4
Query 216: 0.0095 at 0.70 0.2581
Query 217: 0.4007 at 0.80 0.2151
Query 218: 0.9039 at 0.90 0.1694
Query 219: 0.0108 at 1.00 0.1169
Query 220: 0.0687 0.2
Query 221: 0.5576 Avg. prec. (non-interpolated)
Query 222: 0.0008 for all rel. documents
Query 223: 0.0221 0.2945
Query 224: 0.8889 Precision:
Query 225: 0.0000 At 5 docs: 0.3184 0.0
Query 226: 0.0222 At 10 docs: 0.2633 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.0128 At 15 docs: 0.2408
Query 229: 0.5016 At 20 docs: 0.2194 Recall
Query 230: 0.0565 At 30 docs: 0.1946
Query 231: 0.0374 At 100 docs: 0.0978
Query 232: 0.0210 At 200 docs: 0.0598 Run exefrde04t
Query 233: 0.5308 At 500 docs: 0.0276 Comparison to median by topic
Query 234: 0.3506 At 1000 docs: 0.0148
Query 235: 0.0003 +1.0
Query 236: 0.4322 R-Precision (prec. after R
Query 237: 0.8152 (=num_rel) docs. retrieved):
Query 238: 0.3390 Exact: 0.2644
Query 239: 0.0117
Query 240: 1.0000
Query 241: 0.0000 +0.5
Query 242: 0.2958
Query 243: 0.5262
Query 244: 0.0000
Query 245: 0.8333
Query 246: 0.2176
Query 247: 0.0185
Query 248: 0.4618
0.0
Query 249: 0.2000
Query 250: 0.0000
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Dublin City University, Bilingual Dutch to French, Auto, TD Run exefrnl04a
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 49 queries): 1.0
Query 201: 0.0733 Total number of documents
Query 202: 0.6593 over all queries
Query 203: 0.1670 Retrieved: 49000
Query 204: 0.7869 Relevant: 915
Query 205: 0.2040 Rel_ret: 770
0.8
Query 206: 0.3803
Query 207: 0.3024 Interpolated Recall -
Query 208: 0.5711 Precision Averages:
Query 209: 0.0010 at 0.00 0.5215
Query 210: 0.0007 at 0.10 0.4669 0.6
Query 211: 0.8848 at 0.20 0.4566
Query 212: 0.0650 at 0.30 0.3877
Query 213: 0.6340 at 0.40 0.3593
Precision
Query 214: 0.0002 at 0.50 0.3385
Query 215: 0.0423 at 0.60 0.3225 0.4
Query 216: 0.0105 at 0.70 0.3025
Query 217: 0.5562 at 0.80 0.2627
Query 218: 0.9194 at 0.90 0.2020
Query 219: 0.0209 at 1.00 0.1454
Query 220: 0.0033 0.2
Query 221: 0.4847 Avg. prec. (non-interpolated)
Query 222: 0.0011 for all rel. documents
Query 223: 0.0044 0.3339
Query 224: 0.9242 Precision:
Query 225: 0.0037 At 5 docs: 0.3469 0.0
Query 226: 0.0015 At 10 docs: 0.2959 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.4328 At 15 docs: 0.2680
Query 229: 0.5281 At 20 docs: 0.2510 Recall
Query 230: 0.8472 At 30 docs: 0.2156
Query 231: 0.5092 At 100 docs: 0.1133
Query 232: 0.0196 At 200 docs: 0.0653 Run exefrnl04a
Query 233: 0.4759 At 500 docs: 0.0293 Comparison to median by topic
Query 234: 0.0248 At 1000 docs: 0.0157
Query 235: 0.9333 +1.0
Query 236: 0.1803 R-Precision (prec. after R
Query 237: 0.7809 (=num_rel) docs. retrieved):
Query 238: 0.3708 Exact: 0.2977
Query 239: 0.0045
Query 240: 1.0000
Query 241: 0.0001 +0.5
Query 242: 0.0989
Query 243: 0.5262
Query 244: 0.0026
Query 245: 1.0000
Query 246: 0.0886
Query 247: 0.0111
Query 248: 0.7904
0.0
Query 249: 0.0333
Query 250: 0.0002
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Dublin City University, Bilingual Dutch to French, Auto, TD Run exefrnl04t
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 49 queries): 1.0
Query 201: 0.0426 Total number of documents
Query 202: 0.6871 over all queries
Query 203: 0.1700 Retrieved: 49000
Query 204: 0.7784 Relevant: 915
Query 205: 0.2222 Rel_ret: 777
0.8
Query 206: 0.3832
Query 207: 0.3315 Interpolated Recall -
Query 208: 0.6875 Precision Averages:
Query 209: 0.0016 at 0.00 0.5097
Query 210: 0.0008 at 0.10 0.4603 0.6
Query 211: 0.8806 at 0.20 0.4475
Query 212: 0.0876 at 0.30 0.3772
Query 213: 0.5820 at 0.40 0.3577
Precision
Query 214: 0.0001 at 0.50 0.3428
Query 215: 0.0385 at 0.60 0.3269 0.4
Query 216: 0.0106 at 0.70 0.3007
Query 217: 0.5053 at 0.80 0.2545
Query 218: 0.9118 at 0.90 0.2033
Query 219: 0.0210 at 1.00 0.1457
Query 220: 0.0037 0.2
Query 221: 0.4921 Avg. prec. (non-interpolated)
Query 222: 0.0016 for all rel. documents
Query 223: 0.0049 0.3312
Query 224: 0.9444 Precision:
Query 225: 0.0041 At 5 docs: 0.3388 0.0
Query 226: 0.0017 At 10 docs: 0.2857 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.3997 At 15 docs: 0.2667
Query 229: 0.5325 At 20 docs: 0.2449 Recall
Query 230: 0.8645 At 30 docs: 0.2136
Query 231: 0.4863 At 100 docs: 0.1114
Query 232: 0.0229 At 200 docs: 0.0641 Run exefrnl04t
Query 233: 0.2974 At 500 docs: 0.0293 Comparison to median by topic
Query 234: 0.0260 At 1000 docs: 0.0159
Query 235: 0.9056 +1.0
Query 236: 0.1333 R-Precision (prec. after R
Query 237: 0.7895 (=num_rel) docs. retrieved):
Query 238: 0.5190 Exact: 0.2992
Query 239: 0.0050
Query 240: 1.0000
Query 241: 0.0001 +0.5
Query 242: 0.0919
Query 243: 0.5301
Query 244: 0.0026
Query 245: 0.9167
Query 246: 0.0639
Query 247: 0.0105
Query 248: 0.8058
0.0
Query 249: 0.0286
Query 250: 0.0002
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Padua, Bilingual German to French, Auto, TD Run IMSBDEFRN100
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 49 queries): 1.0
Query 201: 0.0002 Total number of documents
Query 202: 0.4183 over all queries
Query 203: 0.1655 Retrieved: 45423
Query 204: 0.0007 Relevant: 915 0.8
Query 205: 0.0388 Rel_ret: 310
Query 206: 0.0005
Query 207: 0.0076 Interpolated Recall -
Query 208: 0.0018 Precision Averages:
Query 209: 0.0019 at 0.00 0.2594
Query 210: 0.0000 at 0.10 0.2482 0.6
Query 211: 0.0001 at 0.20 0.1970
Query 212: 0.0010 at 0.30 0.1618
Query 213: 0.0001 at 0.40 0.1546
Precision
Query 214: 0.0005 at 0.50 0.1436
Query 215: 0.3109 at 0.60 0.1350 0.4
Query 216: 0.0000 at 0.70 0.1125
Query 217: 0.0000 at 0.80 0.0893
Query 218: 0.7862 at 0.90 0.0491
Query 219: 0.0000 at 1.00 0.0302
Query 220: 0.0000 0.2
Query 221: 0.1467 Avg. prec. (non-interpolated)
Query 222: 0.0008 for all rel. documents
Query 223: 0.0000 0.1384
Query 224: 0.0844 Precision:
Query 225: 0.0000 At 5 docs: 0.1714 0.0
Query 226: 0.0019 At 10 docs: 0.1490 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.0009 At 15 docs: 0.1333
Query 229: 0.0044 At 20 docs: 0.1133 Recall
Query 230: 0.5918 At 30 docs: 0.0864
Query 231: 0.0678 At 100 docs: 0.0390
Query 232: 0.0000 At 200 docs: 0.0232 Run IMSBDEFRN100
Query 233: 0.1848 At 500 docs: 0.0114 Comparison to median by topic
Query 234: 0.0000 At 1000 docs: 0.0063
Query 235: 0.3396 +1.0
Query 236: 0.9573 R-Precision (prec. after R
Query 237: 0.8831 (=num_rel) docs. retrieved):
Query 238: 0.0456 Exact: 0.1378
Query 239: 0.0037
Query 240: 0.0000
Query 241: 0.0001 +0.5
Query 242: 0.0007
Query 243: 0.1191
Query 244: 0.0000
Query 245: 0.7562
Query 246: 0.0056
Query 247: 0.8542
0.0
Query 248: 0.0000
Query 249: 0.0000
Query 250: 0.0001
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Padua, Bilingual German to French, Auto, TD Run IMSBDEFRN50
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 49 queries): 1.0
Query 201: 0.0003 Total number of documents
Query 202: 0.3958 over all queries
Query 203: 0.1655 Retrieved: 46422
Query 204: 0.0007 Relevant: 915
Query 205: 0.0388 Rel_ret: 376
0.8
Query 206: 0.0000
Query 207: 0.0073 Interpolated Recall -
Query 208: 0.0018 Precision Averages:
Query 209: 0.0019 at 0.00 0.2749
Query 210: 0.0000 at 0.10 0.2364 0.6
Query 211: 0.0001 at 0.20 0.1892
Query 212: 0.0000 at 0.30 0.1669
Query 213: 0.1303 at 0.40 0.1603
Precision
Query 214: 0.0001 at 0.50 0.1434
Query 215: 0.2533 at 0.60 0.1349 0.4
Query 216: 0.0000 at 0.70 0.1037
Query 217: 0.0000 at 0.80 0.0745
Query 218: 0.7916 at 0.90 0.0470
Query 219: 0.0000 at 1.00 0.0278
Query 220: 0.0000 0.2
Query 221: 0.1471 Avg. prec. (non-interpolated)
Query 222: 0.0008 for all rel. documents
Query 223: 0.0000 0.1349
Query 224: 0.0288 Precision:
Query 225: 0.0000 At 5 docs: 0.1633 0.0
Query 226: 0.0019 At 10 docs: 0.1449 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.0009 At 15 docs: 0.1347
Query 229: 0.0044 At 20 docs: 0.1122 Recall
Query 230: 0.5812 At 30 docs: 0.0925
Query 231: 0.0864 At 100 docs: 0.0431
Query 232: 0.0000 At 200 docs: 0.0259 Run IMSBDEFRN50
Query 233: 0.1841 At 500 docs: 0.0140 Comparison to median by topic
Query 234: 0.0000 At 1000 docs: 0.0077
Query 235: 0.3396 +1.0
Query 236: 0.9573 R-Precision (prec. after R
Query 237: 0.7952 (=num_rel) docs. retrieved):
Query 238: 0.0456 Exact: 0.1374
Query 239: 0.0032
Query 240: 0.0000
Query 241: 0.0002 +0.5
Query 242: 0.0009
Query 243: 0.1194
Query 244: 0.0000
Query 245: 0.7583
Query 246: 0.0056
Query 247: 0.7584
Query 248: 0.0018
0.0
Query 249: 0.0000
Query 250: 0.0001
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Padua, Bilingual German to French, Auto, TD Run IMSBDEFRP100
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 49 queries): 1.0
Query 201: 0.0001 Total number of documents
Query 202: 0.5251 over all queries
Query 203: 0.2175 Retrieved: 46003
Query 204: 0.0005 Relevant: 915 0.8
Query 205: 0.0469 Rel_ret: 309
Query 206: 0.0017
Query 207: 0.0066 Interpolated Recall -
Query 208: 0.0016 Precision Averages:
Query 209: 0.0012 at 0.00 0.2564
Query 210: 0.0000 at 0.10 0.2387 0.6
Query 211: 0.0000 at 0.20 0.1905
Query 212: 0.0009 at 0.30 0.1766
Query 213: 0.0000 at 0.40 0.1551
Precision
Query 214: 0.0003 at 0.50 0.1431
Query 215: 0.3257 at 0.60 0.1264 0.4
Query 216: 0.0123 at 0.70 0.1182
Query 217: 0.0000 at 0.80 0.0940
Query 218: 0.6775 at 0.90 0.0718
Query 219: 0.0000 at 1.00 0.0317
Query 220: 0.0000 0.2
Query 221: 0.2373 Avg. prec. (non-interpolated)
Query 222: 0.0050 for all rel. documents
Query 223: 0.0000 0.1411
Query 224: 0.0340 Precision:
Query 225: 0.0000 At 5 docs: 0.1755 0.0
Query 226: 0.0000 At 10 docs: 0.1571 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.0012 At 15 docs: 0.1293
Query 229: 0.0028 At 20 docs: 0.1133 Recall
Query 230: 0.5088 At 30 docs: 0.0891
Query 231: 0.0519 At 100 docs: 0.0422
Query 232: 0.0000 At 200 docs: 0.0235 Run IMSBDEFRP100
Query 233: 0.1048 At 500 docs: 0.0104 Comparison to median by topic
Query 234: 0.0123 At 1000 docs: 0.0063
Query 235: 0.3038 +1.0
Query 236: 1.0000 R-Precision (prec. after R
Query 237: 0.9288 (=num_rel) docs. retrieved):
Query 238: 0.0387 Exact: 0.1437
Query 239: 0.0050
Query 240: 0.0000
Query 241: 0.0040 +0.5
Query 242: 0.0003
Query 243: 0.1688
Query 244: 0.0000
Query 245: 0.7786
Query 246: 0.0043
Query 247: 0.9043
0.0
Query 248: 0.0000
Query 249: 0.0000
Query 250: 0.0001
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Padua, Bilingual German to French, Auto, TD Run IMSBDEFRP50
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 49 queries): 1.0
Query 201: 0.0001 Total number of documents
Query 202: 0.5228 over all queries
Query 203: 0.2175 Retrieved: 47002
Query 204: 0.0005 Relevant: 915
Query 205: 0.0469 Rel_ret: 379
0.8
Query 206: 0.0008
Query 207: 0.0052 Interpolated Recall -
Query 208: 0.0016 Precision Averages:
Query 209: 0.0012 at 0.00 0.2669
Query 210: 0.0000 at 0.10 0.2429 0.6
Query 211: 0.0000 at 0.20 0.1900
Query 212: 0.0000 at 0.30 0.1775
Query 213: 0.1018 at 0.40 0.1613
Precision
Query 214: 0.0000 at 0.50 0.1473
Query 215: 0.3079 at 0.60 0.1281 0.4
Query 216: 0.0123 at 0.70 0.1119
Query 217: 0.0000 at 0.80 0.0878
Query 218: 0.6540 at 0.90 0.0538
Query 219: 0.0000 at 1.00 0.0266
Query 220: 0.0000 0.2
Query 221: 0.2376 Avg. prec. (non-interpolated)
Query 222: 0.0050 for all rel. documents
Query 223: 0.0000 0.1388
Query 224: 0.0185 Precision:
Query 225: 0.0000 At 5 docs: 0.1714 0.0
Query 226: 0.0000 At 10 docs: 0.1510 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.0012 At 15 docs: 0.1320
Query 229: 0.0028 At 20 docs: 0.1153 Recall
Query 230: 0.5022 At 30 docs: 0.0905
Query 231: 0.0643 At 100 docs: 0.0465
Query 232: 0.0000 At 200 docs: 0.0276 Run IMSBDEFRP50
Query 233: 0.1037 At 500 docs: 0.0131 Comparison to median by topic
Query 234: 0.0128 At 1000 docs: 0.0077
Query 235: 0.3038 +1.0
Query 236: 1.0000 R-Precision (prec. after R
Query 237: 0.8454 (=num_rel) docs. retrieved):
Query 238: 0.0387 Exact: 0.1392
Query 239: 0.0042
Query 240: 0.0000
Query 241: 0.0040 +0.5
Query 242: 0.0004
Query 243: 0.1670
Query 244: 0.0000
Query 245: 0.7756
Query 246: 0.0043
Query 247: 0.8047
Query 248: 0.0314
0.0
Query 249: 0.0000
Query 250: 0.0013
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Padua, Bilingual German to French, Auto, TD Run IMSBDEFRUd651
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 49 queries): 1.0
Query 201: 0.0000 Total number of documents
Query 202: 0.3963 over all queries
Query 203: 0.1483 Retrieved: 45423
Query 204: 0.0005 Relevant: 915
Query 205: 0.0458 Rel_ret: 304
0.8
Query 206: 0.0014
Query 207: 0.0085 Interpolated Recall -
Query 208: 0.0018 Precision Averages:
Query 209: 0.0014 at 0.00 0.2530
Query 210: 0.0000 at 0.10 0.2381 0.6
Query 211: 0.0001 at 0.20 0.1834
Query 212: 0.0008 at 0.30 0.1657
Query 213: 0.0001 at 0.40 0.1513
Precision
Query 214: 0.0004 at 0.50 0.1431
Query 215: 0.3220 at 0.60 0.1278 0.4
Query 216: 0.0063 at 0.70 0.1163
Query 217: 0.0000 at 0.80 0.0905
Query 218: 0.7620 at 0.90 0.0671
Query 219: 0.0000 at 1.00 0.0351
Query 220: 0.0000 0.2
Query 221: 0.1764 Avg. prec. (non-interpolated)
Query 222: 0.0065 for all rel. documents
Query 223: 0.0000 0.1377
Query 224: 0.0337 Precision:
Query 225: 0.0000 At 5 docs: 0.1673 0.0
Query 226: 0.0019 At 10 docs: 0.1531 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.0009 At 15 docs: 0.1265
Query 229: 0.0038 At 20 docs: 0.1102 Recall
Query 230: 0.5393 At 30 docs: 0.0891
Query 231: 0.0439 At 100 docs: 0.0398
Query 232: 0.0000 At 200 docs: 0.0222 Run IMSBDEFRUd651
Query 233: 0.1398 At 500 docs: 0.0105 Comparison to median by topic
Query 234: 0.0000 At 1000 docs: 0.0062
Query 235: 0.3175 +1.0
Query 236: 1.0000 R-Precision (prec. after R
Query 237: 0.9346 (=num_rel) docs. retrieved):
Query 238: 0.0415 Exact: 0.1390
Query 239: 0.0034
Query 240: 0.0000
Query 241: 0.0002 +0.5
Query 242: 0.0010
Query 243: 0.1140
Query 244: 0.0000
Query 245: 0.7845
Query 246: 0.0054
Query 247: 0.9025
Query 248: 0.0000
0.0
Query 249: 0.0000
Query 250: 0.0001
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Padua, Bilingual German to French, Auto, TD Run IMSBDEFRUd655
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 49 queries): 1.0
Query 201: 0.0001 Total number of documents
Query 202: 0.3693 over all queries
Query 203: 0.1483 Retrieved: 46422
Query 204: 0.0005 Relevant: 915
Query 205: 0.0458 Rel_ret: 369
0.8
Query 206: 0.0008
Query 207: 0.0080 Interpolated Recall -
Query 208: 0.0017 Precision Averages:
Query 209: 0.0014 at 0.00 0.2726
Query 210: 0.0000 at 0.10 0.2419 0.6
Query 211: 0.0001 at 0.20 0.1872
Query 212: 0.0000 at 0.30 0.1657
Query 213: 0.1612 at 0.40 0.1546
Precision
Query 214: 0.0001 at 0.50 0.1457
Query 215: 0.2865 at 0.60 0.1298 0.4
Query 216: 0.0063 at 0.70 0.1139
Query 217: 0.0000 at 0.80 0.0809
Query 218: 0.7777 at 0.90 0.0540
Query 219: 0.0000 at 1.00 0.0287
Query 220: 0.0000 0.2
Query 221: 0.1763 Avg. prec. (non-interpolated)
Query 222: 0.0075 for all rel. documents
Query 223: 0.0000 0.1365
Query 224: 0.0142 Precision:
Query 225: 0.0000 At 5 docs: 0.1633 0.0
Query 226: 0.0019 At 10 docs: 0.1490 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.0009 At 15 docs: 0.1279
Query 229: 0.0038 At 20 docs: 0.1153 Recall
Query 230: 0.5341 At 30 docs: 0.0952
Query 231: 0.0499 At 100 docs: 0.0453
Query 232: 0.0000 At 200 docs: 0.0261 Run IMSBDEFRUd655
Query 233: 0.1399 At 500 docs: 0.0123 Comparison to median by topic
Query 234: 0.0000 At 1000 docs: 0.0075
Query 235: 0.3175 +1.0
Query 236: 1.0000 R-Precision (prec. after R
Query 237: 0.8648 (=num_rel) docs. retrieved):
Query 238: 0.0415 Exact: 0.1360
Query 239: 0.0039
Query 240: 0.0000
Query 241: 0.0002 +0.5
Query 242: 0.0011
Query 243: 0.1137
Query 244: 0.0000
Query 245: 0.7812
Query 246: 0.0054
Query 247: 0.8174
Query 248: 0.0031
0.0
Query 249: 0.0000
Query 250: 0.0001
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
NII Group, Bilingual German to French, Auto, TD Run NiiDic03
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 49 queries): 1.0
Query 201: 0.0000 Total number of documents
Query 202: 0.6242 over all queries
Query 203: 0.4989 Retrieved: 49000
Query 204: 0.8378 Relevant: 915
Query 205: 0.4484 Rel_ret: 636
0.8
Query 206: 0.1416
Query 207: 0.3465 Interpolated Recall -
Query 208: 0.3723 Precision Averages:
Query 209: 0.0000 at 0.00 0.3985
Query 210: 0.0241 at 0.10 0.3619 0.6
Query 211: 0.8339 at 0.20 0.3398
Query 212: 0.0003 at 0.30 0.3272
Query 213: 0.6929 at 0.40 0.3106
Precision
Query 214: 0.0022 at 0.50 0.2785
Query 215: 0.0238 at 0.60 0.2550 0.4
Query 216: 0.0000 at 0.70 0.2398
Query 217: 0.0130 at 0.80 0.2140
Query 218: 0.9532 at 0.90 0.1881
Query 219: 0.0000 at 1.00 0.1157
Query 220: 0.0093 0.2
Query 221: 0.6755 Avg. prec. (non-interpolated)
Query 222: 0.0000 for all rel. documents
Query 223: 0.0000 0.2690
Query 224: 0.0005 Precision:
Query 225: 0.0011 At 5 docs: 0.2694 0.0
Query 226: 0.0132 At 10 docs: 0.2429 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.0000 At 15 docs: 0.2259
Query 229: 0.3069 At 20 docs: 0.2133 Recall
Query 230: 0.8277 At 30 docs: 0.1884
Query 231: 0.5953 At 100 docs: 0.1000
Query 232: 0.0000 At 200 docs: 0.0580 Run NiiDic03
Query 233: 0.1772 At 500 docs: 0.0250 Comparison to median by topic
Query 234: 0.0000 At 1000 docs: 0.0130
Query 235: 0.6221 +1.0
Query 236: 0.0513 R-Precision (prec. after R
Query 237: 0.7915 (=num_rel) docs. retrieved):
Query 238: 0.3302 Exact: 0.2549
Query 239: 0.0008
Query 240: 1.0000
Query 241: 0.0203 +0.5
Query 242: 0.1070
Query 243: 0.4546
Query 244: 0.0128
Query 245: 0.3201
Query 246: 0.0267
Query 247: 0.9500
Query 248: 0.0003
0.0
Query 249: 0.0455
Query 250: 0.0266
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
NII Group, Bilingual German to French, Auto, TD Run NiiDic04
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 49 queries): 1.0
Query 201: 0.0000 Total number of documents
Query 202: 0.6242 over all queries
Query 203: 0.5970 Retrieved: 49000
Query 204: 0.8426 Relevant: 915
Query 205: 0.4529 Rel_ret: 639
0.8
Query 206: 0.2009
Query 207: 0.3526 Interpolated Recall -
Query 208: 0.3696 Precision Averages:
Query 209: 0.0000 at 0.00 0.3963
Query 210: 0.0238 at 0.10 0.3738 0.6
Query 211: 0.7887 at 0.20 0.3516
Query 212: 0.0003 at 0.30 0.3343
Query 213: 0.7976 at 0.40 0.3218
Precision
Query 214: 0.0021 at 0.50 0.2911
Query 215: 0.0134 at 0.60 0.2723 0.4
Query 216: 0.0000 at 0.70 0.2491
Query 217: 0.0131 at 0.80 0.2102
Query 218: 0.9333 at 0.90 0.1845
Query 219: 0.0000 at 1.00 0.1128
Query 220: 0.0089 0.2
Query 221: 0.6753 Avg. prec. (non-interpolated)
Query 222: 0.0002 for all rel. documents
Query 223: 0.0000 0.2746
Query 224: 0.0065 Precision:
Query 225: 0.0000 At 5 docs: 0.2857 0.0
Query 226: 0.0000 At 10 docs: 0.2551 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.0000 At 15 docs: 0.2286
Query 229: 0.4254 At 20 docs: 0.2102 Recall
Query 230: 0.7795 At 30 docs: 0.1878
Query 231: 0.4517 At 100 docs: 0.0984
Query 232: 0.0000 At 200 docs: 0.0576 Run NiiDic04
Query 233: 0.0955 At 500 docs: 0.0248 Comparison to median by topic
Query 234: 0.0000 At 1000 docs: 0.0130
Query 235: 0.6505 +1.0
Query 236: 0.0513 R-Precision (prec. after R
Query 237: 0.7929 (=num_rel) docs. retrieved):
Query 238: 0.3328 Exact: 0.2542
Query 239: 0.0044
Query 240: 1.0000
Query 241: 0.0194 +0.5
Query 242: 0.0026
Query 243: 0.4327
Query 244: 0.0149
Query 245: 0.6522
Query 246: 0.0251
Query 247: 0.9500
Query 248: 0.0000
0.0
Query 249: 0.0476
Query 250: 0.0218
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
NII Group, Bilingual German to French, Auto, TD Run NiiDic05
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 49 queries): 1.0
Query 201: 0.0000 Total number of documents
Query 202: 0.2921 over all queries
Query 203: 0.0159 Retrieved: 49000
Query 204: 0.1024 Relevant: 915
Query 205: 0.3757 Rel_ret: 497
0.8
Query 206: 0.0355
Query 207: 0.0059 Interpolated Recall -
Query 208: 0.0756 Precision Averages:
Query 209: 0.0136 at 0.00 0.2558
Query 210: 0.0000 at 0.10 0.1867 0.6
Query 211: 0.3657 at 0.20 0.1504
Query 212: 0.0006 at 0.30 0.1328
Query 213: 0.2426 at 0.40 0.1135
Precision
Query 214: 0.0000 at 0.50 0.0993
Query 215: 0.0061 at 0.60 0.0928 0.4
Query 216: 0.0026 at 0.70 0.0813
Query 217: 0.0000 at 0.80 0.0486
Query 218: 0.8493 at 0.90 0.0311
Query 219: 0.0000 at 1.00 0.0055
Query 220: 0.0000 0.2
Query 221: 0.2449 Avg. prec. (non-interpolated)
Query 222: 0.0096 for all rel. documents
Query 223: 0.0000 0.1015
Query 224: 0.0702 Precision:
Query 225: 0.0000 At 5 docs: 0.1306 0.0
Query 226: 0.0021 At 10 docs: 0.1122 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.0045 At 15 docs: 0.1020
Query 229: 0.0128 At 20 docs: 0.0929 Recall
Query 230: 0.0015 At 30 docs: 0.0878
Query 231: 0.1920 At 100 docs: 0.0490
Query 232: 0.0000 At 200 docs: 0.0309 Run NiiDic05
Query 233: 0.0367 At 500 docs: 0.0169 Comparison to median by topic
Query 234: 0.0000 At 1000 docs: 0.0101
Query 235: 0.0212 +1.0
Query 236: 0.0202 R-Precision (prec. after R
Query 237: 0.0108 (=num_rel) docs. retrieved):
Query 238: 0.0588 Exact: 0.1024
Query 239: 0.0612
Query 240: 0.1111
Query 241: 0.0069 +0.5
Query 242: 0.0063
Query 243: 0.2212
Query 244: 0.0000
Query 245: 0.7500
Query 246: 0.0707
Query 247: 0.6593
Query 248: 0.0000
0.0
Query 249: 0.0175
Query 250: 0.0000
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
NII Group, Bilingual German to French, Auto, TD Run NiiMt02
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 49 queries): 1.0
Query 201: 0.0632 Total number of documents
Query 202: 0.5808 over all queries
Query 203: 0.4555 Retrieved: 49000
Query 204: 0.6646 Relevant: 915
Query 205: 0.2886 Rel_ret: 799
0.8
Query 206: 0.3261
Query 207: 0.3516 Interpolated Recall -
Query 208: 0.7333 Precision Averages:
Query 209: 0.0007 at 0.00 0.4559
Query 210: 0.0555 at 0.10 0.4340 0.6
Query 211: 0.8408 at 0.20 0.4260
Query 212: 0.1784 at 0.30 0.4030
Query 213: 0.8106 at 0.40 0.3820
Precision
Query 214: 0.0592 at 0.50 0.3618
Query 215: 0.0425 at 0.60 0.3441 0.4
Query 216: 0.0453 at 0.70 0.3259
Query 217: 0.4580 at 0.80 0.2789
Query 218: 0.9289 at 0.90 0.2326
Query 219: 0.0000 at 1.00 0.1612
Query 220: 0.0292 0.2
Query 221: 0.6484 Avg. prec. (non-interpolated)
Query 222: 0.0016 for all rel. documents
Query 223: 0.0067 0.3368
Query 224: 0.9762 Precision:
Query 225: 0.0333 At 5 docs: 0.3265 0.0
Query 226: 0.0106 At 10 docs: 0.3102 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.8165 At 15 docs: 0.2871
Query 229: 0.3137 At 20 docs: 0.2684 Recall
Query 230: 0.8350 At 30 docs: 0.2313
Query 231: 0.2715 At 100 docs: 0.1231
Query 232: 0.0030 At 200 docs: 0.0713 Run NiiMt02
Query 233: 0.0666 At 500 docs: 0.0310 Comparison to median by topic
Query 234: 0.0040 At 1000 docs: 0.0163
Query 235: 0.0428 +1.0
Query 236: 0.9588 R-Precision (prec. after R
Query 237: 0.7801 (=num_rel) docs. retrieved):
Query 238: 0.2467 Exact: 0.3125
Query 239: 0.1949
Query 240: 1.0000
Query 241: 0.0126 +0.5
Query 242: 0.2816
Query 243: 0.3925
Query 244: 0.0120
Query 245: 0.7577
Query 246: 0.0741
Query 247: 0.0416
Query 248: 0.7128
0.0
Query 249: 0.0556
Query 250: 0.0419
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Daedalus, Bilingual Dutch to French, Auto, TD Run nl2frav
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 49 queries): 1.0
Query 201: 0.2354 Total number of documents
Query 202: 0.5703 over all queries
Query 203: 0.1587 Retrieved: 49000
Query 204: 0.8211 Relevant: 915
Query 205: 0.4068 Rel_ret: 755
0.8
Query 206: 0.4675
Query 207: 0.3206 Interpolated Recall -
Query 208: 0.7431 Precision Averages:
Query 209: 0.1231 at 0.00 0.5628
Query 210: 0.0110 at 0.10 0.5149 0.6
Query 211: 0.7423 at 0.20 0.4599
Query 212: 0.1308 at 0.30 0.4088
Query 213: 0.6358 at 0.40 0.3785
Precision
Query 214: 0.0000 at 0.50 0.3594
Query 215: 0.0710 at 0.60 0.3296 0.4
Query 216: 0.0517 at 0.70 0.2984
Query 217: 0.4782 at 0.80 0.2668
Query 218: 0.8929 at 0.90 0.2224
Query 219: 0.0217 at 1.00 0.1668
Query 220: 0.0019 0.2
Query 221: 0.3326 Avg. prec. (non-interpolated)
Query 222: 0.0165 for all rel. documents
Query 223: 0.0017 0.3505
Query 224: 0.9583 Precision:
Query 225: 0.0263 At 5 docs: 0.3878 0.0
Query 226: 0.0263 At 10 docs: 0.3306 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.2451 At 15 docs: 0.2884
Query 229: 0.4732 At 20 docs: 0.2673 Recall
Query 230: 0.9224 At 30 docs: 0.2238
Query 231: 0.6693 At 100 docs: 0.1147
Query 232: 0.0009 At 200 docs: 0.0643 Run nl2frav
Query 233: 0.4265 At 500 docs: 0.0287 Comparison to median by topic
Query 234: 0.0090 At 1000 docs: 0.0154
Query 235: 0.9167 +1.0
Query 236: 0.0653 R-Precision (prec. after R
Query 237: 0.8526 (=num_rel) docs. retrieved):
Query 238: 0.5550 Exact: 0.3387
Query 239: 0.0161
Query 240: 1.0000
Query 241: 0.0146 +0.5
Query 242: 0.1823
Query 243: 0.6168
Query 244: 0.0000
Query 245: 1.0000
Query 246: 0.0543
Query 247: 0.0156
Query 248: 0.8775
0.0
Query 249: 0.0127
Query 250: 0.0008
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Daedalus, Bilingual Dutch to French, Auto, TD Run nl2frcomb1s101
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 49 queries): 1.0
Query 201: 0.2363 Total number of documents
Query 202: 0.5844 over all queries
Query 203: 0.1392 Retrieved: 49000
Query 204: 0.8075 Relevant: 915
Query 205: 0.4185 Rel_ret: 749
0.8
Query 206: 0.4710
Query 207: 0.3120 Interpolated Recall -
Query 208: 0.7463 Precision Averages:
Query 209: 0.1015 at 0.00 0.5515
Query 210: 0.0128 at 0.10 0.4966 0.6
Query 211: 0.7389 at 0.20 0.4521
Query 212: 0.1303 at 0.30 0.4108
Query 213: 0.6452 at 0.40 0.3804
Precision
Query 214: 0.0000 at 0.50 0.3534
Query 215: 0.0716 at 0.60 0.3229 0.4
Query 216: 0.0548 at 0.70 0.2930
Query 217: 0.4784 at 0.80 0.2639
Query 218: 0.8963 at 0.90 0.2175
Query 219: 0.0191 at 1.00 0.1595
Query 220: 0.0019 0.2
Query 221: 0.3284 Avg. prec. (non-interpolated)
Query 222: 0.0162 for all rel. documents
Query 223: 0.0006 0.3449
Query 224: 0.9444 Precision:
Query 225: 0.0278 At 5 docs: 0.3755 0.0
Query 226: 0.0263 At 10 docs: 0.3306 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.2424 At 15 docs: 0.2857
Query 229: 0.4714 At 20 docs: 0.2663 Recall
Query 230: 0.9172 At 30 docs: 0.2252
Query 231: 0.5513 At 100 docs: 0.1147
Query 232: 0.0002 At 200 docs: 0.0635 Run nl2frcomb1s101
Query 233: 0.4374 At 500 docs: 0.0287 Comparison to median by topic
Query 234: 0.0064 At 1000 docs: 0.0153
Query 235: 0.9167 +1.0
Query 236: 0.0461 R-Precision (prec. after R
Query 237: 0.8597 (=num_rel) docs. retrieved):
Query 238: 0.4550 Exact: 0.3352
Query 239: 0.0182
Query 240: 1.0000
Query 241: 0.0174 +0.5
Query 242: 0.1830
Query 243: 0.6136
Query 244: 0.0000
Query 245: 1.0000
Query 246: 0.0471
Query 247: 0.0101
Query 248: 0.8828
0.0
Query 249: 0.0127
Query 250: 0.0003
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Daedalus, Bilingual Dutch to French, Auto, TD Run nl2frR4FWnormal
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 49 queries): 1.0
Query 201: 0.2363 Total number of documents
Query 202: 0.5844 over all queries
Query 203: 0.1392 Retrieved: 49000
Query 204: 0.8075 Relevant: 915
Query 205: 0.4324 Rel_ret: 749
0.8
Query 206: 0.4710
Query 207: 0.3120 Interpolated Recall -
Query 208: 0.7463 Precision Averages:
Query 209: 0.1015 at 0.00 0.5583
Query 210: 0.0128 at 0.10 0.5034 0.6
Query 211: 0.7389 at 0.20 0.4590
Query 212: 0.1303 at 0.30 0.4108
Query 213: 0.6452 at 0.40 0.3804
Precision
Query 214: 0.0000 at 0.50 0.3534
Query 215: 0.0716 at 0.60 0.3229 0.4
Query 216: 0.0548 at 0.70 0.2930
Query 217: 0.4784 at 0.80 0.2639
Query 218: 0.8963 at 0.90 0.2175
Query 219: 0.0191 at 1.00 0.1595
Query 220: 0.0019 0.2
Query 221: 0.3284 Avg. prec. (non-interpolated)
Query 222: 0.0162 for all rel. documents
Query 223: 0.0006 0.3472
Query 224: 0.9444 Precision:
Query 225: 0.0278 At 5 docs: 0.3755 0.0
Query 226: 0.0263 At 10 docs: 0.3306 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.2424 At 15 docs: 0.2857
Query 229: 0.4714 At 20 docs: 0.2663 Recall
Query 230: 0.9172 At 30 docs: 0.2252
Query 231: 0.5513 At 100 docs: 0.1147
Query 232: 0.0002 At 200 docs: 0.0635 Run nl2frR4FWnormal
Query 233: 0.4374 At 500 docs: 0.0287 Comparison to median by topic
Query 234: 0.0064 At 1000 docs: 0.0153
Query 235: 0.9167 +1.0
Query 236: 0.0461 R-Precision (prec. after R
Query 237: 0.8597 (=num_rel) docs. retrieved):
Query 238: 0.5550 Exact: 0.3352
Query 239: 0.0182
Query 240: 1.0000
Query 241: 0.0174 +0.5
Query 242: 0.1830
Query 243: 0.6136
Query 244: 0.0000
Query 245: 1.0000
Query 246: 0.0471
Query 247: 0.0101
Query 248: 0.8828
0.0
Query 249: 0.0127
Query 250: 0.0003
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Daedalus, Bilingual Dutch to French, Auto, TD Run nl2frR5FWnormal
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 49 queries): 1.0
Query 201: 0.2370 Total number of documents
Query 202: 0.5891 over all queries
Query 203: 0.1330 Retrieved: 49000
Query 204: 0.8037 Relevant: 915
Query 205: 0.4332 Rel_ret: 754
0.8
Query 206: 0.4722
Query 207: 0.3119 Interpolated Recall -
Query 208: 0.7431 Precision Averages:
Query 209: 0.1014 at 0.00 0.5598
Query 210: 0.0124 at 0.10 0.5021 0.6
Query 211: 0.7440 at 0.20 0.4584
Query 212: 0.1436 at 0.30 0.4115
Query 213: 0.6512 at 0.40 0.3817
Precision
Query 214: 0.0000 at 0.50 0.3560
Query 215: 0.0694 at 0.60 0.3262 0.4
Query 216: 0.0556 at 0.70 0.2955
Query 217: 0.4743 at 0.80 0.2674
Query 218: 0.8932 at 0.90 0.2188
Query 219: 0.0182 at 1.00 0.1593
Query 220: 0.0018 0.2
Query 221: 0.3279 Avg. prec. (non-interpolated)
Query 222: 0.0159 for all rel. documents
Query 223: 0.0007 0.3483
Query 224: 0.9444 Precision:
Query 225: 0.0238 At 5 docs: 0.3837 0.0
Query 226: 0.0263 At 10 docs: 0.3286 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.2366 At 15 docs: 0.2871
Query 229: 0.4724 At 20 docs: 0.2684 Recall
Query 230: 0.9172 At 30 docs: 0.2252
Query 231: 0.5948 At 100 docs: 0.1149
Query 232: 0.0002 At 200 docs: 0.0640 Run nl2frR5FWnormal
Query 233: 0.4392 At 500 docs: 0.0289 Comparison to median by topic
Query 234: 0.0031 At 1000 docs: 0.0154
Query 235: 0.9167 +1.0
Query 236: 0.0624 R-Precision (prec. after R
Query 237: 0.8597 (=num_rel) docs. retrieved):
Query 238: 0.5425 Exact: 0.3400
Query 239: 0.0188
Query 240: 1.0000
Query 241: 0.0226 +0.5
Query 242: 0.1832
Query 243: 0.6131
Query 244: 0.0000
Query 245: 1.0000
Query 246: 0.0493
Query 247: 0.0098
Query 248: 0.8850
0.0
Query 249: 0.0141
Query 250: 0.0006
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
SICS, Bilingual Swedish to French, Auto, TD Run SICSsvfrQF
Average precision Overall statistics
Recall−Precision Values
(individual queries): (for 49 queries):
1.0
Query 201: 0.0533 Total number of documents
Query 202: 0.5339 over all queries
Query 203: 0.4034 Retrieved: 49000
Query 204: 0.8165 Relevant: 915
Query 205: 0.3336 Rel_ret: 784 0.8
Query 206: 0.1266
Query 207: 0.0823 Interpolated Recall -
Query 208: 0.5087 Precision Averages:
Query 209: 0.0009 at 0.00 0.5023
Query 210: 0.3382 at 0.10 0.4320 0.6
Query 211: 0.6426 at 0.20 0.3602
Query 212: 0.1999 at 0.30 0.3350
Query 213: 0.5669 at 0.40 0.2958
Precision
Query 214: 0.0000 at 0.50 0.2680
Query 215: 0.0611 at 0.60 0.2372 0.4
Query 216: 0.0007 at 0.70 0.2070
Query 217: 0.1969 at 0.80 0.1708
Query 218: 0.8344 at 0.90 0.1486
Query 219: 0.0014 at 1.00 0.0832
Query 220: 0.0127 0.2
Query 221: 0.1899 Avg. prec. (non-interpolated)
Query 222: 0.0076 for all rel. documents
Query 223: 0.0004 0.2622
Query 224: 0.6663 Precision:
Query 225: 0.0026 At 5 docs: 0.2980 0.0
Query 226: 0.0000 At 10 docs: 0.2449 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.0565 At 15 docs: 0.2204
Query 229: 0.0004 At 20 docs: 0.2010 Recall
Query 230: 0.5194 At 30 docs: 0.1830
Query 231: 0.2795 At 100 docs: 0.1088
Query 232: 0.1573 At 200 docs: 0.0665 Run SICSsvfrQF
Query 233: 0.3612 At 500 docs: 0.0301
Query 234: 0.0833 At 1000 docs: 0.0160
Comparison to median by topic
Query 235: 0.8179 +1.0
Query 236: 0.2021 R-Precision (prec. after R
Query 237: 0.9164 (=num_rel) docs. retrieved):
Query 238: 0.1135 Exact: 0.2586
Query 239: 0.0590
Query 240: 1.0000
Query 241: 0.0351 +0.5
Query 242: 0.0222
Query 243: 0.3921
Query 244: 0.0833
Query 245: 0.7524
Query 246: 0.0454
Query 247: 0.0030
Query 248: 0.3361 0.0
Query 249: 0.0164
Query 250: 0.0154
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Thomson Legal, Bilingual German to French, Auto, TD Run tlrde2fr1
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 49 queries): 1.0
Query 201: 0.0769 Total number of documents
Query 202: 0.1873 over all queries
Query 203: 0.1930 Retrieved: 49000
Query 204: 0.4244 Relevant: 915
Query 205: 0.2558 Rel_ret: 685
0.8
Query 206: 0.1727
Query 207: 0.0000 Interpolated Recall -
Query 208: 0.8042 Precision Averages:
Query 209: 0.3111 at 0.00 0.5240
Query 210: 0.2988 at 0.10 0.4785 0.6
Query 211: 0.7595 at 0.20 0.4214
Query 212: 0.1973 at 0.30 0.3397
Query 213: 0.7137 at 0.40 0.3006
Precision
Query 214: 0.0001 at 0.50 0.2731
Query 215: 0.1135 at 0.60 0.2308 0.4
Query 216: 0.0026 at 0.70 0.2054
Query 217: 0.3126 at 0.80 0.1690
Query 218: 0.8101 at 0.90 0.1374
Query 219: 0.2341 at 1.00 0.0999
Query 220: 0.0638 0.2
Query 221: 0.4650 Avg. prec. (non-interpolated)
Query 222: 0.0054 for all rel. documents
Query 223: 0.0259 0.2723
Query 224: 0.8020 Precision:
Query 225: 0.0070 At 5 docs: 0.3020 0.0
Query 226: 0.0185 At 10 docs: 0.2571 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.3423 At 15 docs: 0.2354
Query 229: 0.0019 At 20 docs: 0.2153 Recall
Query 230: 0.2071 At 30 docs: 0.1857
Query 231: 0.3768 At 100 docs: 0.0951
Query 232: 0.0000 At 200 docs: 0.0585 Run tlrde2fr1
Query 233: 0.3633 At 500 docs: 0.0265 Comparison to median by topic
Query 234: 0.0000 At 1000 docs: 0.0140
Query 235: 0.0078 +1.0
Query 236: 0.1087 R-Precision (prec. after R
Query 237: 0.6568 (=num_rel) docs. retrieved):
Query 238: 0.4371 Exact: 0.2877
Query 239: 0.0369
Query 240: 1.0000
Query 241: 0.0311 +0.5
Query 242: 0.5160
Query 243: 0.6804
Query 244: 0.0106
Query 245: 0.7672
Query 246: 0.2529
Query 247: 0.0351
Query 248: 0.1848
0.0
Query 249: 0.0625
Query 250: 0.0066
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Thomson Legal, Bilingual German to French, Auto, TD Run tlrde2fr2
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 49 queries): 1.0
Query 201: 0.0808 Total number of documents
Query 202: 0.0836 over all queries
Query 203: 0.2213 Retrieved: 49000
Query 204: 0.4248 Relevant: 915
Query 205: 0.2768 Rel_ret: 704
0.8
Query 206: 0.1722
Query 207: 0.2156 Interpolated Recall -
Query 208: 0.8042 Precision Averages:
Query 209: 0.4042 at 0.00 0.5628
Query 210: 0.3478 at 0.10 0.5249 0.6
Query 211: 0.8104 at 0.20 0.4793
Query 212: 0.1393 at 0.30 0.4189
Query 213: 0.6897 at 0.40 0.3681
Precision
Query 214: 0.0001 at 0.50 0.3235
Query 215: 0.1019 at 0.60 0.2828 0.4
Query 216: 0.0010 at 0.70 0.2595
Query 217: 0.3231 at 0.80 0.2080
Query 218: 0.8107 at 0.90 0.1615
Query 219: 0.1240 at 1.00 0.1168
Query 220: 0.0112 0.2
Query 221: 0.5245 Avg. prec. (non-interpolated)
Query 222: 0.0062 for all rel. documents
Query 223: 0.0067 0.3225
Query 224: 0.8556 Precision:
Query 225: 0.0024 At 5 docs: 0.3673 0.0
Query 226: 0.0179 At 10 docs: 0.3082 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.3620 At 15 docs: 0.2735
Query 229: 0.4873 At 20 docs: 0.2541 Recall
Query 230: 0.5001 At 30 docs: 0.2082
Query 231: 0.3672 At 100 docs: 0.1076
Query 232: 0.0005 At 200 docs: 0.0622 Run tlrde2fr2
Query 233: 0.3693 At 500 docs: 0.0277 Comparison to median by topic
Query 234: 0.0000 At 1000 docs: 0.0144
Query 235: 0.0425 +1.0
Query 236: 0.1569 R-Precision (prec. after R
Query 237: 0.8893 (=num_rel) docs. retrieved):
Query 238: 0.4581 Exact: 0.3250
Query 239: 0.0417
Query 240: 1.0000
Query 241: 0.0250 +0.5
Query 242: 0.5156
Query 243: 0.7870
Query 244: 0.0062
Query 245: 0.7675
Query 246: 0.2327
Query 247: 0.6942
Query 248: 0.5232
0.0
Query 249: 0.1111
Query 250: 0.0093
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Thomson Legal, Bilingual German to French, Auto, TD Run tlrde2fr3
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 49 queries): 1.0
Query 201: 0.1651 Total number of documents
Query 202: 0.7259 over all queries
Query 203: 0.5346 Retrieved: 49000
Query 204: 0.7677 Relevant: 915
Query 205: 0.2675 Rel_ret: 752
0.8
Query 206: 0.1706
Query 207: 0.2647 Interpolated Recall -
Query 208: 0.8875 Precision Averages:
Query 209: 0.2870 at 0.00 0.5482
Query 210: 0.3837 at 0.10 0.4998 0.6
Query 211: 0.8431 at 0.20 0.4801
Query 212: 0.1807 at 0.30 0.4414
Query 213: 0.7867 at 0.40 0.4264
Precision
Query 214: 0.0000 at 0.50 0.3999
Query 215: 0.1353 at 0.60 0.3775 0.4
Query 216: 0.0076 at 0.70 0.3499
Query 217: 0.2385 at 0.80 0.3126
Query 218: 0.8483 at 0.90 0.2701
Query 219: 0.1945 at 1.00 0.2097
Query 220: 0.0072 0.2
Query 221: 0.6969 Avg. prec. (non-interpolated)
Query 222: 0.0002 for all rel. documents
Query 223: 0.0118 0.3750
Query 224: 0.9583 Precision:
Query 225: 0.0052 At 5 docs: 0.3837 0.0
Query 226: 0.0000 At 10 docs: 0.3531 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.6970 At 15 docs: 0.3279
Query 229: 0.3998 At 20 docs: 0.3000 Recall
Query 230: 0.6562 At 30 docs: 0.2571
Query 231: 0.1921 At 100 docs: 0.1255
Query 232: 0.0000 At 200 docs: 0.0707 Run tlrde2fr3
Query 233: 0.3806 At 500 docs: 0.0302 Comparison to median by topic
Query 234: 0.0000 At 1000 docs: 0.0153
Query 235: 0.1386 +1.0
Query 236: 0.6347 R-Precision (prec. after R
Query 237: 0.9074 (=num_rel) docs. retrieved):
Query 238: 0.4833 Exact: 0.3409
Query 239: 0.0077
Query 240: 0.5000
Query 241: 0.0025 +0.5
Query 242: 0.3305
Query 243: 0.8412
Query 244: 0.0035
Query 245: 0.8409
Query 246: 0.2241
Query 247: 1.0000
Query 248: 0.7219
0.0
Query 249: 0.0435
Query 250: 0.0029
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Thomson Legal, Bilingual German to French, Auto, TD Run tlrde2fr4
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 49 queries): 1.0
Query 201: 0.1457 Total number of documents
Query 202: 0.4007 over all queries
Query 203: 0.5590 Retrieved: 49000
Query 204: 0.7106 Relevant: 915
Query 205: 0.2086 Rel_ret: 706
0.8
Query 206: 0.1809
Query 207: 0.0001 Interpolated Recall -
Query 208: 0.8875 Precision Averages:
Query 209: 0.3476 at 0.00 0.4998
Query 210: 0.6266 at 0.10 0.4539 0.6
Query 211: 0.8403 at 0.20 0.4366
Query 212: 0.4061 at 0.30 0.4060
Query 213: 0.8319 at 0.40 0.3669
Precision
Query 214: 0.0000 at 0.50 0.3384
Query 215: 0.1859 at 0.60 0.3212 0.4
Query 216: 0.0021 at 0.70 0.2880
Query 217: 0.2679 at 0.80 0.2535
Query 218: 0.8362 at 0.90 0.2215
Query 219: 0.1388 at 1.00 0.1693
Query 220: 0.0023 0.2
Query 221: 0.6137 Avg. prec. (non-interpolated)
Query 222: 0.0004 for all rel. documents
Query 223: 0.0125 0.3289
Query 224: 0.9762 Precision:
Query 225: 0.0030 At 5 docs: 0.3143 0.0
Query 226: 0.0000 At 10 docs: 0.2959 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.0002 At 15 docs: 0.2748
Query 229: 0.0000 At 20 docs: 0.2531 Recall
Query 230: 0.6023 At 30 docs: 0.2197
Query 231: 0.1943 At 100 docs: 0.1157
Query 232: 0.0001 At 200 docs: 0.0662 Run tlrde2fr4
Query 233: 0.3735 At 500 docs: 0.0284 Comparison to median by topic
Query 234: 0.0000 At 1000 docs: 0.0144
Query 235: 0.0417 +1.0
Query 236: 0.2629 R-Precision (prec. after R
Query 237: 0.8926 (=num_rel) docs. retrieved):
Query 238: 0.6597 Exact: 0.3005
Query 239: 0.0006
Query 240: 0.5000
Query 241: 0.0034 +0.5
Query 242: 0.3373
Query 243: 0.9060
Query 244: 0.0038
Query 245: 0.8409
Query 246: 0.4345
Query 247: 0.0345
Query 248: 0.7620
0.0
Query 249: 0.0769
Query 250: 0.0024
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
JHU/APL, Bilingual Spanish to Finnish, Auto, TD Run aplbiesfia
Average precision Overall statistics
(individual queries): (for 45 queries):
Recall−Precision Values
1.0
Query 201: 0.1107 Total number of documents
Query 202: 0.8769 over all queries
Query 203: 0.6333 Retrieved: 45000
Query 204: 0.0017 Relevant: 413
Query 205: 0.2634 Rel_ret: 310 0.8
Query 207: 0.0015
Query 208: 0.2704 Interpolated Recall -
Query 209: 0.2500 Precision Averages:
Query 210: 1.0000 at 0.00 0.4429
Query 211: 0.9689 at 0.10 0.4153 0.6
Query 212: 0.3246 at 0.20 0.3907
Query 213: 0.0254 at 0.30 0.3649
Query 214: 0.0133 at 0.40 0.3426
Precision
Query 215: 1.0000 at 0.50 0.3124
Query 216: 0.2250 at 0.60 0.2672 0.4
Query 217: 0.4308 at 0.70 0.2444
Query 218: 0.2971 at 0.80 0.2308
Query 219: 0.0172 at 0.90 0.2127
Query 220: 0.0177 at 1.00 0.2025
Query 221: 0.9429 0.2
Query 222: 0.0020 Avg. prec. (non-interpolated)
Query 223: 0.1018 for all rel. documents
Query 224: 0.0833 0.2982
Query 225: 0.0077 Precision:
Query 226: 0.1276 At 5 docs: 0.2533 0.0
Query 228: 0.0511 At 10 docs: 0.1822 0.0 0.2 0.4 0.6 0.8 1.0
Query 229: 0.0051 At 15 docs: 0.1570
Query 230: 0.5178 At 20 docs: 0.1322 Recall
Query 232: 0.0204 At 30 docs: 0.1044
Query 233: 0.3912 At 100 docs: 0.0433
Query 234: 0.4586 At 200 docs: 0.0260 Run aplbiesfia
Query 235: 0.0645 At 500 docs: 0.0122
Query 236: 0.9167 At 1000 docs: 0.0069 Comparison to median by topic
Query 237: 0.8875 +1.0
Query 238: 0.9167 R-Precision (prec. after R
Query 239: 0.0308 (=num_rel) docs. retrieved):
Query 241: 0.0016 Exact: 0.2421
Query 242: 0.3250
Query 243: 0.0116
Query 244: 0.0500 +0.5
Query 245: 0.0031
Query 246: 0.3333
Query 248: 0.3903
Query 249: 0.0456
Query 250: 0.0040
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
JHU/APL, Bilingual French to Finnish, Auto, TD Run aplbifrfia
Average precision Overall statistics
(individual queries): (for 45 queries):
Recall−Precision Values
1.0
Query 201: 0.2667 Total number of documents
Query 202: 0.9945 over all queries
Query 203: 0.3409 Retrieved: 45000
Query 204: 0.0996 Relevant: 413
Query 205: 0.6210 Rel_ret: 322 0.8
Query 207: 0.1154
Query 208: 0.3135 Interpolated Recall -
Query 209: 0.0169 Precision Averages:
Query 210: 0.0625 at 0.00 0.5251
Query 211: 0.9552 at 0.10 0.4879 0.6
Query 212: 0.2860 at 0.20 0.4146
Query 213: 0.3346 at 0.30 0.3539
Query 214: 0.3367 at 0.40 0.2997
Precision
Query 215: 0.0476 at 0.50 0.2688
Query 216: 0.0264 at 0.60 0.2375 0.4
Query 217: 0.5042 at 0.70 0.2201
Query 218: 0.8379 at 0.80 0.2013
Query 219: 0.0003 at 0.90 0.1834
Query 220: 0.0490 at 1.00 0.1681
Query 221: 0.7533 0.2
Query 222: 0.0962 Avg. prec. (non-interpolated)
Query 223: 0.0315 for all rel. documents
Query 224: 0.0145 0.2899
Query 225: 0.1173 Precision:
Query 226: 0.1104 At 5 docs: 0.2933 0.0
Query 228: 0.0060 At 10 docs: 0.2200 0.0 0.2 0.4 0.6 0.8 1.0
Query 229: 0.3359 At 15 docs: 0.1926
Query 230: 0.2535 At 20 docs: 0.1711 Recall
Query 232: 0.0011 At 30 docs: 0.1319
Query 233: 0.4207 At 100 docs: 0.0527
Query 234: 0.4593 At 200 docs: 0.0307 Run aplbifrfia
Query 235: 0.1424 At 500 docs: 0.0136
Query 236: 1.0000 At 1000 docs: 0.0072 Comparison to median by topic
Query 237: 1.0000 +1.0
Query 238: 1.0000 R-Precision (prec. after R
Query 239: 0.1212 (=num_rel) docs. retrieved):
Query 241: 0.0004 Exact: 0.2689
Query 242: 0.0365
Query 243: 0.2865
Query 244: 0.0189 +0.5
Query 245: 0.0000
Query 246: 0.1250
Query 248: 0.4709
Query 249: 0.0342
Query 250: 0.0000
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
CLIPS, Bilingual English to Finnish, Auto, TDN Run CLIPS04ENFI1
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 45 queries): 1.0
Query 201: 0.0624 Total number of documents
Query 202: 0.0176 over all queries
Query 203: 0.0000 Retrieved: 44001
Query 204: 0.0000 Relevant: 413
Query 205: 0.1006 Rel_ret: 215
0.8
Query 207: 0.0000
Query 208: 0.1069 Interpolated Recall -
Query 209: 0.0000 Precision Averages:
Query 210: 0.0000 at 0.00 0.1938
Query 211: 0.0002 at 0.10 0.1700 0.6
Query 212: 0.0863 at 0.20 0.1539
Query 213: 0.7377 at 0.30 0.1464
Query 214: 0.0079 at 0.40 0.1350
Precision
Query 215: 0.0000 at 0.50 0.1318
Query 216: 0.0333 at 0.60 0.1171 0.4
Query 217: 0.0022 at 0.70 0.0945
Query 218: 0.3299 at 0.80 0.0754
Query 219: 0.0099 at 0.90 0.0495
Query 220: 0.0000 at 1.00 0.0360
Query 221: 0.0203 0.2
Query 222: 0.0000 Avg. prec. (non-interpolated)
Query 223: 0.0032 for all rel. documents
Query 224: 0.0000 0.1148
Query 225: 0.0000 Precision:
Query 226: 0.9593 At 5 docs: 0.1333 0.0
Query 228: 0.0000 At 10 docs: 0.1133 0.0 0.2 0.4 0.6 0.8 1.0
Query 229: 0.0000 At 15 docs: 0.0963
Query 230: 0.0736 At 20 docs: 0.0856 Recall
Query 232: 0.0278 At 30 docs: 0.0659
Query 233: 0.1055 At 100 docs: 0.0280
Query 234: 0.6867 At 200 docs: 0.0163 Run CLIPS04ENFI1
Query 235: 0.8103 At 500 docs: 0.0084 Comparison to median by topic
Query 236: 0.0000 At 1000 docs: 0.0048
Query 237: 0.0000 +1.0
Query 238: 0.0028 R-Precision (prec. after R
Query 239: 0.0180 (=num_rel) docs. retrieved):
Query 241: 0.0907 Exact: 0.1077
Query 242: 0.8333
Query 243: 0.0000
Query 244: 0.0000 +0.5
Query 245: 0.0030
Query 246: 0.0000
Query 248: 0.0006
Query 249: 0.0343
Query 250: 0.0000
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
CLIPS, Bilingual French to Finnish, Auto, TDN Run CLIPS04FRFI1
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 45 queries): 1.0
Query 201: 0.0021 Total number of documents
Query 202: 0.0023 over all queries
Query 203: 0.0035 Retrieved: 45000
Query 204: 0.0000 Relevant: 413
Query 205: 0.0160 Rel_ret: 164
0.8
Query 207: 0.0086
Query 208: 0.1559 Interpolated Recall -
Query 209: 0.0016 Precision Averages:
Query 210: 0.0000 at 0.00 0.1873
Query 211: 0.0013 at 0.10 0.1783 0.6
Query 212: 0.0004 at 0.20 0.1681
Query 213: 0.8401 at 0.30 0.1502
Query 214: 0.1111 at 0.40 0.1366
Precision
Query 215: 0.0000 at 0.50 0.1341
Query 216: 0.0550 at 0.60 0.1129 0.4
Query 217: 0.0002 at 0.70 0.1074
Query 218: 0.3385 at 0.80 0.0810
Query 219: 0.0043 at 0.90 0.0548
Query 220: 0.0000 at 1.00 0.0490
Query 221: 0.0230 0.2
Query 222: 0.0014 Avg. prec. (non-interpolated)
Query 223: 0.0008 for all rel. documents
Query 224: 1.0000 0.1199
Query 225: 0.0000 Precision:
Query 226: 0.0000 At 5 docs: 0.0978 0.0
Query 228: 0.0000 At 10 docs: 0.0844 0.0 0.2 0.4 0.6 0.8 1.0
Query 229: 0.0014 At 15 docs: 0.0800
Query 230: 0.4576 At 20 docs: 0.0700 Recall
Query 232: 0.0000 At 30 docs: 0.0511
Query 233: 0.0000 At 100 docs: 0.0227
Query 234: 0.7190 At 200 docs: 0.0130 Run CLIPS04FRFI1
Query 235: 0.8546 At 500 docs: 0.0065 Comparison to median by topic
Query 236: 0.0000 At 1000 docs: 0.0036
Query 237: 0.0004 +1.0
Query 238: 0.0015 R-Precision (prec. after R
Query 239: 0.0978 (=num_rel) docs. retrieved):
Query 241: 0.1077 Exact: 0.1151
Query 242: 0.5833
Query 243: 0.0000
Query 244: 0.0000 +0.5
Query 245: 0.0030
Query 246: 0.0000
Query 248: 0.0000
Query 249: 0.0049
Query 250: 0.0000
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
JHU/APL, Bilingual English to Portuguese, Auto, TD Run aplbienpta
Average precision Overall statistics
(individual queries): (for 46 queries):
Recall−Precision Values
1.0
Query 201: 0.0321 Total number of documents
Query 202: 0.8846 over all queries
Query 203: 0.0779 Retrieved: 46000
Query 204: 0.9821 Relevant: 678
Query 205: 0.0889 Rel_ret: 423 0.8
Query 206: 1.0000
Query 207: 0.0399 Interpolated Recall -
Query 208: 0.2604 Precision Averages:
Query 209: 0.5038 at 0.00 0.4984
Query 210: 0.1920 at 0.10 0.4895 0.6
Query 211: 0.9352 at 0.20 0.4642
Query 212: 0.1189 at 0.30 0.4205
Query 213: 0.5655 at 0.40 0.3722
Precision
Query 214: 0.0030 at 0.50 0.3604
Query 215: 0.1000 at 0.60 0.3031 0.4
Query 217: 0.1200 at 0.70 0.2889
Query 218: 0.6928 at 0.80 0.2753
Query 219: 0.0777 at 0.90 0.2566
Query 221: 0.7052 at 1.00 0.2228
Query 222: 0.0249 0.2
Query 223: 0.3333 Avg. prec. (non-interpolated)
Query 224: 0.8333 for all rel. documents
Query 225: 0.0175 0.3419
Query 226: 0.2003 Precision:
Query 228: 0.1310 At 5 docs: 0.2696 0.0
Query 229: 0.0006 At 10 docs: 0.2174 0.0 0.2 0.4 0.6 0.8 1.0
Query 230: 0.6005 At 15 docs: 0.1870
Query 231: 0.0009 At 20 docs: 0.1652 Recall
Query 232: 0.0097 At 30 docs: 0.1377
Query 233: 0.6313 At 100 docs: 0.0596
Query 234: 0.8333 At 200 docs: 0.0336 Run aplbienpta
Query 235: 0.0000 At 500 docs: 0.0161
Query 236: 0.4741 At 1000 docs: 0.0092 Comparison to median by topic
Query 237: 0.4435 +1.0
Query 238: 0.0714 R-Precision (prec. after R
Query 239: 0.1801 (=num_rel) docs. retrieved):
Query 241: 0.0067 Exact: 0.2887
Query 242: 0.1734
Query 243: 0.0227
Query 244: 0.0065 +0.5
Query 245: 1.0000
Query 246: 1.0000
Query 247: 0.6108
Query 248: 0.2933
Query 249: 0.3665
Query 250: 0.0794
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
JHU/APL, Bilingual Spanish to Portuguese, Auto, TD Run aplbiespta
Average precision Overall statistics
(individual queries): (for 46 queries):
Recall−Precision Values
1.0
Query 201: 0.0328 Total number of documents
Query 202: 0.8783 over all queries
Query 203: 0.2674 Retrieved: 46000
Query 204: 0.6925 Relevant: 678
Query 205: 0.1213 Rel_ret: 546 0.8
Query 206: 1.0000
Query 207: 0.2988 Interpolated Recall -
Query 208: 1.0000 Precision Averages:
Query 209: 0.2700 at 0.00 0.6536
Query 210: 0.6461 at 0.10 0.5995 0.6
Query 211: 0.9572 at 0.20 0.5705
Query 212: 0.0833 at 0.30 0.5260
Query 213: 0.6920 at 0.40 0.4910
Precision
Query 214: 0.1179 at 0.50 0.4658
Query 215: 1.0000 at 0.60 0.4266 0.4
Query 217: 1.0000 at 0.70 0.4014
Query 218: 0.6510 at 0.80 0.3736
Query 219: 0.1214 at 0.90 0.3398
Query 221: 0.9583 at 1.00 0.3101
Query 222: 0.0000 0.2
Query 223: 0.3333 Avg. prec. (non-interpolated)
Query 224: 1.0000 for all rel. documents
Query 225: 0.0256 0.4537
Query 226: 0.4447 Precision:
Query 228: 0.2442 At 5 docs: 0.3913 0.0
Query 229: 0.2622 At 10 docs: 0.3174 0.0 0.2 0.4 0.6 0.8 1.0
Query 230: 0.3996 At 15 docs: 0.2609
Query 231: 0.0133 At 20 docs: 0.2250 Recall
Query 232: 0.3248 At 30 docs: 0.1812
Query 233: 0.6876 At 100 docs: 0.0798
Query 234: 0.5833 At 200 docs: 0.0468 Run aplbiespta
Query 235: 0.0217 At 500 docs: 0.0214
Query 236: 0.8056 At 1000 docs: 0.0119 Comparison to median by topic
Query 237: 0.6667 +1.0
Query 238: 0.0476 R-Precision (prec. after R
Query 239: 0.1902 (=num_rel) docs. retrieved):
Query 241: 0.0007 Exact: 0.4187
Query 242: 0.7875
Query 243: 0.2500
Query 244: 0.3333 +0.5
Query 245: 1.0000
Query 246: 0.2000
Query 247: 0.3924
Query 248: 0.7329
Query 249: 0.2670
Query 250: 0.0657
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
JHU/APL, Bilingual Spanish to Portuguese, Auto, TD Run aplbiesptb
Average precision Overall statistics
(individual queries): (for 46 queries):
Recall−Precision Values
1.0
Query 201: 0.0277 Total number of documents
Query 202: 0.8171 over all queries
Query 203: 0.2318 Retrieved: 46000
Query 204: 0.6148 Relevant: 678
Query 205: 0.2159 Rel_ret: 439 0.8
Query 206: 0.0429
Query 207: 0.5254 Interpolated Recall -
Query 208: 0.9667 Precision Averages:
Query 209: 0.2679 at 0.00 0.5504
Query 210: 0.1133 at 0.10 0.5123 0.6
Query 211: 0.9669 at 0.20 0.4733
Query 212: 0.2003 at 0.30 0.4468
Query 213: 0.2202 at 0.40 0.4340
Precision
Query 214: 0.2974 at 0.50 0.4247
Query 215: 0.2000 at 0.60 0.3759 0.4
Query 217: 0.9367 at 0.70 0.3546
Query 218: 0.8123 at 0.80 0.3018
Query 219: 0.0192 at 0.90 0.2637
Query 221: 1.0000 at 1.00 0.2391
Query 222: 0.0000 0.2
Query 223: 0.5000 Avg. prec. (non-interpolated)
Query 224: 1.0000 for all rel. documents
Query 225: 0.0035 0.3825
Query 226: 0.6667 Precision:
Query 228: 0.5046 At 5 docs: 0.3652 0.0
Query 229: 0.0076 At 10 docs: 0.2826 0.0 0.2 0.4 0.6 0.8 1.0
Query 230: 0.4977 At 15 docs: 0.2333
Query 231: 0.0062 At 20 docs: 0.2054 Recall
Query 232: 0.0894 At 30 docs: 0.1594
Query 233: 0.4717 At 100 docs: 0.0680
Query 234: 0.0000 At 200 docs: 0.0377 Run aplbiesptb
Query 235: 0.0059 At 500 docs: 0.0175
Query 236: 0.6389 At 1000 docs: 0.0095 Comparison to median by topic
Query 237: 1.0000 +1.0
Query 238: 0.0345 R-Precision (prec. after R
Query 239: 0.2072 (=num_rel) docs. retrieved):
Query 241: 0.0254 Exact: 0.3278
Query 242: 0.4879
Query 243: 0.2500
Query 244: 0.5000 +0.5
Query 245: 0.3206
Query 246: 0.2500
Query 247: 0.8867
Query 248: 0.5840
Query 249: 0.1507
Query 250: 0.0278
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Alicante, Bilingual English to Portuguese, Auto, TD Run IRn−BEnPF−nexp
Average precision Overall statistics
(individual queries): (for 46 queries):
Recall−Precision Values
1.0
Query 201: 0.0258 Total number of documents
Query 202: 0.3552 over all queries
Query 203: 0.2368 Retrieved: 46000
Query 204: 0.3714 Relevant: 678
Query 205: 0.5192 Rel_ret: 331 0.8
Query 206: 1.0000
Query 207: 0.0093 Interpolated Recall -
Query 208: 0.6127 Precision Averages:
Query 209: 0.0000 at 0.00 0.4302
Query 210: 0.0051 at 0.10 0.3998 0.6
Query 211: 0.0650 at 0.20 0.3461
Query 212: 0.2185 at 0.30 0.2880
Query 213: 0.4384 at 0.40 0.2551
Precision
Query 214: 0.0000 at 0.50 0.2252
Query 215: 0.0025 at 0.60 0.1937 0.4
Query 217: 0.0991 at 0.70 0.1690
Query 218: 0.7111 at 0.80 0.1612
Query 219: 0.0000 at 0.90 0.1502
Query 221: 0.7140 at 1.00 0.1389
Query 222: 0.0027 0.2
Query 223: 0.0769 Avg. prec. (non-interpolated)
Query 224: 0.0726 for all rel. documents
Query 225: 1.0000 0.2378
Query 226: 0.3594 Precision:
Query 228: 0.0380 At 5 docs: 0.2087 0.0
Query 229: 0.0022 At 10 docs: 0.1522 0.0 0.2 0.4 0.6 0.8 1.0
Query 230: 0.6238 At 15 docs: 0.1333
Query 231: 0.0048 At 20 docs: 0.1152 Recall
Query 232: 0.0006 At 30 docs: 0.0986
Query 233: 0.6487 At 100 docs: 0.0433
Query 234: 0.0220 At 200 docs: 0.0257 Run IRn−BEnPF−nexp
Query 235: 0.0000 At 500 docs: 0.0128
Query 236: 0.1493 At 1000 docs: 0.0072 Comparison to median by topic
Query 237: 1.0000 +1.0
Query 238: 0.0179 R-Precision (prec. after R
Query 239: 0.0188 (=num_rel) docs. retrieved):
Query 241: 0.0278 Exact: 0.2124
Query 242: 0.0172
Query 243: 0.2500
Query 244: 0.0769 +0.5
Query 245: 0.9167
Query 246: 0.0169
Query 247: 0.0131
Query 248: 0.1389
Query 249: 0.0518
Query 250: 0.0055
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Alicante, Bilingual English to Portuguese, Auto, TD Run IRn−BEnPF−Pexp
Average precision Overall statistics
(individual queries): (for 46 queries):
Recall−Precision Values
1.0
Query 201: 0.0255 Total number of documents
Query 202: 0.5344 over all queries
Query 203: 0.2175 Retrieved: 46000
Query 204: 0.4116 Relevant: 678
Query 205: 0.2692 Rel_ret: 337 0.8
Query 206: 0.3667
Query 207: 0.0087 Interpolated Recall -
Query 208: 0.4361 Precision Averages:
Query 209: 0.0000 at 0.00 0.3907
Query 210: 0.0000 at 0.10 0.3384 0.6
Query 211: 0.0794 at 0.20 0.3025
Query 212: 0.1649 at 0.30 0.2613
Query 213: 0.5473 at 0.40 0.2326
Precision
Query 214: 0.0000 at 0.50 0.2123
Query 215: 0.0286 at 0.60 0.1910 0.4
Query 217: 0.3147 at 0.70 0.1747
Query 218: 0.6478 at 0.80 0.1589
Query 219: 0.0000 at 0.90 0.1436
Query 221: 0.8968 at 1.00 0.1309
Query 222: 0.0000 0.2
Query 223: 0.1250 Avg. prec. (non-interpolated)
Query 224: 0.2667 for all rel. documents
Query 225: 0.2000 0.2173
Query 226: 0.2926 Precision:
Query 228: 0.0371 At 5 docs: 0.2348 0.0
Query 229: 0.0014 At 10 docs: 0.1674 0.0 0.2 0.4 0.6 0.8 1.0
Query 230: 0.4949 At 15 docs: 0.1464
Query 231: 0.0109 At 20 docs: 0.1293 Recall
Query 232: 0.0017 At 30 docs: 0.1058
Query 233: 0.6672 At 100 docs: 0.0457
Query 234: 0.0060 At 200 docs: 0.0267 Run IRn−BEnPF−Pexp
Query 235: 0.0000 At 500 docs: 0.0133
Query 236: 0.1208 At 1000 docs: 0.0073 Comparison to median by topic
Query 237: 1.0000 +1.0
Query 238: 0.0169 R-Precision (prec. after R
Query 239: 0.0448 (=num_rel) docs. retrieved):
Query 241: 0.0207 Exact: 0.1761
Query 242: 0.1000
Query 243: 0.2000
Query 244: 0.3333 +0.5
Query 245: 0.8056
Query 246: 0.0172
Query 247: 0.0125
Query 248: 0.2428
Query 249: 0.0236
Query 250: 0.0043
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Alicante, Bilingual English to Portuguese, Auto, TD Run IRn−BEnPM−nexp
Average precision Overall statistics
(individual queries): (for 46 queries):
Recall−Precision Values
1.0
Query 201: 0.0288 Total number of documents
Query 202: 0.3282 over all queries
Query 203: 0.1607 Retrieved: 46000
Query 204: 0.3393 Relevant: 678
Query 205: 0.5208 Rel_ret: 351 0.8
Query 206: 0.6250
Query 207: 0.0447 Interpolated Recall -
Query 208: 0.7326 Precision Averages:
Query 209: 0.0012 at 0.00 0.4788
Query 210: 0.3179 at 0.10 0.4397 0.6
Query 211: 0.7620 at 0.20 0.4190
Query 212: 0.2628 at 0.30 0.3776
Query 213: 0.5446 at 0.40 0.3308
Precision
Query 214: 0.0000 at 0.50 0.3134
Query 215: 0.0179 at 0.60 0.2573 0.4
Query 217: 0.0816 at 0.70 0.2243
Query 218: 0.7119 at 0.80 0.2089
Query 219: 0.0000 at 0.90 0.1880
Query 221: 0.7728 at 1.00 0.1633
Query 222: 0.0024 0.2
Query 223: 0.0909 Avg. prec. (non-interpolated)
Query 224: 0.2250 for all rel. documents
Query 225: 1.0000 0.2975
Query 226: 0.4570 Precision:
Query 228: 0.0189 At 5 docs: 0.2826 0.0
Query 229: 0.0039 At 10 docs: 0.2130 0.0 0.2 0.4 0.6 0.8 1.0
Query 230: 0.6455 At 15 docs: 0.1797
Query 231: 0.0122 At 20 docs: 0.1533 Recall
Query 232: 0.0007 At 30 docs: 0.1217
Query 233: 0.6510 At 100 docs: 0.0509
Query 234: 0.0179 At 200 docs: 0.0297 Run IRn−BEnPM−nexp
Query 235: 0.0000 At 500 docs: 0.0138
Query 236: 0.1163 At 1000 docs: 0.0076 Comparison to median by topic
Query 237: 1.0000 +1.0
Query 238: 0.0164 R-Precision (prec. after R
Query 239: 0.0507 (=num_rel) docs. retrieved):
Query 241: 0.0523 Exact: 0.2715
Query 242: 0.1520
Query 243: 0.2000
Query 244: 1.0000 +0.5
Query 245: 0.9167
Query 246: 0.0182
Query 247: 0.0154
Query 248: 0.7455
Query 249: 0.0257
Query 250: 0.0000
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Alicante, Bilingual English to Portuguese, Auto, TD Run IRn−BEnPM−Pexp
Average precision Overall statistics
(individual queries): (for 46 queries):
Recall−Precision Values
1.0
Query 201: 0.0208 Total number of documents
Query 202: 0.4764 over all queries
Query 203: 0.1222 Retrieved: 46000
Query 204: 0.3027 Relevant: 678
Query 205: 0.5200 Rel_ret: 361 0.8
Query 206: 0.2000
Query 207: 0.0490 Interpolated Recall -
Query 208: 0.6326 Precision Averages:
Query 209: 0.0013 at 0.00 0.5119
Query 210: 0.7208 at 0.10 0.4507 0.6
Query 211: 0.8057 at 0.20 0.4211
Query 212: 0.3217 at 0.30 0.3988
Query 213: 0.5623 at 0.40 0.3431
Precision
Query 214: 0.0000 at 0.50 0.3128
Query 215: 0.0455 at 0.60 0.2786 0.4
Query 217: 0.1249 at 0.70 0.2580
Query 218: 0.6570 at 0.80 0.2422
Query 219: 0.0000 at 0.90 0.2032
Query 221: 0.9333 at 1.00 0.1855
Query 222: 0.0017 0.2
Query 223: 0.1111 Avg. prec. (non-interpolated)
Query 224: 0.3250 for all rel. documents
Query 225: 1.0000 0.3123
Query 226: 0.6083 Precision:
Query 228: 0.0159 At 5 docs: 0.2783 0.0
Query 229: 0.0035 At 10 docs: 0.2130 0.0 0.2 0.4 0.6 0.8 1.0
Query 230: 0.5739 At 15 docs: 0.1797
Query 231: 0.0116 At 20 docs: 0.1598 Recall
Query 232: 0.0007 At 30 docs: 0.1232
Query 233: 0.6826 At 100 docs: 0.0528
Query 234: 0.0109 At 200 docs: 0.0303 Run IRn−BEnPM−Pexp
Query 235: 0.0000 At 500 docs: 0.0140
Query 236: 0.3967 At 1000 docs: 0.0078 Comparison to median by topic
Query 237: 1.0000 +1.0
Query 238: 0.0164 R-Precision (prec. after R
Query 239: 0.1076 (=num_rel) docs. retrieved):
Query 241: 0.0543 Exact: 0.2650
Query 242: 0.2103
Query 243: 0.2000
Query 244: 1.0000 +0.5
Query 245: 0.8056
Query 246: 0.0172
Query 247: 0.0154
Query 248: 0.6765
Query 249: 0.0249
Query 250: 0.0000
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Alicante, Bilingual Spanish to Portuguese, Auto, TD Run IRn−BEsPM−nexp
Average precision Overall statistics
(individual queries): (for 46 queries):
Recall−Precision Values
1.0
Query 201: 0.0498 Total number of documents
Query 202: 0.5892 over all queries
Query 203: 0.1187 Retrieved: 46000
Query 204: 0.3506 Relevant: 678
Query 205: 0.2083 Rel_ret: 398 0.8
Query 206: 0.6111
Query 207: 0.0051 Interpolated Recall -
Query 208: 0.9667 Precision Averages:
Query 209: 0.0007 at 0.00 0.4705
Query 210: 0.3958 at 0.10 0.4225 0.6
Query 211: 0.6470 at 0.20 0.3846
Query 212: 0.0000 at 0.30 0.3460
Query 213: 0.4649 at 0.40 0.3196
Precision
Query 214: 0.0487 at 0.50 0.3059
Query 215: 0.0099 at 0.60 0.2668 0.4
Query 217: 0.0349 at 0.70 0.2501
Query 218: 0.6707 at 0.80 0.2374
Query 219: 0.0000 at 0.90 0.2088
Query 221: 0.8302 at 1.00 0.1943
Query 222: 0.0008 0.2
Query 223: 0.1667 Avg. prec. (non-interpolated)
Query 224: 0.2262 for all rel. documents
Query 225: 1.0000 0.2977
Query 226: 0.1207 Precision:
Query 228: 0.0455 At 5 docs: 0.2522 0.0
Query 229: 0.0172 At 10 docs: 0.2022 0.0 0.2 0.4 0.6 0.8 1.0
Query 230: 0.5260 At 15 docs: 0.1681
Query 231: 0.0074 At 20 docs: 0.1467 Recall
Query 232: 0.0216 At 30 docs: 0.1196
Query 233: 0.5108 At 100 docs: 0.0507
Query 234: 0.0009 At 200 docs: 0.0308 Run IRn−BEsPM−nexp
Query 235: 0.0014 At 500 docs: 0.0150
Query 236: 0.4550 At 1000 docs: 0.0087 Comparison to median by topic
Query 237: 1.0000 +1.0
Query 238: 0.0141 R-Precision (prec. after R
Query 239: 0.0997 (=num_rel) docs. retrieved):
Query 241: 0.0184 Exact: 0.2752
Query 242: 0.0668
Query 243: 0.1667
Query 244: 1.0000 +0.5
Query 245: 1.0000
Query 246: 0.0196
Query 247: 0.9127
Query 248: 0.2893
Query 249: 0.0045
Query 250: 0.0000
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Alicante, Bilingual Spanish to Portuguese, Auto, TD Run IRn−BEsPM−Pexp
Average precision Overall statistics
(individual queries): (for 46 queries):
Recall−Precision Values
1.0
Query 201: 0.0306 Total number of documents
Query 202: 0.6831 over all queries
Query 203: 0.1543 Retrieved: 46000
Query 204: 0.3522 Relevant: 678
Query 205: 0.1394 Rel_ret: 416 0.8
Query 206: 0.1909
Query 207: 0.0058 Interpolated Recall -
Query 208: 1.0000 Precision Averages:
Query 209: 0.0007 at 0.00 0.4699
Query 210: 0.7012 at 0.10 0.4473 0.6
Query 211: 0.7131 at 0.20 0.4077
Query 212: 0.0000 at 0.30 0.3668
Query 213: 0.6233 at 0.40 0.3408
Precision
Query 214: 0.0870 at 0.50 0.3315
Query 215: 0.0238 at 0.60 0.3076 0.4
Query 217: 0.0385 at 0.70 0.2777
Query 218: 0.6262 at 0.80 0.2628
Query 219: 0.0000 at 0.90 0.2345
Query 221: 0.8968 at 1.00 0.2159
Query 222: 0.0008 0.2
Query 223: 0.1667 Avg. prec. (non-interpolated)
Query 224: 0.3667 for all rel. documents
Query 225: 1.0000 0.3243
Query 226: 0.1467 Precision:
Query 228: 0.1479 At 5 docs: 0.3043 0.0
Query 229: 0.0151 At 10 docs: 0.2174 0.0 0.2 0.4 0.6 0.8 1.0
Query 230: 0.6188 At 15 docs: 0.1739
Query 231: 0.0060 At 20 docs: 0.1565 Recall
Query 232: 0.0233 At 30 docs: 0.1283
Query 233: 0.6185 At 100 docs: 0.0561
Query 234: 0.0008 At 200 docs: 0.0330 Run IRn−BEsPM−Pexp
Query 235: 0.0061 At 500 docs: 0.0160
Query 236: 0.5625 At 1000 docs: 0.0090 Comparison to median by topic
Query 237: 1.0000 +1.0
Query 238: 0.0143 R-Precision (prec. after R
Query 239: 0.0822 (=num_rel) docs. retrieved):
Query 241: 0.0145 Exact: 0.2888
Query 242: 0.1659
Query 243: 0.2000
Query 244: 1.0000 +0.5
Query 245: 1.0000
Query 246: 0.0161
Query 247: 1.0000
Query 248: 0.4715
Query 249: 0.0091
Query 250: 0.0000
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Amsterdam, Bilingual English to Portuguese, Auto, TD Run UAmsC04EnPo4GiSb
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 46 queries): 1.0
Query 201: 0.0140 Total number of documents
Query 202: 0.8211 over all queries
Query 203: 0.3287 Retrieved: 46000
Query 204: 0.5158 Relevant: 678
Query 205: 0.4167 Rel_ret: 546
0.8
Query 206: 0.6250
Query 207: 0.1378 Interpolated Recall -
Query 208: 0.8143 Precision Averages:
Query 209: 0.0746 at 0.00 0.5542
Query 210: 0.8850 at 0.10 0.5257 0.6
Query 211: 0.9277 at 0.20 0.5069
Query 212: 0.5298 at 0.30 0.4910
Query 213: 0.7698 at 0.40 0.4481
Precision
Query 214: 0.0265 at 0.50 0.4098
Query 215: 0.2000 at 0.60 0.3601 0.4
Query 217: 0.9571 at 0.70 0.3220
Query 218: 0.8052 at 0.80 0.3022
Query 219: 0.0310 at 0.90 0.2495
Query 221: 0.9242 at 1.00 0.2326
Query 222: 0.0073 0.2
Query 223: 0.5000 Avg. prec. (non-interpolated)
Query 224: 0.2083 for all rel. documents
Query 225: 0.0244 0.3850
Query 226: 0.5250 Precision:
Query 228: 0.0138 At 5 docs: 0.3870 0.0
Query 229: 0.4195 At 10 docs: 0.3043 0.0 0.2 0.4 0.6 0.8 1.0
Query 230: 0.4746 At 15 docs: 0.2478
Query 231: 0.0038 At 20 docs: 0.2130 Recall
Query 232: 0.1087 At 30 docs: 0.1703
Query 233: 0.5504 At 100 docs: 0.0780
Query 234: 0.0000 At 200 docs: 0.0470 Run UAmsC04EnPo4GiSb
Query 235: 0.0115 At 500 docs: 0.0219 Comparison to median by topic
Query 236: 0.3934 At 1000 docs: 0.0119
Query 237: 1.0000 +1.0
Query 238: 0.0667 R-Precision (prec. after R
Query 239: 0.1945 (=num_rel) docs. retrieved):
Query 241: 0.0872 Exact: 0.3399
Query 242: 0.2396
Query 243: 0.1667
Query 244: 0.0769 +0.5
Query 245: 1.0000
Query 246: 0.2000
Query 247: 1.0000
Query 248: 0.4474
Query 249: 0.1532
Query 250: 0.0338
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Amsterdam, Bilingual English to Portuguese, Auto, TD Run UAmsC04EnPo4iSPC
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 46 queries): 1.0
Query 201: 0.0026 Total number of documents
Query 202: 0.7639 over all queries
Query 203: 0.2901 Retrieved: 46000
Query 204: 0.5278 Relevant: 678
Query 205: 0.3333 Rel_ret: 508
0.8
Query 206: 0.1875
Query 207: 0.1939 Interpolated Recall -
Query 208: 0.0997 Precision Averages:
Query 209: 0.0013 at 0.00 0.4099
Query 210: 0.8048 at 0.10 0.3776 0.6
Query 211: 0.9050 at 0.20 0.3612
Query 212: 0.0010 at 0.30 0.3404
Query 213: 0.5947 at 0.40 0.3162
Precision
Query 214: 0.0012 at 0.50 0.2946
Query 215: 0.0105 at 0.60 0.2589 0.4
Query 217: 0.0020 at 0.70 0.2172
Query 218: 0.8228 at 0.80 0.2033
Query 219: 0.0000 at 0.90 0.1738
Query 221: 0.4667 at 1.00 0.1560
Query 222: 0.0029 0.2
Query 223: 0.5000 Avg. prec. (non-interpolated)
Query 224: 0.0134 for all rel. documents
Query 225: 0.1111 0.2755
Query 226: 0.0822 Precision:
Query 228: 0.0261 At 5 docs: 0.2870 0.0
Query 229: 0.8122 At 10 docs: 0.2391 0.0 0.2 0.4 0.6 0.8 1.0
Query 230: 0.4797 At 15 docs: 0.2000
Query 231: 0.0000 At 20 docs: 0.1761 Recall
Query 232: 0.2492 At 30 docs: 0.1428
Query 233: 0.0007 At 100 docs: 0.0707
Query 234: 0.0000 At 200 docs: 0.0439 Run UAmsC04EnPo4iSPC
Query 235: 0.0000 At 500 docs: 0.0208 Comparison to median by topic
Query 236: 0.1280 At 1000 docs: 0.0110
Query 237: 1.0000 +1.0
Query 238: 0.0625 R-Precision (prec. after R
Query 239: 0.0715 (=num_rel) docs. retrieved):
Query 241: 0.0018 Exact: 0.2159
Query 242: 0.2579
Query 243: 0.0909
Query 244: 0.3333 +0.5
Query 245: 0.8667
Query 246: 0.2000
Query 247: 1.0000
Query 248: 0.2395
Query 249: 0.0775
Query 250: 0.0566
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Amsterdam, Bilingual English to Portuguese, Auto, TD Run UAmsC04EnPo4iSWL
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 46 queries): 1.0
Query 201: 0.0112 Total number of documents
Query 202: 0.8235 over all queries
Query 203: 0.2158 Retrieved: 46000
Query 204: 0.6443 Relevant: 678
Query 205: 0.3409 Rel_ret: 404
0.8
Query 206: 0.2111
Query 207: 0.0035 Interpolated Recall -
Query 208: 0.7209 Precision Averages:
Query 209: 0.0037 at 0.00 0.4241
Query 210: 0.7869 at 0.10 0.4191 0.6
Query 211: 0.9109 at 0.20 0.3960
Query 212: 0.0769 at 0.30 0.3882
Query 213: 0.7410 at 0.40 0.3767
Precision
Query 214: 0.0171 at 0.50 0.3492
Query 215: 0.0137 at 0.60 0.3054 0.4
Query 217: 0.0125 at 0.70 0.2804
Query 218: 0.8034 at 0.80 0.2503
Query 219: 0.0088 at 0.90 0.2222
Query 221: 0.9484 at 1.00 0.2058
Query 222: 0.0000 0.2
Query 223: 0.5000 Avg. prec. (non-interpolated)
Query 224: 0.7500 for all rel. documents
Query 225: 0.1667 0.3207
Query 226: 0.9500 Precision:
Query 228: 0.0065 At 5 docs: 0.3087 0.0
Query 229: 0.0243 At 10 docs: 0.2370 0.0 0.2 0.4 0.6 0.8 1.0
Query 230: 0.5219 At 15 docs: 0.1986
Query 231: 0.0023 At 20 docs: 0.1707 Recall
Query 232: 0.0519 At 30 docs: 0.1406
Query 233: 0.4894 At 100 docs: 0.0602
Query 234: 0.0433 At 200 docs: 0.0347 Run UAmsC04EnPo4iSWL
Query 235: 0.0000 At 500 docs: 0.0160 Comparison to median by topic
Query 236: 0.1152 At 1000 docs: 0.0088
Query 237: 1.0000 +1.0
Query 238: 0.0400 R-Precision (prec. after R
Query 239: 0.1440 (=num_rel) docs. retrieved):
Query 241: 0.0114 Exact: 0.2567
Query 242: 0.3126
Query 243: 0.1111
Query 244: 0.2000 +0.5
Query 245: 0.2778
Query 246: 0.2000
Query 247: 1.0000
Query 248: 0.5202
Query 249: 0.0204
Query 250: 0.0000
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Amsterdam, Bilingual English to Portuguese, Auto, TD Run UAmsC04EnPoAll
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 46 queries): 1.0
Query 201: 0.0110 Total number of documents
Query 202: 0.8113 over all queries
Query 203: 0.3778 Retrieved: 46000
Query 204: 0.7459 Relevant: 678
Query 205: 0.5000 Rel_ret: 581
0.8
Query 206: 0.6250
Query 207: 0.1296 Interpolated Recall -
Query 208: 0.8393 Precision Averages:
Query 209: 0.0759 at 0.00 0.6131
Query 210: 0.8600 at 0.10 0.5768 0.6
Query 211: 0.9379 at 0.20 0.5444
Query 212: 0.3782 at 0.30 0.5174
Query 213: 0.8005 at 0.40 0.4853
Precision
Query 214: 0.0059 at 0.50 0.4635
Query 215: 0.2500 at 0.60 0.4197 0.4
Query 217: 0.8240 at 0.70 0.3672
Query 218: 0.8337 at 0.80 0.3416
Query 219: 0.0036 at 0.90 0.3056
Query 221: 0.9107 at 1.00 0.2827
Query 222: 0.0047 0.2
Query 223: 0.5000 Avg. prec. (non-interpolated)
Query 224: 0.3667 for all rel. documents
Query 225: 1.0000 0.4366
Query 226: 0.6917 Precision:
Query 228: 0.0960 At 5 docs: 0.4217 0.0
Query 229: 0.7764 At 10 docs: 0.3239 0.0 0.2 0.4 0.6 0.8 1.0
Query 230: 0.5436 At 15 docs: 0.2565
Query 231: 0.0012 At 20 docs: 0.2239 Recall
Query 232: 0.2365 At 30 docs: 0.1848
Query 233: 0.5451 At 100 docs: 0.0893
Query 234: 0.0130 At 200 docs: 0.0536 Run UAmsC04EnPoAll
Query 235: 0.0032 At 500 docs: 0.0239 Comparison to median by topic
Query 236: 0.3981 At 1000 docs: 0.0126
Query 237: 1.0000 +1.0
Query 238: 0.0526 R-Precision (prec. after R
Query 239: 0.1781 (=num_rel) docs. retrieved):
Query 241: 0.0543 Exact: 0.3656
Query 242: 0.2270
Query 243: 0.1250
Query 244: 0.3333 +0.5
Query 245: 1.0000
Query 246: 0.3333
Query 247: 1.0000
Query 248: 0.5439
Query 249: 0.0976
Query 250: 0.0436
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Université de Neuchâtel, Bilingual English to Portuguese, Auto, TD Run UniNEBpt1
Average precision Overall statistics
(individual queries): (for 46 queries):
Recall−Precision Values
1.0
Query 201: 0.0350 Total number of documents
Query 202: 0.8565 over all queries
Query 203: 0.4145 Retrieved: 46000
Query 204: 0.8632 Relevant: 678
Query 205: 0.2333 Rel_ret: 433 0.8
Query 206: 0.7500
Query 207: 0.1651 Interpolated Recall -
Query 208: 1.0000 Precision Averages:
Query 209: 0.0009 at 0.00 0.5844
Query 210: 0.8767 at 0.10 0.5740 0.6
Query 211: 0.9188 at 0.20 0.5475
Query 212: 0.4273 at 0.30 0.5301
Query 213: 0.7301 at 0.40 0.5240
Precision
Query 214: 0.0074 at 0.50 0.4976
Query 215: 0.1111 at 0.60 0.4411 0.4
Query 217: 0.6114 at 0.70 0.4263
Query 218: 0.8305 at 0.80 0.4158
Query 219: 0.0096 at 0.90 0.3992
Query 221: 0.8972 at 1.00 0.3645
Query 222: 0.0272 0.2
Query 223: 1.0000 Avg. prec. (non-interpolated)
Query 224: 1.0000 for all rel. documents
Query 225: 0.1429 0.4704
Query 226: 1.0000 Precision:
Query 228: 0.2856 At 5 docs: 0.4043 0.0
Query 229: 0.0007 At 10 docs: 0.3239 0.0 0.2 0.4 0.6 0.8 1.0
Query 230: 0.4170 At 15 docs: 0.2536
Query 231: 0.0008 At 20 docs: 0.2185 Recall
Query 232: 0.1190 At 30 docs: 0.1732
Query 233: 0.8114 At 100 docs: 0.0683
Query 234: 0.3667 At 200 docs: 0.0386 Run UniNEBpt1
Query 235: 0.0021 At 500 docs: 0.0176
Query 236: 1.0000 At 1000 docs: 0.0094 Comparison to median by topic
Query 237: 1.0000 +1.0
Query 238: 0.0526 R-Precision (prec. after R
Query 239: 0.1524 (=num_rel) docs. retrieved):
Query 241: 0.0048 Exact: 0.4352
Query 242: 0.4266
Query 243: 0.1667
Query 244: 0.0061 +0.5
Query 245: 1.0000
Query 246: 1.0000
Query 247: 1.0000
Query 248: 0.6705
Query 249: 0.2289
Query 250: 0.0174
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Université de Neuchâtel, Bilingual English to Portuguese, Auto, TD Run UniNEBpt2
Average precision Overall statistics
(individual queries): (for 46 queries):
Recall−Precision Values
1.0
Query 201: 0.0333 Total number of documents
Query 202: 0.8471 over all queries
Query 203: 0.3940 Retrieved: 46000
Query 204: 0.8632 Relevant: 678
Query 205: 0.6111 Rel_ret: 434 0.8
Query 206: 0.7000
Query 207: 0.1943 Interpolated Recall -
Query 208: 1.0000 Precision Averages:
Query 209: 0.0011 at 0.00 0.5704
Query 210: 0.8767 at 0.10 0.5607 0.6
Query 211: 0.9090 at 0.20 0.5273
Query 212: 0.4133 at 0.30 0.5141
Query 213: 0.7287 at 0.40 0.5052
Precision
Query 214: 0.0056 at 0.50 0.4832
Query 215: 0.1000 at 0.60 0.4221 0.4
Query 217: 0.3176 at 0.70 0.4025
Query 218: 0.8324 at 0.80 0.3874
Query 219: 0.0098 at 0.90 0.3759
Query 221: 0.9151 at 1.00 0.3370
Query 222: 0.0203 0.2
Query 223: 1.0000 Avg. prec. (non-interpolated)
Query 224: 1.0000 for all rel. documents
Query 225: 0.1429 0.4491
Query 226: 1.0000 Precision:
Query 228: 0.0859 At 5 docs: 0.3826 0.0
Query 229: 0.0020 At 10 docs: 0.3087 0.0 0.2 0.4 0.6 0.8 1.0
Query 230: 0.4612 At 15 docs: 0.2478
Query 231: 0.0020 At 20 docs: 0.2141 Recall
Query 232: 0.1321 At 30 docs: 0.1681
Query 233: 0.8096 At 100 docs: 0.0663
Query 234: 0.3667 At 200 docs: 0.0378 Run UniNEBpt2
Query 235: 0.0000 At 500 docs: 0.0176
Query 236: 0.9167 At 1000 docs: 0.0094 Comparison to median by topic
Query 237: 1.0000 +1.0
Query 238: 0.0500 R-Precision (prec. after R
Query 239: 0.1517 (=num_rel) docs. retrieved):
Query 241: 0.0070 Exact: 0.3963
Query 242: 0.4512
Query 243: 0.1429
Query 244: 0.0112 +0.5
Query 245: 1.0000
Query 246: 0.3333
Query 247: 1.0000
Query 248: 0.6400
Query 249: 0.1767
Query 250: 0.0034
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
JHU/APL, Bilingual English to Russian, Auto, TD Run aplbibgrub
Average precision Overall statistics
(individual queries): (for 34 queries):
Recall−Precision Values
1.0
Query 201: 0.0015 Total number of documents
Query 202: 0.0164 over all queries
Query 203: 0.0000 Retrieved: 34000
Query 207: 0.0000 Relevant: 123
Query 209: 0.0169 Rel_ret: 81 0.8
Query 210: 0.2358
Query 211: 1.0000 Interpolated Recall -
Query 212: 0.0481 Precision Averages:
Query 213: 0.2870 at 0.00 0.2516
Query 214: 0.0410 at 0.10 0.2369 0.6
Query 215: 0.0000 at 0.20 0.2267
Query 216: 0.0000 at 0.30 0.2030
Query 218: 0.1667 at 0.40 0.1818
Precision
Query 220: 0.0000 at 0.50 0.1663
Query 221: 0.2582 at 0.60 0.0890 0.4
Query 224: 0.5000 at 0.70 0.0771
Query 225: 0.0000 at 0.80 0.0756
Query 226: 0.0033 at 0.90 0.0686
Query 227: 0.0000 at 1.00 0.0680
Query 228: 0.0012 0.2
Query 230: 0.4102 Avg. prec. (non-interpolated)
Query 231: 0.0192 for all rel. documents
Query 232: 0.0003 0.1407
Query 233: 0.0064 Precision:
Query 234: 0.0010 At 5 docs: 0.1059 0.0
Query 235: 0.0014 At 10 docs: 0.0647 0.0 0.2 0.4 0.6 0.8 1.0
Query 237: 0.3750 At 15 docs: 0.0510
Query 238: 0.0135 At 20 docs: 0.0426 Recall
Query 239: 0.1097 At 30 docs: 0.0373
Query 241: 0.2107 At 100 docs: 0.0153
Query 242: 0.0312 At 200 docs: 0.0091 Run aplbibgrub
Query 244: 1.0000 At 500 docs: 0.0042
Query 245: 0.0279 At 1000 docs: 0.0024 Comparison to median by topic
Query 250: 0.0000 +1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.1505
+0.5
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
UC Berkeley, Bilingual Chinese to Russian, Auto, TD Run BKRUBLCR1
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 34 queries): 1.0
Query 201: 0.0000 Total number of documents
Query 202: 0.0005 over all queries
Query 203: 0.0164 Retrieved: 34000
Query 207: 0.0000 Relevant: 123
Query 209: 0.0368 Rel_ret: 57
0.8
Query 210: 0.6738
Query 211: 0.0476 Interpolated Recall -
Query 212: 0.0143 Precision Averages:
Query 213: 0.0001 at 0.00 0.1659
Query 214: 0.8667 at 0.10 0.1659 0.6
Query 215: 0.0033 at 0.20 0.1559
Query 216: 0.0000 at 0.30 0.1167
Query 218: 0.0029 at 0.40 0.1137
Precision
Query 220: 0.0007 at 0.50 0.1051
Query 221: 0.5833 at 0.60 0.0844 0.4
Query 224: 0.0014 at 0.70 0.0704
Query 225: 0.1328 at 0.80 0.0551
Query 226: 0.0000 at 0.90 0.0540
Query 227: 0.0013 at 1.00 0.0540
Query 228: 0.0030 0.2
Query 230: 0.2474 Avg. prec. (non-interpolated)
Query 231: 0.0141 for all rel. documents
Query 232: 0.0003 0.0956
Query 233: 0.2173 Precision:
Query 234: 0.0000 At 5 docs: 0.0765 0.0
Query 235: 0.0987 At 10 docs: 0.0471 0.0 0.2 0.4 0.6 0.8 1.0
Query 237: 0.0000 At 15 docs: 0.0373
Query 238: 0.0000 At 20 docs: 0.0294 Recall
Query 239: 0.0067 At 30 docs: 0.0216
Query 241: 0.0022 At 100 docs: 0.0085
Query 242: 0.0278 At 200 docs: 0.0053 Run BKRUBLCR1
Query 244: 0.2500 At 500 docs: 0.0030 Comparison to median by topic
Query 245: 0.0000 At 1000 docs: 0.0017
Query 250: 0.0000 +1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.0696
+0.5
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
UC Berkeley, Bilingual Chinese to Russian, Auto, TDN Run BKRUBLCR2
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 34 queries): 1.0
Query 201: 0.0000 Total number of documents
Query 202: 0.0005 over all queries
Query 203: 0.0200 Retrieved: 34000
Query 207: 0.0000 Relevant: 123
Query 209: 0.0250 Rel_ret: 68
0.8
Query 210: 0.5513
Query 211: 0.0482 Interpolated Recall -
Query 212: 0.0186 Precision Averages:
Query 213: 0.0028 at 0.00 0.1924
Query 214: 0.8667 at 0.10 0.1924 0.6
Query 215: 0.0024 at 0.20 0.1822
Query 216: 0.0000 at 0.30 0.1417
Query 218: 0.0011 at 0.40 0.1414
Precision
Query 220: 0.0022 at 0.50 0.1215
Query 221: 0.5833 at 0.60 0.1077 0.4
Query 224: 0.0020 at 0.70 0.0921
Query 225: 0.1885 at 0.80 0.0782
Query 226: 0.0000 at 0.90 0.0776
Query 227: 0.0094 at 1.00 0.0776
Query 228: 0.0022 0.2
Query 230: 0.2604 Avg. prec. (non-interpolated)
Query 231: 0.0047 for all rel. documents
Query 232: 0.0006 0.1197
Query 233: 0.2878 Precision:
Query 234: 0.0000 At 5 docs: 0.0706 0.0
Query 235: 0.0419 At 10 docs: 0.0500 0.0 0.2 0.4 0.6 0.8 1.0
Query 237: 0.0365 At 15 docs: 0.0412
Query 238: 0.0189 At 20 docs: 0.0353 Recall
Query 239: 0.0244 At 30 docs: 0.0255
Query 241: 0.0026 At 100 docs: 0.0091
Query 242: 0.0667 At 200 docs: 0.0062 Run BKRUBLCR2
Query 244: 1.0000 At 500 docs: 0.0034 Comparison to median by topic
Query 245: 0.0010 At 1000 docs: 0.0020
Query 250: 0.0000 +1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.0990
+0.5
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
UC Berkeley, Bilingual English to Russian, Auto, TDN Run BKRUBLER1
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 34 queries): 1.0
Query 201: 0.0010 Total number of documents
Query 202: 0.0009 over all queries
Query 203: 0.0025 Retrieved: 34000
Query 207: 0.0087 Relevant: 123 0.8
Query 209: 0.0030 Rel_ret: 69
Query 210: 0.3151
Query 211: 0.8333 Interpolated Recall -
Query 212: 0.0070 Precision Averages:
Query 213: 0.0005 at 0.00 0.2444
Query 214: 0.4623 at 0.10 0.2430 0.6
Query 215: 0.0038 at 0.20 0.2423
Query 216: 0.5000 at 0.30 0.1809
Query 218: 0.0294 at 0.40 0.1563
Precision
Query 220: 0.0000 at 0.50 0.1445
Query 221: 0.5833 at 0.60 0.0896 0.4
Query 224: 0.1250 at 0.70 0.0796
Query 225: 0.1027 at 0.80 0.0771
Query 226: 0.0014 at 0.90 0.0764
Query 227: 0.0088 at 1.00 0.0764
Query 228: 0.0027 0.2
Query 230: 0.1511 Avg. prec. (non-interpolated)
Query 231: 0.0074 for all rel. documents
Query 232: 0.0002 0.1361
Query 233: 0.2416 Precision:
Query 234: 0.0000 At 5 docs: 0.0765 0.0
Query 235: 0.1444 At 10 docs: 0.0500 0.0 0.2 0.4 0.6 0.8 1.0
Query 237: 0.0290 At 15 docs: 0.0412
Query 238: 0.0128 At 20 docs: 0.0338 Recall
Query 239: 0.0039 At 30 docs: 0.0255
Query 241: 0.0101 At 100 docs: 0.0097
Query 242: 0.0323 At 200 docs: 0.0054 Run BKRUBLER1
Query 244: 1.0000 At 500 docs: 0.0033 Comparison to median by topic
Query 245: 0.0019 At 1000 docs: 0.0020
Query 250: 0.0000 +1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.1127
+0.5
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
UC Berkeley, Bilingual English to Russian, Auto, TDN Run BKRUBLER2
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 34 queries): 1.0
Query 201: 0.0288 Total number of documents
Query 202: 0.0008 over all queries
Query 203: 0.0061 Retrieved: 34000
Query 207: 0.0000 Relevant: 123 0.8
Query 209: 0.0007 Rel_ret: 85
Query 210: 0.0016
Query 211: 1.0000 Interpolated Recall -
Query 212: 0.0846 Precision Averages:
Query 213: 0.0054 at 0.00 0.2965
Query 214: 0.0050 at 0.10 0.2965 0.6
Query 215: 0.2000 at 0.20 0.2806
Query 216: 0.5000 at 0.30 0.2269
Query 218: 0.0027 at 0.40 0.2205
Precision
Query 220: 0.0751 at 0.50 0.1976
Query 221: 0.5222 at 0.60 0.0940 0.4
Query 224: 0.0383 at 0.70 0.0813
Query 225: 0.0052 at 0.80 0.0806
Query 226: 0.0000 at 0.90 0.0802
Query 227: 0.5000 at 1.00 0.0797
Query 228: 0.0016 0.2
Query 230: 0.2160 Avg. prec. (non-interpolated)
Query 231: 1.0000 for all rel. documents
Query 232: 0.4792 0.1638
Query 233: 0.1171 Precision:
Query 234: 0.0000 At 5 docs: 0.1059 0.0
Query 235: 0.2011 At 10 docs: 0.0647 0.0 0.2 0.4 0.6 0.8 1.0
Query 237: 0.0020 At 15 docs: 0.0529
Query 238: 0.0012 At 20 docs: 0.0426 Recall
Query 239: 0.4001 At 30 docs: 0.0314
Query 241: 0.0779 At 100 docs: 0.0144
Query 242: 0.0250 At 200 docs: 0.0085 Run BKRUBLER2
Query 244: 0.0714 At 500 docs: 0.0044 Comparison to median by topic
Query 245: 0.0014 At 1000 docs: 0.0025
Query 250: 0.0000 +1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.1609
+0.5
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
UC Berkeley, Bilingual English to Russian, Auto, TD Run BKRUBLER3
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 34 queries): 1.0
Query 201: 0.0000 Total number of documents
Query 202: 0.3603 over all queries
Query 203: 1.0000 Retrieved: 34000
Query 207: 0.0000 Relevant: 123 0.8
Query 209: 0.3088 Rel_ret: 98
Query 210: 0.3958
Query 211: 1.0000 Interpolated Recall -
Query 212: 0.2420 Precision Averages:
Query 213: 0.3755 at 0.00 0.5158
Query 214: 0.1144 at 0.10 0.5147 0.6
Query 215: 0.3333 at 0.20 0.4951
Query 216: 0.0000 at 0.30 0.4328
Query 218: 0.2500 at 0.40 0.3617
Precision
Query 220: 0.0014 at 0.50 0.3470
Query 221: 0.8333 at 0.60 0.2648 0.4
Query 224: 0.5052 at 0.70 0.2268
Query 225: 0.4206 at 0.80 0.2145
Query 226: 0.0025 at 0.90 0.1997
Query 227: 0.0058 at 1.00 0.1997
Query 228: 0.2500 0.2
Query 230: 0.2461 Avg. prec. (non-interpolated)
Query 231: 0.3333 for all rel. documents
Query 232: 0.0288 0.3291
Query 233: 0.2641 Precision:
Query 234: 0.4556 At 5 docs: 0.1824 0.0
Query 235: 0.0012 At 10 docs: 0.1147 0.0 0.2 0.4 0.6 0.8 1.0
Query 237: 0.3500 At 15 docs: 0.0922
Query 238: 1.0000 At 20 docs: 0.0750 Recall
Query 239: 0.3188 At 30 docs: 0.0559
Query 241: 0.1066 At 100 docs: 0.0226
Query 242: 0.0189 At 200 docs: 0.0125 Run BKRUBLER3
Query 244: 1.0000 At 500 docs: 0.0054 Comparison to median by topic
Query 245: 0.6667 At 1000 docs: 0.0029
Query 250: 0.0000 +1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.3010
+0.5
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
UC Berkeley, Bilingual English to Russian, Auto, TDN Run BKRUBLER4
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 34 queries): 1.0
Query 201: 0.0013 Total number of documents
Query 202: 0.3562 over all queries
Query 203: 0.0909 Retrieved: 34000
Query 207: 0.0000 Relevant: 123 0.8
Query 209: 0.3929 Rel_ret: 93
Query 210: 0.3574
Query 211: 1.0000 Interpolated Recall -
Query 212: 0.0093 Precision Averages:
Query 213: 0.3340 at 0.00 0.4575
Query 214: 0.0233 at 0.10 0.4575 0.6
Query 215: 0.2000 at 0.20 0.4493
Query 216: 0.0000 at 0.30 0.4281
Query 218: 0.2500 at 0.40 0.3239
Precision
Query 220: 0.0716 at 0.50 0.2932
Query 221: 0.8333 at 0.60 0.1990 0.4
Query 224: 0.1037 at 0.70 0.1907
Query 225: 0.4206 at 0.80 0.1782
Query 226: 0.0030 at 0.90 0.1629
Query 227: 0.5000 at 1.00 0.1629
Query 228: 0.3333 0.2
Query 230: 0.1731 Avg. prec. (non-interpolated)
Query 231: 1.0000 for all rel. documents
Query 232: 0.1084 0.2850
Query 233: 0.2574 Precision:
Query 234: 0.3434 At 5 docs: 0.1824 0.0
Query 235: 0.0004 At 10 docs: 0.1206 0.0 0.2 0.4 0.6 0.8 1.0
Query 237: 0.3333 At 15 docs: 0.0961
Query 238: 0.2500 At 20 docs: 0.0750 Recall
Query 239: 0.4583 At 30 docs: 0.0539
Query 241: 0.0869 At 100 docs: 0.0212
Query 242: 0.0303 At 200 docs: 0.0116 Run BKRUBLER4
Query 244: 1.0000 At 500 docs: 0.0052 Comparison to median by topic
Query 245: 0.3667 At 1000 docs: 0.0027
Query 250: 0.0000 +1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.2575
+0.5
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
UC Berkeley, Bilingual English to Russian, Auto, TD Run BKRUBLJR1
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 34 queries): 1.0
Query 201: 0.0000 Total number of documents
Query 202: 0.0008 over all queries
Query 203: 0.0045 Retrieved: 34000
Query 207: 0.0000 Relevant: 123 0.8
Query 209: 0.0058 Rel_ret: 64
Query 210: 0.6738
Query 211: 0.4167 Interpolated Recall -
Query 212: 0.5216 Precision Averages:
Query 213: 0.0021 at 0.00 0.2036
Query 214: 0.0005 at 0.10 0.2036 0.6
Query 215: 0.0040 at 0.20 0.1888
Query 216: 0.0000 at 0.30 0.1689
Query 218: 0.0057 at 0.40 0.1607
Precision
Query 220: 0.0000 at 0.50 0.1288
Query 221: 0.8333 at 0.60 0.0858 0.4
Query 224: 0.0455 at 0.70 0.0808
Query 225: 0.1611 at 0.80 0.0653
Query 226: 0.0179 at 0.90 0.0611
Query 227: 0.0026 at 1.00 0.0611
Query 228: 0.0030 0.2
Query 230: 0.2550 Avg. prec. (non-interpolated)
Query 231: 0.0156 for all rel. documents
Query 232: 0.0000 0.1166
Query 233: 0.0583 Precision:
Query 234: 0.0000 At 5 docs: 0.1000 0.0
Query 235: 0.4012 At 10 docs: 0.0647 0.0 0.2 0.4 0.6 0.8 1.0
Query 237: 0.3750 At 15 docs: 0.0510
Query 238: 0.0059 At 20 docs: 0.0426 Recall
Query 239: 0.0869 At 30 docs: 0.0294
Query 241: 0.0027 At 100 docs: 0.0115
Query 242: 0.0556 At 200 docs: 0.0065 Run BKRUBLJR1
Query 244: 0.0078 At 500 docs: 0.0034 Comparison to median by topic
Query 245: 0.0000 At 1000 docs: 0.0019
Query 250: 0.0000 +1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.0853
+0.5
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
UC Berkeley, Bilingual English to Russian, Auto, TDN Run BKRUBLJR2
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 34 queries): 1.0
Query 201: 0.0000 Total number of documents
Query 202: 0.0020 over all queries
Query 203: 0.0024 Retrieved: 34000
Query 207: 0.0000 Relevant: 123 0.8
Query 209: 0.0037 Rel_ret: 67
Query 210: 0.4668
Query 211: 0.4167 Interpolated Recall -
Query 212: 0.0648 Precision Averages:
Query 213: 0.0021 at 0.00 0.1709
Query 214: 0.0019 at 0.10 0.1709 0.6
Query 215: 0.0028 at 0.20 0.1699
Query 216: 0.0007 at 0.30 0.1249
Query 218: 0.0017 at 0.40 0.1185
Precision
Query 220: 0.0016 at 0.50 0.1130
Query 221: 0.5833 at 0.60 0.0898 0.4
Query 224: 0.0714 at 0.70 0.0846
Query 225: 0.0785 at 0.80 0.0726
Query 226: 0.0018 at 0.90 0.0701
Query 227: 0.0028 at 1.00 0.0701
Query 228: 0.0023 0.2
Query 230: 0.1935 Avg. prec. (non-interpolated)
Query 231: 0.0043 for all rel. documents
Query 232: 0.0006 0.1050
Query 233: 0.0903 Precision:
Query 234: 0.0000 At 5 docs: 0.0765 0.0
Query 235: 0.0764 At 10 docs: 0.0500 0.0 0.2 0.4 0.6 0.8 1.0
Query 237: 0.3750 At 15 docs: 0.0373
Query 238: 0.0000 At 20 docs: 0.0309 Recall
Query 239: 0.0721 At 30 docs: 0.0255
Query 241: 0.0017 At 100 docs: 0.0103
Query 242: 0.0500 At 200 docs: 0.0060 Run BKRUBLJR2
Query 244: 1.0000 At 500 docs: 0.0032 Comparison to median by topic
Query 245: 0.0006 At 1000 docs: 0.0020
Query 250: 0.0000 +1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.0868
+0.5
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
CLIPS, Bilingual English to Russian, Auto, TDN Run CLIPS04ENRU1
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 34 queries): 1.0
Query 201: 0.0004 Total number of documents
Query 202: 0.0076 over all queries
Query 203: 0.0000 Retrieved: 33001
Query 207: 0.0000 Relevant: 123
Query 209: 0.0231 Rel_ret: 73
0.8
Query 210: 0.4515
Query 211: 0.2429 Interpolated Recall -
Query 212: 0.0007 Precision Averages:
Query 213: 0.0281 at 0.00 0.1710
Query 214: 0.0000 at 0.10 0.1710 0.6
Query 215: 0.5000 at 0.20 0.1444
Query 216: 0.0078 at 0.30 0.1194
Query 218: 0.0079 at 0.40 0.1150
Precision
Query 220: 0.0019 at 0.50 0.1113
Query 221: 0.0814 at 0.60 0.0999 0.4
Query 224: 0.0005 at 0.70 0.0979
Query 225: 0.0000 at 0.80 0.0958
Query 226: 1.0000 at 0.90 0.0937
Query 227: 0.0038 at 1.00 0.0931
Query 228: 0.0294 0.2
Query 230: 0.1554 Avg. prec. (non-interpolated)
Query 231: 0.0000 for all rel. documents
Query 232: 0.0518 0.1137
Query 233: 0.0284 Precision:
Query 234: 0.0000 At 5 docs: 0.0353 0.0
Query 235: 0.0003 At 10 docs: 0.0353 0.0 0.2 0.4 0.6 0.8 1.0
Query 237: 0.0005 At 15 docs: 0.0333
Query 238: 0.0020 At 20 docs: 0.0294 Recall
Query 239: 0.0908 At 30 docs: 0.0235
Query 241: 0.0578 At 100 docs: 0.0124
Query 242: 0.0833 At 200 docs: 0.0071 Run CLIPS04ENRU1
Query 244: 0.0060 At 500 docs: 0.0036 Comparison to median by topic
Query 245: 0.0015 At 1000 docs: 0.0021
Query 250: 1.0000 +1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.0768
+0.5
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
CLIPS, Bilingual English to Russian, Auto, TDN Run CLIPS04ENRU2
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 34 queries): 1.0
Query 201: 0.0196 Total number of documents
Query 202: 0.0092 over all queries
Query 203: 0.0010 Retrieved: 33001
Query 207: 0.0000 Relevant: 123
Query 209: 0.0006 Rel_ret: 56
0.8
Query 210: 0.2662
Query 211: 0.2262 Interpolated Recall -
Query 212: 0.0002 Precision Averages:
Query 213: 0.0092 at 0.00 0.0859
Query 214: 0.0005 at 0.10 0.0859 0.6
Query 215: 0.5000 at 0.20 0.0768
Query 216: 0.0000 at 0.30 0.0468
Query 218: 0.0040 at 0.40 0.0435
Precision
Query 220: 0.0022 at 0.50 0.0417
Query 221: 0.0160 at 0.60 0.0401 0.4
Query 224: 0.0000 at 0.70 0.0343
Query 225: 0.0000 at 0.80 0.0336
Query 226: 0.1429 at 0.90 0.0333
Query 227: 0.0000 at 1.00 0.0333
Query 228: 0.0417 0.2
Query 230: 0.0254 Avg. prec. (non-interpolated)
Query 231: 0.0013 for all rel. documents
Query 232: 0.0207 0.0462
Query 233: 0.0000 Precision:
Query 234: 0.0000 At 5 docs: 0.0176 0.0
Query 235: 0.0000 At 10 docs: 0.0294 0.0 0.2 0.4 0.6 0.8 1.0
Query 237: 0.0004 At 15 docs: 0.0216
Query 238: 0.0000 At 20 docs: 0.0191 Recall
Query 239: 0.1103 At 30 docs: 0.0157
Query 241: 0.0247 At 100 docs: 0.0071
Query 242: 0.0222 At 200 docs: 0.0044 Run CLIPS04ENRU2
Query 244: 0.0000 At 500 docs: 0.0024 Comparison to median by topic
Query 245: 0.0014 At 1000 docs: 0.0016
Query 250: 0.1250 +1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.0136
+0.5
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
CLIPS, Bilingual French to Russian, Auto, TDN Run CLIPS04FRRU1
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 34 queries): 1.0
Query 201: 0.0000 Total number of documents
Query 202: 0.0173 over all queries
Query 203: 0.0025 Retrieved: 32007
Query 207: 0.0000 Relevant: 123
Query 209: 0.0055 Rel_ret: 43
0.8
Query 210: 0.0179
Query 211: 0.4167 Interpolated Recall -
Query 212: 0.0044 Precision Averages:
Query 213: 0.0106 at 0.00 0.0847
Query 214: 0.0023 at 0.10 0.0847 0.6
Query 215: 0.5000 at 0.20 0.0847
Query 216: 0.0000 at 0.30 0.0697
Query 218: 0.0016 at 0.40 0.0686
Precision
Query 220: 0.0000 at 0.50 0.0683
Query 221: 0.0118 at 0.60 0.0626 0.4
Query 224: 0.0000 at 0.70 0.0449
Query 225: 0.0000 at 0.80 0.0446
Query 226: 0.1429 at 0.90 0.0446
Query 227: 0.0000 at 1.00 0.0446
Query 228: 0.0074 0.2
Query 230: 0.0043 Avg. prec. (non-interpolated)
Query 231: 0.0000 for all rel. documents
Query 232: 0.0000 0.0612
Query 233: 0.0028 Precision:
Query 234: 0.0000 At 5 docs: 0.0353 0.0
Query 235: 0.4200 At 10 docs: 0.0235 0.0 0.2 0.4 0.6 0.8 1.0
Query 237: 0.0000 At 15 docs: 0.0176
Query 238: 0.0000 At 20 docs: 0.0132 Recall
Query 239: 0.0000 At 30 docs: 0.0088
Query 241: 0.0052 At 100 docs: 0.0053
Query 242: 0.5000 At 200 docs: 0.0038 Run CLIPS04FRRU1
Query 244: 0.0083 At 500 docs: 0.0022 Comparison to median by topic
Query 245: 0.0000 At 1000 docs: 0.0013
Query 250: 0.0000 +1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.0324
+0.5
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
CLIPS, Bilingual French to Russian, Auto, TDN Run CLIPS04FRRU2
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 34 queries): 1.0
Query 201: 0.0000 Total number of documents
Query 202: 0.0173 over all queries
Query 203: 0.0019 Retrieved: 32007
Query 207: 0.0000 Relevant: 123
Query 209: 0.0055 Rel_ret: 48
0.8
Query 210: 0.0156
Query 211: 0.4167 Interpolated Recall -
Query 212: 0.0040 Precision Averages:
Query 213: 0.0106 at 0.00 0.0682
Query 214: 0.0023 at 0.10 0.0682 0.6
Query 215: 0.5000 at 0.20 0.0676
Query 216: 0.0000 at 0.30 0.0635
Query 218: 0.0011 at 0.40 0.0626
Precision
Query 220: 0.0000 at 0.50 0.0626
Query 221: 0.0093 at 0.60 0.0572 0.4
Query 224: 0.0000 at 0.70 0.0423
Query 225: 0.0000 at 0.80 0.0416
Query 226: 0.0500 at 0.90 0.0416
Query 227: 0.0000 at 1.00 0.0416
Query 228: 0.0074 0.2
Query 230: 0.0024 Avg. prec. (non-interpolated)
Query 231: 0.0000 for all rel. documents
Query 232: 0.0001 0.0550
Query 233: 0.0077 Precision:
Query 234: 0.0000 At 5 docs: 0.0294 0.0
Query 235: 0.3000 At 10 docs: 0.0206 0.0 0.2 0.4 0.6 0.8 1.0
Query 237: 0.0000 At 15 docs: 0.0137
Query 238: 0.0000 At 20 docs: 0.0132 Recall
Query 239: 0.0000 At 30 docs: 0.0108
Query 241: 0.0171 At 100 docs: 0.0056
Query 242: 0.5000 At 200 docs: 0.0040 Run CLIPS04FRRU2
Query 244: 0.0000 At 500 docs: 0.0021 Comparison to median by topic
Query 245: 0.0000 At 1000 docs: 0.0014
Query 250: 0.0000 +1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.0265
+0.5
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Dublin City University, Bilingual English to Russian, Auto, TD Run exerussbi04a
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 34 queries): 1.0
Query 201: 0.0000 Total number of documents
Query 202: 0.3912 over all queries
Query 203: 1.0000 Retrieved: 34000
Query 207: 0.0000 Relevant: 123
Query 209: 0.8333 Rel_ret: 96
0.8
Query 210: 0.5799
Query 211: 1.0000 Interpolated Recall -
Query 212: 0.1487 Precision Averages:
Query 213: 0.2327 at 0.00 0.4945
Query 214: 0.0093 at 0.10 0.4945 0.6
Query 215: 1.0000 at 0.20 0.4729
Query 216: 0.0000 at 0.30 0.4192
Query 218: 0.2500 at 0.40 0.3438
Precision
Query 220: 0.0045 at 0.50 0.3406
Query 221: 0.2722 at 0.60 0.2582 0.4
Query 224: 0.1308 at 0.70 0.2151
Query 225: 0.3687 at 0.80 0.2112
Query 226: 0.0182 at 0.90 0.2023
Query 227: 0.1250 at 1.00 0.2017
Query 228: 0.0244 0.2
Query 230: 0.2258 Avg. prec. (non-interpolated)
Query 231: 1.0000 for all rel. documents
Query 232: 0.1167 0.3195
Query 233: 0.2279 Precision:
Query 234: 0.5646 At 5 docs: 0.1824 0.0
Query 235: 0.0004 At 10 docs: 0.1059 0.0 0.2 0.4 0.6 0.8 1.0
Query 237: 0.2500 At 15 docs: 0.0765
Query 238: 0.5000 At 20 docs: 0.0632 Recall
Query 239: 0.1041 At 30 docs: 0.0490
Query 241: 0.0535 At 100 docs: 0.0200
Query 242: 0.0312 At 200 docs: 0.0110 Run exerussbi04a
Query 244: 1.0000 At 500 docs: 0.0052 Comparison to median by topic
Query 245: 0.4000 At 1000 docs: 0.0028
Query 250: 0.0000 +1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.3060
+0.5
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Dublin City University, Bilingual English to Russian, Auto, TD Run exerussbi04amg
Average precision Overall statistics
(individual queries): (for 34 queries): Recall−Precision Values
1.0
Query 201: 0.0012 Total number of documents
Query 202: 0.3864 over all queries
Query 203: 1.0000 Retrieved: 34000
Query 207: 0.0000 Relevant: 123
Query 209: 1.0000 Rel_ret: 95 0.8
Query 210: 0.3839
Query 211: 1.0000 Interpolated Recall -
Query 212: 0.5256 Precision Averages:
Query 213: 0.2287 at 0.00 0.4990
Query 214: 0.0033 at 0.10 0.4990 0.6
Query 215: 1.0000 at 0.20 0.4961
Query 216: 0.0012 at 0.30 0.4121
Query 218: 0.2500 at 0.40 0.3450
Precision
Query 220: 0.0062 at 0.50 0.3334
Query 221: 0.5500 at 0.60 0.2399 0.4
Query 224: 0.1667 at 0.70 0.2036
Query 225: 0.2130 at 0.80 0.1985
Query 226: 0.0385 at 0.90 0.1862
Query 227: 0.5000 at 1.00 0.1860
Query 228: 0.0039 0.2
Query 230: 0.1773 Avg. prec. (non-interpolated)
Query 231: 1.0000 for all rel. documents
Query 232: 0.1140 0.3125
Query 233: 0.1713 Precision:
Query 234: 0.0296 At 5 docs: 0.1765 0.0
Query 235: 0.0000 At 10 docs: 0.1088 0.0 0.2 0.4 0.6 0.8 1.0
Query 237: 0.2500 At 15 docs: 0.0784
Query 238: 0.3333 At 20 docs: 0.0676 Recall
Query 239: 0.2985 At 30 docs: 0.0529
Query 241: 0.0839 At 100 docs: 0.0197
Query 242: 0.0097 At 200 docs: 0.0110 Run exerussbi04amg
Query 244: 0.5000 At 500 docs: 0.0050
Query 245: 0.4000 At 1000 docs: 0.0028 Comparison to median by topic
Query 250: 0.0000 +1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.2923
+0.5
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Dublin City University, Bilingual English to Russian, Auto, TD Run exerussbi04l
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 34 queries): 1.0
Query 201: 0.0000 Total number of documents
Query 202: 0.3820 over all queries
Query 203: 1.0000 Retrieved: 34000
Query 207: 0.0000 Relevant: 123
Query 209: 0.5833 Rel_ret: 95
0.8
Query 210: 0.5799
Query 211: 1.0000 Interpolated Recall -
Query 212: 0.2616 Precision Averages:
Query 213: 0.2377 at 0.00 0.5021
Query 214: 0.0088 at 0.10 0.5021 0.6
Query 215: 1.0000 at 0.20 0.4653
Query 216: 0.0000 at 0.30 0.4049
Query 218: 0.2500 at 0.40 0.3106
Precision
Query 220: 0.0028 at 0.50 0.3081
Query 221: 0.2727 at 0.60 0.2294 0.4
Query 224: 0.1310 at 0.70 0.1863
Query 225: 0.5444 at 0.80 0.1827
Query 226: 0.0204 at 0.90 0.1739
Query 227: 0.2500 at 1.00 0.1731
Query 228: 0.0256 0.2
Query 230: 0.2243 Avg. prec. (non-interpolated)
Query 231: 0.5000 for all rel. documents
Query 232: 0.1093 0.2959
Query 233: 0.2134 Precision:
Query 234: 0.5670 At 5 docs: 0.1765 0.0
Query 235: 0.0004 At 10 docs: 0.1088 0.0 0.2 0.4 0.6 0.8 1.0
Query 237: 0.2500 At 15 docs: 0.0765
Query 238: 0.5000 At 20 docs: 0.0632 Recall
Query 239: 0.1491 At 30 docs: 0.0480
Query 241: 0.0586 At 100 docs: 0.0200
Query 242: 0.0312 At 200 docs: 0.0113 Run exerussbi04l
Query 244: 0.5000 At 500 docs: 0.0051 Comparison to median by topic
Query 245: 0.4074 At 1000 docs: 0.0028
Query 250: 0.0000 +1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.2560
+0.5
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Dublin City University, Bilingual English to Russian, Auto, TD Run exerussbi04q
Average precision Overall statistics
(individual queries): (for 34 queries): Recall−Precision Values
1.0
Query 201: 0.0000 Total number of documents
Query 202: 0.3786 over all queries
Query 203: 1.0000 Retrieved: 34000
Query 207: 0.0000 Relevant: 123
Query 209: 0.8333 Rel_ret: 95 0.8
Query 210: 0.5799
Query 211: 1.0000 Interpolated Recall -
Query 212: 0.2775 Precision Averages:
Query 213: 0.2257 at 0.00 0.4916
Query 214: 0.0063 at 0.10 0.4916 0.6
Query 215: 1.0000 at 0.20 0.4525
Query 216: 0.0000 at 0.30 0.3943
Query 218: 0.2500 at 0.40 0.3311
Precision
Query 220: 0.0059 at 0.50 0.3289
Query 221: 0.2738 at 0.60 0.2457 0.4
Query 224: 0.1074 at 0.70 0.2016
Query 225: 0.3889 at 0.80 0.1975
Query 226: 0.0147 at 0.90 0.1895
Query 227: 0.1250 at 1.00 0.1887
Query 228: 0.0357 0.2
Query 230: 0.2278 Avg. prec. (non-interpolated)
Query 231: 1.0000 for all rel. documents
Query 232: 0.1149 0.3048
Query 233: 0.1932 Precision:
Query 234: 0.3955 At 5 docs: 0.1765 0.0
Query 235: 0.0003 At 10 docs: 0.1088 0.0 0.2 0.4 0.6 0.8 1.0
Query 237: 0.2500 At 15 docs: 0.0784
Query 238: 0.5000 At 20 docs: 0.0647 Recall
Query 239: 0.1509 At 30 docs: 0.0500
Query 241: 0.0558 At 100 docs: 0.0200
Query 242: 0.0435 At 200 docs: 0.0110 Run exerussbi04q
Query 244: 0.5000 At 500 docs: 0.0049
Query 245: 0.4286 At 1000 docs: 0.0028 Comparison to median by topic
Query 250: 0.0000 +1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.2722
+0.5
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Dublin City University, Bilingual English to Russian, Auto, TD Run exerussbi04t
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 34 queries): 1.0
Query 201: 0.0000 Total number of documents
Query 202: 0.3856 over all queries
Query 203: 1.0000 Retrieved: 34000
Query 207: 0.0000 Relevant: 123
Query 209: 0.8333 Rel_ret: 96
0.8
Query 210: 0.5833
Query 211: 1.0000 Interpolated Recall -
Query 212: 0.2227 Precision Averages:
Query 213: 0.2420 at 0.00 0.5180
Query 214: 0.0078 at 0.10 0.5180 0.6
Query 215: 1.0000 at 0.20 0.4954
Query 216: 0.0000 at 0.30 0.4236
Query 218: 0.2500 at 0.40 0.3431
Precision
Query 220: 0.0046 at 0.50 0.3404
Query 221: 0.2727 at 0.60 0.2611 0.4
Query 224: 0.1033 at 0.70 0.2048
Query 225: 0.5354 at 0.80 0.2006
Query 226: 0.0154 at 0.90 0.1904
Query 227: 0.1250 at 1.00 0.1897
Query 228: 0.0238 0.2
Query 230: 0.2263 Avg. prec. (non-interpolated)
Query 231: 0.5000 for all rel. documents
Query 232: 0.1177 0.3210
Query 233: 0.2285 Precision:
Query 234: 0.7083 At 5 docs: 0.1824 0.0
Query 235: 0.0005 At 10 docs: 0.1059 0.0 0.2 0.4 0.6 0.8 1.0
Query 237: 0.2500 At 15 docs: 0.0804
Query 238: 0.5000 At 20 docs: 0.0676 Recall
Query 239: 0.2612 At 30 docs: 0.0529
Query 241: 0.0529 At 100 docs: 0.0206
Query 242: 0.0455 At 200 docs: 0.0110 Run exerussbi04t
Query 244: 1.0000 At 500 docs: 0.0051 Comparison to median by topic
Query 245: 0.4167 At 1000 docs: 0.0028
Query 250: 0.0000 +1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.2830
+0.5
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Alicante, Bilingual English to Russian, Auto, TD Run IRn−BEnR−Dexp
Average precision Overall statistics
(individual queries): (for 34 queries):
Recall−Precision Values
1.0
Query 201: 0.0203 Total number of documents
Query 202: 0.3419 over all queries
Query 203: 1.0000 Retrieved: 34000
Query 207: 0.0000 Relevant: 123
Query 209: 0.7500 Rel_ret: 111 0.8
Query 210: 0.4237
Query 211: 0.8333 Interpolated Recall -
Query 212: 0.5690 Precision Averages:
Query 213: 0.2093 at 0.00 0.4529
Query 214: 0.0072 at 0.10 0.4508 0.6
Query 215: 0.3333 at 0.20 0.4403
Query 216: 0.0066 at 0.30 0.4068
Query 218: 0.5833 at 0.40 0.3560
Precision
Query 220: 0.0102 at 0.50 0.3533
Query 221: 0.8333 at 0.60 0.2988 0.4
Query 224: 0.2250 at 0.70 0.2874
Query 225: 0.2421 at 0.80 0.2835
Query 226: 0.0128 at 0.90 0.2695
Query 227: 0.0152 at 1.00 0.2658
Query 228: 0.0069 0.2
Query 230: 0.2166 Avg. prec. (non-interpolated)
Query 231: 1.0000 for all rel. documents
Query 232: 0.0781 0.3357
Query 233: 0.2549 Precision:
Query 234: 0.0081 At 5 docs: 0.1882 0.0
Query 235: 0.0069 At 10 docs: 0.1294 0.0 0.2 0.4 0.6 0.8 1.0
Query 237: 0.7929 At 15 docs: 0.0941
Query 238: 1.0000 At 20 docs: 0.0779 Recall
Query 239: 0.0929 At 30 docs: 0.0608
Query 241: 0.2269 At 100 docs: 0.0271
Query 242: 0.0159 At 200 docs: 0.0144 Run IRn−BEnR−Dexp
Query 244: 1.0000 At 500 docs: 0.0065
Query 245: 0.2963 At 1000 docs: 0.0033 Comparison to median by topic
Query 250: 0.0000 +1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.2835
+0.5
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Alicante, Bilingual English to Russian, Auto, TD Run IRn−BEnR−nexp
Average precision Overall statistics
(individual queries): (for 34 queries):
Recall−Precision Values
1.0
Query 201: 0.0266 Total number of documents
Query 202: 0.3478 over all queries
Query 203: 1.0000 Retrieved: 34000
Query 207: 0.0000 Relevant: 123
Query 209: 0.8333 Rel_ret: 108 0.8
Query 210: 0.5771
Query 211: 1.0000 Interpolated Recall -
Query 212: 0.2704 Precision Averages:
Query 213: 0.1415 at 0.00 0.4467
Query 214: 0.0056 at 0.10 0.4467 0.6
Query 215: 0.1429 at 0.20 0.4402
Query 216: 0.0040 at 0.30 0.4066
Query 218: 0.5833 at 0.40 0.3643
Precision
Query 220: 0.0095 at 0.50 0.3608
Query 221: 0.6667 at 0.60 0.2895 0.4
Query 224: 0.7500 at 0.70 0.2683
Query 225: 0.2329 at 0.80 0.2563
Query 226: 0.0026 at 0.90 0.2486
Query 227: 0.0385 at 1.00 0.2469
Query 228: 0.0156 0.2
Query 230: 0.1229 Avg. prec. (non-interpolated)
Query 231: 0.1429 for all rel. documents
Query 232: 0.0364 0.3296
Query 233: 0.2164 Precision:
Query 234: 0.0181 At 5 docs: 0.1765 0.0
Query 235: 0.0058 At 10 docs: 0.1206 0.0 0.2 0.4 0.6 0.8 1.0
Query 237: 0.7409 At 15 docs: 0.0882
Query 238: 1.0000 At 20 docs: 0.0676 Recall
Query 239: 0.1259 At 30 docs: 0.0559
Query 241: 0.1451 At 100 docs: 0.0232
Query 242: 0.0033 At 200 docs: 0.0129 Run IRn−BEnR−nexp
Query 244: 1.0000 At 500 docs: 0.0060
Query 245: 1.0000 At 1000 docs: 0.0032 Comparison to median by topic
Query 250: 0.0000 +1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.2959
+0.5
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Alicante, Bilingual Spanish to Russian, Auto, TD Run IRn−BEsR−Dexp
Average precision Overall statistics
(individual queries): (for 34 queries):
Recall−Precision Values
1.0
Query 201: 0.0139 Total number of documents
Query 202: 0.3700 over all queries
Query 203: 1.0000 Retrieved: 34000
Query 207: 0.0000 Relevant: 123
Query 209: 0.0792 Rel_ret: 106 0.8
Query 210: 0.4470
Query 211: 0.8333 Interpolated Recall -
Query 212: 0.0147 Precision Averages:
Query 213: 0.3130 at 0.00 0.4356
Query 214: 0.0068 at 0.10 0.4282 0.6
Query 215: 0.3333 at 0.20 0.4197
Query 216: 0.0022 at 0.30 0.3664
Query 218: 0.5833 at 0.40 0.3293
Precision
Query 220: 0.0098 at 0.50 0.3224
Query 221: 0.6429 at 0.60 0.2712 0.4
Query 224: 0.1833 at 0.70 0.2441
Query 225: 0.0833 at 0.80 0.2390
Query 226: 0.0455 at 0.90 0.2352
Query 227: 0.0714 at 1.00 0.2292
Query 228: 0.0060 0.2
Query 230: 0.1649 Avg. prec. (non-interpolated)
Query 231: 1.0000 for all rel. documents
Query 232: 0.0529 0.3087
Query 233: 0.2673 Precision:
Query 234: 0.0010 At 5 docs: 0.1529 0.0
Query 235: 0.0103 At 10 docs: 0.1088 0.0 0.2 0.4 0.6 0.8 1.0
Query 237: 0.8875 At 15 docs: 0.0824
Query 238: 1.0000 At 20 docs: 0.0676 Recall
Query 239: 0.1214 At 30 docs: 0.0559
Query 241: 0.1649 At 100 docs: 0.0232
Query 242: 0.0200 At 200 docs: 0.0132 Run IRn−BEsR−Dexp
Query 244: 1.0000 At 500 docs: 0.0059
Query 245: 0.7667 At 1000 docs: 0.0031 Comparison to median by topic
Query 250: 0.0000 +1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.2547
+0.5
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Alicante, Bilingual Spanish to Russian, Auto, TD Run IRn−BEsR−nexp
Average precision Overall statistics
(individual queries): (for 34 queries):
Recall−Precision Values
1.0
Query 201: 0.0163 Total number of documents
Query 202: 0.3668 over all queries
Query 203: 1.0000 Retrieved: 34000
Query 207: 0.0000 Relevant: 123
Query 209: 0.2672 Rel_ret: 101 0.8
Query 210: 0.6917
Query 211: 1.0000 Interpolated Recall -
Query 212: 0.0174 Precision Averages:
Query 213: 0.1887 at 0.00 0.4106
Query 214: 0.0012 at 0.10 0.4098 0.6
Query 215: 0.1429 at 0.20 0.4042
Query 216: 0.0000 at 0.30 0.3675
Query 218: 0.5833 at 0.40 0.3256
Precision
Query 220: 0.0141 at 0.50 0.3182
Query 221: 0.5909 at 0.60 0.2602 0.4
Query 224: 0.2500 at 0.70 0.2546
Query 225: 0.1111 at 0.80 0.2404
Query 226: 0.0208 at 0.90 0.2378
Query 227: 0.0714 at 1.00 0.2349
Query 228: 0.0087 0.2
Query 230: 0.0629 Avg. prec. (non-interpolated)
Query 231: 1.0000 for all rel. documents
Query 232: 0.0263 0.3044
Query 233: 0.2319 Precision:
Query 234: 0.0100 At 5 docs: 0.1588 0.0
Query 235: 0.0053 At 10 docs: 0.1000 0.0 0.2 0.4 0.6 0.8 1.0
Query 237: 0.9500 At 15 docs: 0.0765
Query 238: 0.5000 At 20 docs: 0.0647 Recall
Query 239: 0.0844 At 30 docs: 0.0471
Query 241: 0.1379 At 100 docs: 0.0212
Query 242: 0.0000 At 200 docs: 0.0113 Run IRn−BEsR−nexp
Query 244: 1.0000 At 500 docs: 0.0055
Query 245: 1.0000 At 1000 docs: 0.0030 Comparison to median by topic
Query 250: 0.0000 +1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.2711
+0.5
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Chicago, Bilingual English to Russian, Auto, T Run UCERBiT1
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 34 queries): 1.0
Query 201: 0.0021 Total number of documents
Query 202: 0.0014 over all queries
Query 203: 0.0014 Retrieved: 34000
Query 207: 0.0036 Relevant: 123
Query 209: 0.0030 Rel_ret: 43
0.8
Query 210: 0.0003
Query 211: 0.0010 Interpolated Recall -
Query 212: 0.0071 Precision Averages:
Query 213: 0.0033 at 0.00 0.0065
Query 214: 0.0013 at 0.10 0.0065 0.6
Query 215: 0.0000 at 0.20 0.0042
Query 216: 0.0000 at 0.30 0.0040
Query 218: 0.0000 at 0.40 0.0026
Precision
Query 220: 0.0000 at 0.50 0.0025
Query 221: 0.0173 at 0.60 0.0011 0.4
Query 224: 0.0000 at 0.70 0.0008
Query 225: 0.0090 at 0.80 0.0008
Query 226: 0.0000 at 0.90 0.0008
Query 227: 0.0026 at 1.00 0.0008
Query 228: 0.0000 0.2
Query 230: 0.0041 Avg. prec. (non-interpolated)
Query 231: 0.0000 for all rel. documents
Query 232: 0.0004 0.0025
Query 233: 0.0011 Precision:
Query 234: 0.0026 At 5 docs: 0.0000 0.0
Query 235: 0.0000 At 10 docs: 0.0000 0.0 0.2 0.4 0.6 0.8 1.0
Query 237: 0.0000 At 15 docs: 0.0000
Query 238: 0.0172 At 20 docs: 0.0000 Recall
Query 239: 0.0020 At 30 docs: 0.0020
Query 241: 0.0030 At 100 docs: 0.0015
Query 242: 0.0000 At 200 docs: 0.0015 Run UCERBiT1
Query 244: 0.0000 At 500 docs: 0.0012 Comparison to median by topic
Query 245: 0.0006 At 1000 docs: 0.0013
Query 250: 0.0010 +1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.0000
+0.5
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Hildesheim, Bilingual English to Russian, Auto, TD Run UHIenru1
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 34 queries): 1.0
Query 201: 0.0072 Total number of documents
Query 202: 0.0099 over all queries
Query 203: 1.0000 Retrieved: 34000
Query 207: 0.0000 Relevant: 123 0.8
Query 209: 0.0139 Rel_ret: 77
Query 210: 0.2885
Query 211: 0.1167 Interpolated Recall -
Query 212: 0.0002 Precision Averages:
Query 213: 0.1914 at 0.00 0.2290
Query 214: 0.0333 at 0.10 0.2290 0.6
Query 215: 1.0000 at 0.20 0.2115
Query 216: 0.0000 at 0.30 0.1702
Query 218: 0.0200 at 0.40 0.1236
Precision
Query 220: 0.0026 at 0.50 0.1196
Query 221: 0.0164 at 0.60 0.1001 0.4
Query 224: 0.0092 at 0.70 0.0965
Query 225: 0.1023 at 0.80 0.0965
Query 226: 0.0000 at 0.90 0.0956
Query 227: 0.1667 at 1.00 0.0950
Query 228: 0.0000 0.2
Query 230: 0.3265 Avg. prec. (non-interpolated)
Query 231: 0.0047 for all rel. documents
Query 232: 0.0021 0.1353
Query 233: 0.0032 Precision:
Query 234: 0.1122 At 5 docs: 0.0706 0.0
Query 235: 0.0004 At 10 docs: 0.0500 0.0 0.2 0.4 0.6 0.8 1.0
Query 237: 0.0568 At 15 docs: 0.0392
Query 238: 0.0139 At 20 docs: 0.0324 Recall
Query 239: 0.0225 At 30 docs: 0.0245
Query 241: 0.0505 At 100 docs: 0.0115
Query 242: 0.0167 At 200 docs: 0.0071 Run UHIenru1
Query 244: 1.0000 At 500 docs: 0.0038 Comparison to median by topic
Query 245: 0.0124 At 1000 docs: 0.0023
Query 250: 0.0000 +1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.1245
+0.5
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Hildesheim, Bilingual English to Russian, Auto, TD Run UHIenru2
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 34 queries): 1.0
Query 201: 0.0088 Total number of documents
Query 202: 0.0088 over all queries
Query 203: 1.0000 Retrieved: 34000
Query 207: 0.0000 Relevant: 123 0.8
Query 209: 0.0125 Rel_ret: 73
Query 210: 0.2972
Query 211: 0.0662 Interpolated Recall -
Query 212: 0.0000 Precision Averages:
Query 213: 0.1792 at 0.00 0.2087
Query 214: 0.0133 at 0.10 0.2087 0.6
Query 215: 1.0000 at 0.20 0.1978
Query 216: 0.0000 at 0.30 0.1482
Query 218: 0.0217 at 0.40 0.1179
Precision
Query 220: 0.0032 at 0.50 0.1174
Query 221: 0.0091 at 0.60 0.0957 0.4
Query 224: 0.0085 at 0.70 0.0945
Query 225: 0.0880 at 0.80 0.0942
Query 226: 0.0010 at 0.90 0.0935
Query 227: 0.2500 at 1.00 0.0935
Query 228: 0.0015 0.2
Query 230: 0.0640 Avg. prec. (non-interpolated)
Query 231: 0.0047 for all rel. documents
Query 232: 0.0023 0.1274
Query 233: 0.0046 Precision:
Query 234: 0.1667 At 5 docs: 0.0588 0.0
Query 235: 0.0004 At 10 docs: 0.0324 0.0 0.2 0.4 0.6 0.8 1.0
Query 237: 0.0462 At 15 docs: 0.0314
Query 238: 0.0085 At 20 docs: 0.0235 Recall
Query 239: 0.0138 At 30 docs: 0.0206
Query 241: 0.0290 At 100 docs: 0.0094
Query 242: 0.0135 At 200 docs: 0.0057 Run UHIenru2
Query 244: 1.0000 At 500 docs: 0.0031 Comparison to median by topic
Query 245: 0.0098 At 1000 docs: 0.0021
Query 250: 0.0000 +1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.1304
+0.5
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Hildesheim, Bilingual English to Russian, Auto, TD Run UHIenru3
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 34 queries): 1.0
Query 201: 0.0000 Total number of documents
Query 202: 0.0179 over all queries
Query 203: 1.0000 Retrieved: 32809
Query 207: 0.0000 Relevant: 123 0.8
Query 209: 0.0185 Rel_ret: 53
Query 210: 0.0098
Query 211: 0.0667 Interpolated Recall -
Query 212: 0.0000 Precision Averages:
Query 213: 0.0007 at 0.00 0.0677
Query 214: 0.0004 at 0.10 0.0650 0.6
Query 215: 0.0286 at 0.20 0.0644
Query 216: 0.0000 at 0.30 0.0620
Query 218: 0.0385 at 0.40 0.0499
Precision
Query 220: 0.0556 at 0.50 0.0497
Query 221: 0.0501 at 0.60 0.0404 0.4
Query 224: 0.0048 at 0.70 0.0385
Query 225: 0.0975 at 0.80 0.0383
Query 226: 0.0000 at 0.90 0.0374
Query 227: 0.0128 at 1.00 0.0374
Query 228: 0.0018 0.2
Query 230: 0.0036 Avg. prec. (non-interpolated)
Query 231: 0.0069 for all rel. documents
Query 232: 0.0000 0.0484
Query 233: 0.0018 Precision:
Query 234: 0.0000 At 5 docs: 0.0118 0.0
Query 235: 0.0000 At 10 docs: 0.0176 0.0 0.2 0.4 0.6 0.8 1.0
Query 237: 0.0667 At 15 docs: 0.0157
Query 238: 0.0054 At 20 docs: 0.0147 Recall
Query 239: 0.0000 At 30 docs: 0.0127
Query 241: 0.0326 At 100 docs: 0.0062
Query 242: 0.0000 At 200 docs: 0.0044 Run UHIenru3
Query 244: 0.1111 At 500 docs: 0.0027 Comparison to median by topic
Query 245: 0.0131 At 1000 docs: 0.0016
Query 250: 0.0000 +1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.0309
+0.5
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Université de Neuchâtel, Bilingual English to Russian, Auto, TD Run UniNEBru1
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 34 queries): 1.0
Query 201: 0.0118 Total number of documents
Query 202: 0.5033 over all queries
Query 203: 1.0000 Retrieved: 34000
Query 207: 0.0000 Relevant: 123 0.8
Query 209: 1.0000 Rel_ret: 104
Query 210: 0.4598
Query 211: 0.5833 Interpolated Recall -
Query 212: 0.4679 Precision Averages:
Query 213: 0.1688 at 0.00 0.4163
Query 214: 0.0287 at 0.10 0.4163 0.6
Query 215: 0.2000 at 0.20 0.4163
Query 216: 0.0067 at 0.30 0.3712
Query 218: 0.2500 at 0.40 0.3291
Precision
Query 220: 0.0226 at 0.50 0.3237
Query 221: 0.7000 at 0.60 0.2663 0.4
Query 224: 0.1038 at 0.70 0.2378
Query 225: 0.6429 at 0.80 0.2287
Query 226: 0.0044 at 0.90 0.2246
Query 227: 0.0833 at 1.00 0.2222
Query 228: 0.0066 0.2
Query 230: 0.1775 Avg. prec. (non-interpolated)
Query 231: 1.0000 for all rel. documents
Query 232: 0.1351 0.3007
Query 233: 0.1677 Precision:
Query 234: 0.0237 At 5 docs: 0.1706 0.0
Query 235: 0.0004 At 10 docs: 0.1118 0.0 0.2 0.4 0.6 0.8 1.0
Query 237: 0.1250 At 15 docs: 0.0902
Query 238: 1.0000 At 20 docs: 0.0794 Recall
Query 239: 0.0518 At 30 docs: 0.0578
Query 241: 0.1377 At 100 docs: 0.0232
Query 242: 0.0385 At 200 docs: 0.0131 Run UniNEBru1
Query 244: 1.0000 At 500 docs: 0.0058 Comparison to median by topic
Query 245: 0.1225 At 1000 docs: 0.0031
Query 250: 0.0000 +1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.2742
+0.5
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Université de Neuchâtel, Bilingual English to Russian, Auto, TD Run UniNEBru2
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 34 queries): 1.0
Query 201: 0.0091 Total number of documents
Query 202: 0.4476 over all queries
Query 203: 1.0000 Retrieved: 34000
Query 207: 0.0000 Relevant: 123 0.8
Query 209: 1.0000 Rel_ret: 104
Query 210: 0.4781
Query 211: 0.5833 Interpolated Recall -
Query 212: 0.2989 Precision Averages:
Query 213: 0.1667 at 0.00 0.4190
Query 214: 0.0401 at 0.10 0.4190 0.6
Query 215: 0.2000 at 0.20 0.4190
Query 216: 0.0038 at 0.30 0.3763
Query 218: 0.2500 at 0.40 0.3185
Precision
Query 220: 0.0225 at 0.50 0.3093
Query 221: 0.7000 at 0.60 0.2522 0.4
Query 224: 0.1056 at 0.70 0.2282
Query 225: 0.6095 at 0.80 0.2226
Query 226: 0.0031 at 0.90 0.2182
Query 227: 0.0833 at 1.00 0.2162
Query 228: 0.0070 0.2
Query 230: 0.1756 Avg. prec. (non-interpolated)
Query 231: 1.0000 for all rel. documents
Query 232: 0.1260 0.2962
Query 233: 0.1891 Precision:
Query 234: 0.0297 At 5 docs: 0.1647 0.0
Query 235: 0.0008 At 10 docs: 0.1029 0.0 0.2 0.4 0.6 0.8 1.0
Query 237: 0.1250 At 15 docs: 0.0863
Query 238: 1.0000 At 20 docs: 0.0750 Recall
Query 239: 0.0468 At 30 docs: 0.0598
Query 241: 0.1141 At 100 docs: 0.0224
Query 242: 0.0417 At 200 docs: 0.0128 Run UniNEBru2
Query 244: 1.0000 At 500 docs: 0.0059 Comparison to median by topic
Query 245: 0.2143 At 1000 docs: 0.0031
Query 250: 0.0000 +1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.2855
+0.5
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
SUNY Buffalo, Monolingual English, Auto, TD Run UBmonoEN01
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 42 queries): 1.0
Query 201: 0.2309 Total number of documents
Query 202: 0.6479 over all queries
Query 204: 0.3942 Retrieved: 42000
Query 205: 0.5881 Relevant: 375 0.8
Query 206: 1.0000 Rel_ret: 361
Query 207: 0.8126
Query 208: 1.0000 Interpolated Recall -
Query 209: 0.0827 Precision Averages:
Query 210: 0.2000 at 0.00 0.7444
Query 211: 1.0000 at 0.10 0.6559 0.6
Query 212: 0.2884 at 0.20 0.6534
Query 213: 0.1855 at 0.30 0.5828
Query 214: 0.5881 at 0.40 0.5611
Precision
Query 215: 0.0667 at 0.50 0.5355
Query 216: 0.7292 at 0.60 0.5138 0.4
Query 217: 0.1534 at 0.70 0.4650
Query 218: 0.9124 at 0.80 0.4269
Query 219: 0.0023 at 0.90 0.3885
Query 221: 0.5833 at 1.00 0.3682
Query 222: 0.1052 0.2
Query 223: 0.4098 Avg. prec. (non-interpolated)
Query 224: 0.8156 for all rel. documents
Query 226: 0.2657 0.5167
Query 228: 0.0213 Precision:
Query 229: 0.7000 At 5 docs: 0.4095 0.0
Query 230: 0.7326 At 10 docs: 0.3048 0.0 0.2 0.4 0.6 0.8 1.0
Query 231: 0.3333 At 15 docs: 0.2444
Query 232: 0.1368 At 20 docs: 0.2107 Recall
Query 233: 0.8424 At 30 docs: 0.1667
Query 235: 0.2958 At 100 docs: 0.0690
Query 236: 0.7000 At 200 docs: 0.0382 Run UBmonoEN01
Query 237: 1.0000 At 500 docs: 0.0165 Comparison to median by topic
Query 238: 0.3096 At 1000 docs: 0.0086
Query 239: 0.1123 +1.0
Query 240: 0.9056 R-Precision (prec. after R
Query 241: 0.0052 (=num_rel) docs. retrieved):
Query 242: 0.6811 Exact: 0.4608
Query 245: 0.8270
Query 246: 1.0000
Query 247: 1.0000 +0.5
Query 248: 1.0000
Query 249: 0.0383
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
JHU/APL, Monolingual Finnish, Auto, TD Run aplmofia
Average precision Overall statistics
(individual queries): (for 45 queries):
Recall−Precision Values
1.0
Query 201: 0.1104 Total number of documents
Query 202: 0.9449 over all queries
Query 203: 0.3175 Retrieved: 45000
Query 204: 0.9573 Relevant: 413
Query 205: 0.8556 Rel_ret: 395 0.8
Query 207: 0.3007
Query 208: 0.8199 Interpolated Recall -
Query 209: 0.0000 Precision Averages:
Query 210: 0.0667 at 0.00 0.6821
Query 211: 0.9875 at 0.10 0.6762 0.6
Query 212: 0.4341 at 0.20 0.6434
Query 213: 0.7178 at 0.30 0.6130
Query 214: 0.6667 at 0.40 0.5984
Precision
Query 215: 1.0000 at 0.50 0.5639
Query 216: 0.0042 at 0.60 0.5452 0.4
Query 217: 0.6879 at 0.70 0.4809
Query 218: 0.9217 at 0.80 0.4558
Query 219: 0.8082 at 0.90 0.4054
Query 220: 0.0455 at 1.00 0.3824
Query 221: 0.6978 0.2
Query 222: 0.1254 Avg. prec. (non-interpolated)
Query 223: 0.1335 for all rel. documents
Query 224: 1.0000 0.5393
Query 225: 0.8762 Precision:
Query 226: 1.0000 At 5 docs: 0.4489 0.0
Query 228: 0.0224 At 10 docs: 0.3756 0.0 0.2 0.4 0.6 0.8 1.0
Query 229: 0.0007 At 15 docs: 0.3126
Query 230: 0.4451 At 20 docs: 0.2600 Recall
Query 232: 0.0000 At 30 docs: 0.1919
Query 233: 0.6548 At 100 docs: 0.0713
Query 234: 0.4565 At 200 docs: 0.0406 Run aplmofia
Query 235: 0.5709 At 500 docs: 0.0171
Query 236: 0.9167 At 1000 docs: 0.0088 Comparison to median by topic
Query 237: 1.0000 +1.0
Query 238: 1.0000 R-Precision (prec. after R
Query 239: 0.4023 (=num_rel) docs. retrieved):
Query 241: 0.1452 Exact: 0.4724
Query 242: 0.2917
Query 243: 0.4022
Query 244: 0.5000 +0.5
Query 245: 1.0000
Query 246: 0.0833
Query 248: 0.8444
Query 249: 0.0521
Query 250: 1.0000
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
JHU/APL, Monolingual Finnish, Auto, TD Run aplmofib
Average precision Overall statistics
(individual queries): (for 45 queries):
Recall−Precision Values
1.0
Query 201: 0.1158 Total number of documents
Query 202: 0.9628 over all queries
Query 203: 0.6250 Retrieved: 45000
Query 204: 0.9452 Relevant: 413
Query 205: 0.8357 Rel_ret: 394 0.8
Query 207: 0.2475
Query 208: 0.8288 Interpolated Recall -
Query 209: 0.0000 Precision Averages:
Query 210: 0.0370 at 0.00 0.7011
Query 211: 0.9870 at 0.10 0.6909 0.6
Query 212: 0.3961 at 0.20 0.6694
Query 213: 0.6708 at 0.30 0.6356
Query 214: 0.3889 at 0.40 0.5834
Precision
Query 215: 1.0000 at 0.50 0.5609
Query 216: 0.0009 at 0.60 0.5338 0.4
Query 217: 0.5789 at 0.70 0.4791
Query 218: 0.9519 at 0.80 0.4568
Query 219: 0.7983 at 0.90 0.4158
Query 220: 0.0265 at 1.00 0.3893
Query 221: 0.7454 0.2
Query 222: 0.1323 Avg. prec. (non-interpolated)
Query 223: 0.1303 for all rel. documents
Query 224: 1.0000 0.5443
Query 225: 0.9029 Precision:
Query 226: 0.9822 At 5 docs: 0.4489 0.0
Query 228: 0.0197 At 10 docs: 0.3622 0.0 0.2 0.4 0.6 0.8 1.0
Query 229: 0.0011 At 15 docs: 0.2978
Query 230: 0.4881 At 20 docs: 0.2522 Recall
Query 232: 0.0000 At 30 docs: 0.1896
Query 233: 0.7004 At 100 docs: 0.0716
Query 234: 0.3629 At 200 docs: 0.0397 Run aplmofib
Query 235: 0.3998 At 500 docs: 0.0171
Query 236: 0.9167 At 1000 docs: 0.0088 Comparison to median by topic
Query 237: 1.0000 +1.0
Query 238: 1.0000 R-Precision (prec. after R
Query 239: 0.4346 (=num_rel) docs. retrieved):
Query 241: 0.1386 Exact: 0.4698
Query 242: 0.8333
Query 243: 0.4052
Query 244: 1.0000 +0.5
Query 245: 0.5000
Query 246: 0.1111
Query 248: 0.8583
Query 249: 0.0334
Query 250: 1.0000
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
JHU/APL, Monolingual Finnish, Auto, TD Run aplmofic
Average precision Overall statistics
(individual queries): (for 45 queries):
Recall−Precision Values
1.0
Query 201: 0.1031 Total number of documents
Query 202: 0.9314 over all queries
Query 203: 0.7778 Retrieved: 45000
Query 204: 0.9499 Relevant: 413
Query 205: 0.8357 Rel_ret: 392 0.8
Query 207: 0.3329
Query 208: 0.8141 Interpolated Recall -
Query 209: 0.0000 Precision Averages:
Query 210: 0.0476 at 0.00 0.6765
Query 211: 0.9833 at 0.10 0.6609 0.6
Query 212: 0.4302 at 0.20 0.6193
Query 213: 0.6486 at 0.30 0.6066
Query 214: 0.3889 at 0.40 0.5852
Precision
Query 215: 1.0000 at 0.50 0.5676
Query 216: 0.0000 at 0.60 0.5396 0.4
Query 217: 0.5962 at 0.70 0.4738
Query 218: 1.0000 at 0.80 0.4524
Query 219: 0.7666 at 0.90 0.4046
Query 220: 0.0134 at 1.00 0.3809
Query 221: 0.6787 0.2
Query 222: 0.1425 Avg. prec. (non-interpolated)
Query 223: 0.1305 for all rel. documents
Query 224: 1.0000 0.5336
Query 225: 0.8762 Precision:
Query 226: 1.0000 At 5 docs: 0.4311 0.0
Query 228: 0.0192 At 10 docs: 0.3489 0.0 0.2 0.4 0.6 0.8 1.0
Query 229: 0.0077 At 15 docs: 0.2993
Query 230: 0.2701 At 20 docs: 0.2478 Recall
Query 232: 0.0000 At 30 docs: 0.1852
Query 233: 0.6944 At 100 docs: 0.0704
Query 234: 0.0130 At 200 docs: 0.0393 Run aplmofic
Query 235: 0.5232 At 500 docs: 0.0169
Query 236: 0.9167 At 1000 docs: 0.0087 Comparison to median by topic
Query 237: 1.0000 +1.0
Query 238: 1.0000 R-Precision (prec. after R
Query 239: 0.3856 (=num_rel) docs. retrieved):
Query 241: 0.1550 Exact: 0.4711
Query 242: 0.8333
Query 243: 0.3441
Query 244: 1.0000 +0.5
Query 245: 0.5000
Query 246: 0.0714
Query 248: 0.8048
Query 249: 0.0275
Query 250: 1.0000
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
CLIPS, Monolingual Finnish, Auto, TDN Run CLIPS04MNFI1
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 45 queries): 1.0
Query 201: 0.2036 Total number of documents
Query 202: 0.8234 over all queries
Query 203: 0.5889 Retrieved: 45000
Query 204: 0.9801 Relevant: 413
Query 205: 0.5317 Rel_ret: 406
0.8
Query 207: 0.2374
Query 208: 0.8380 Interpolated Recall -
Query 209: 0.0000 Precision Averages:
Query 210: 0.2500 at 0.00 0.6993
Query 211: 0.9688 at 0.10 0.6804 0.6
Query 212: 0.4547 at 0.20 0.6726
Query 213: 0.8076 at 0.30 0.6529
Query 214: 0.5000 at 0.40 0.6017
Precision
Query 215: 0.1429 at 0.50 0.5742
Query 216: 0.2598 at 0.60 0.5168 0.4
Query 217: 0.6375 at 0.70 0.4538
Query 218: 0.9909 at 0.80 0.4278
Query 219: 0.6467 at 0.90 0.3871
Query 220: 0.1770 at 1.00 0.3540
Query 221: 0.6579 0.2
Query 222: 0.0767 Avg. prec. (non-interpolated)
Query 223: 0.1569 for all rel. documents
Query 224: 1.0000 0.5349
Query 225: 1.0000 Precision:
Query 226: 0.8692 At 5 docs: 0.4578 0.0
Query 228: 0.0071 At 10 docs: 0.3711 0.0 0.2 0.4 0.6 0.8 1.0
Query 229: 0.2100 At 15 docs: 0.3126
Query 230: 0.6519 At 20 docs: 0.2700 Recall
Query 232: 0.0625 At 30 docs: 0.2015
Query 233: 0.6036 At 100 docs: 0.0749
Query 234: 0.4891 At 200 docs: 0.0413 Run CLIPS04MNFI1
Query 235: 0.6430 At 500 docs: 0.0177 Comparison to median by topic
Query 236: 0.9167 At 1000 docs: 0.0090
Query 237: 1.0000 +1.0
Query 238: 0.7917 R-Precision (prec. after R
Query 239: 0.2638 (=num_rel) docs. retrieved):
Query 241: 0.3469 Exact: 0.4786
Query 242: 1.0000
Query 243: 0.0343
Query 244: 1.0000 +0.5
Query 245: 0.5000
Query 246: 0.0769
Query 248: 0.6433
Query 249: 0.0320
Query 250: 1.0000
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Dublin City University, Monolingual Finnish, Auto, TD Run exefinmono04a
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 45 queries): 1.0
Query 201: 0.1137 Total number of documents
Query 202: 0.9945 over all queries
Query 203: 0.4667 Retrieved: 41625
Query 204: 0.8707 Relevant: 413
Query 205: 0.7309 Rel_ret: 304
0.8
Query 207: 0.1347
Query 208: 0.7600 Interpolated Recall -
Query 209: 0.0000 Precision Averages:
Query 210: 0.0159 at 0.00 0.5637
Query 211: 0.9758 at 0.10 0.5390 0.6
Query 212: 0.1824 at 0.20 0.5264
Query 213: 0.7777 at 0.30 0.5047
Query 214: 0.0000 at 0.40 0.4746
Precision
Query 215: 0.1111 at 0.50 0.4406
Query 216: 0.0000 at 0.60 0.4185 0.4
Query 217: 0.6856 at 0.70 0.3659
Query 218: 0.9174 at 0.80 0.3536
Query 219: 0.0297 at 0.90 0.3092
Query 220: 0.0464 at 1.00 0.2815
Query 221: 0.7962 0.2
Query 222: 0.1253 Avg. prec. (non-interpolated)
Query 223: 0.1090 for all rel. documents
Query 224: 1.0000 0.4252
Query 225: 0.9667 Precision:
Query 226: 0.3732 At 5 docs: 0.3689 0.0
Query 228: 0.0000 At 10 docs: 0.2978 0.0 0.2 0.4 0.6 0.8 1.0
Query 229: 0.0000 At 15 docs: 0.2415
Query 230: 0.1513 At 20 docs: 0.1989 Recall
Query 232: 0.0000 At 30 docs: 0.1489
Query 233: 0.4902 At 100 docs: 0.0538
Query 234: 0.4788 At 200 docs: 0.0296 Run exefinmono04a
Query 235: 0.0028 At 500 docs: 0.0131 Comparison to median by topic
Query 236: 0.9167 At 1000 docs: 0.0068
Query 237: 1.0000 +1.0
Query 238: 0.7556 R-Precision (prec. after R
Query 239: 0.0008 (=num_rel) docs. retrieved):
Query 241: 0.1132 Exact: 0.3895
Query 242: 0.5000
Query 243: 0.2680
Query 244: 1.0000 +0.5
Query 245: 0.5000
Query 246: 0.1667
Query 248: 0.5248
Query 249: 0.0839
Query 250: 1.0000
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Dublin City University, Monolingual Finnish, Auto, TD Run exefinmono04l
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 45 queries): 1.0
Query 201: 0.1566 Total number of documents
Query 202: 0.9788 over all queries
Query 203: 0.6667 Retrieved: 42195
Query 204: 0.9466 Relevant: 413
Query 205: 0.6595 Rel_ret: 311
0.8
Query 207: 0.1347
Query 208: 0.8032 Interpolated Recall -
Query 209: 0.0000 Precision Averages:
Query 210: 0.0189 at 0.00 0.6034
Query 211: 0.9725 at 0.10 0.5709 0.6
Query 212: 0.1576 at 0.20 0.5371
Query 213: 0.8018 at 0.30 0.5125
Query 214: 0.0000 at 0.40 0.4670
Precision
Query 215: 0.1111 at 0.50 0.4414
Query 216: 0.0000 at 0.60 0.4152 0.4
Query 217: 0.6966 at 0.70 0.3647
Query 218: 0.9488 at 0.80 0.3554
Query 219: 0.1958 at 0.90 0.3138
Query 220: 0.0197 at 1.00 0.2862
Query 221: 0.7117 0.2
Query 222: 0.1153 Avg. prec. (non-interpolated)
Query 223: 0.0872 for all rel. documents
Query 224: 1.0000 0.4324
Query 225: 0.9667 Precision:
Query 226: 0.3783 At 5 docs: 0.3822 0.0
Query 228: 0.0000 At 10 docs: 0.3111 0.0 0.2 0.4 0.6 0.8 1.0
Query 229: 0.0000 At 15 docs: 0.2533
Query 230: 0.1338 At 20 docs: 0.2056 Recall
Query 232: 0.0000 At 30 docs: 0.1533
Query 233: 0.5204 At 100 docs: 0.0567
Query 234: 0.5039 At 200 docs: 0.0309 Run exefinmono04l
Query 235: 0.0556 At 500 docs: 0.0133 Comparison to median by topic
Query 236: 0.9167 At 1000 docs: 0.0069
Query 237: 1.0000 +1.0
Query 238: 0.7556 R-Precision (prec. after R
Query 239: 0.0006 (=num_rel) docs. retrieved):
Query 241: 0.1149 Exact: 0.3880
Query 242: 0.5000
Query 243: 0.2715
Query 244: 1.0000 +0.5
Query 245: 0.5000
Query 246: 0.1429
Query 248: 0.3650
Query 249: 0.1477
Query 250: 1.0000
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Dublin City University, Monolingual Finnish, Auto, TD Run exefinmono04q
Average precision Overall statistics
(individual queries): (for 45 queries): Recall−Precision Values
1.0
Query 201: 0.1040 Total number of documents
Query 202: 0.9746 over all queries
Query 203: 0.8667 Retrieved: 43506
Query 204: 0.8517 Relevant: 413
Query 205: 0.6583 Rel_ret: 327 0.8
Query 207: 0.1345
Query 208: 0.8177 Interpolated Recall -
Query 209: 0.0011 Precision Averages:
Query 210: 0.0102 at 0.00 0.5942
Query 211: 0.9753 at 0.10 0.5756 0.6
Query 212: 0.1976 at 0.20 0.5585
Query 213: 0.7870 at 0.30 0.5419
Query 214: 0.0000 at 0.40 0.5123
Precision
Query 215: 0.1000 at 0.50 0.4778
Query 216: 0.0000 at 0.60 0.4388 0.4
Query 217: 0.7028 at 0.70 0.3741
Query 218: 0.9188 at 0.80 0.3605
Query 219: 0.3054 at 0.90 0.3161
Query 220: 0.0512 at 1.00 0.2910
Query 221: 0.7783 0.2
Query 222: 0.1152 Avg. prec. (non-interpolated)
Query 223: 0.1358 for all rel. documents
Query 224: 1.0000 0.4489
Query 225: 0.9667 Precision:
Query 226: 0.2864 At 5 docs: 0.3911 0.0
Query 228: 0.0000 At 10 docs: 0.3067 0.0 0.2 0.4 0.6 0.8 1.0
Query 229: 0.0000 At 15 docs: 0.2504
Query 230: 0.1078 At 20 docs: 0.2122 Recall
Query 232: 0.0000 At 30 docs: 0.1563
Query 233: 0.5732 At 100 docs: 0.0578
Query 234: 0.4906 At 200 docs: 0.0320 Run exefinmono04q
Query 235: 0.0030 At 500 docs: 0.0141
Query 236: 0.9167 At 1000 docs: 0.0073 Comparison to median by topic
Query 237: 1.0000 +1.0
Query 238: 0.8667 R-Precision (prec. after R
Query 239: 0.0004 (=num_rel) docs. retrieved):
Query 241: 0.2081 Exact: 0.3976
Query 242: 0.7500
Query 243: 0.3033
Query 244: 1.0000 +0.5
Query 245: 0.5000
Query 246: 0.1250
Query 248: 0.4969
Query 249: 0.1214
Query 250: 1.0000
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Dublin City University, Monolingual Finnish, Auto, TD Run exefinmono04t
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 45 queries): 1.0
Query 201: 0.1038 Total number of documents
Query 202: 1.0000 over all queries
Query 203: 0.4667 Retrieved: 44293
Query 204: 0.9053 Relevant: 413
Query 205: 0.6754 Rel_ret: 333
0.8
Query 207: 0.1357
Query 208: 0.8177 Interpolated Recall -
Query 209: 0.0011 Precision Averages:
Query 210: 0.0108 at 0.00 0.5966
Query 211: 0.9758 at 0.10 0.5841 0.6
Query 212: 0.1918 at 0.20 0.5460
Query 213: 0.7786 at 0.30 0.5329
Query 214: 0.0000 at 0.40 0.5058
Precision
Query 215: 0.1429 at 0.50 0.4824
Query 216: 0.0000 at 0.60 0.4321 0.4
Query 217: 0.7279 at 0.70 0.3780
Query 218: 0.9667 at 0.80 0.3628
Query 219: 0.2751 at 0.90 0.3234
Query 220: 0.0747 at 1.00 0.2952
Query 221: 0.7783 0.2
Query 222: 0.1161 Avg. prec. (non-interpolated)
Query 223: 0.1467 for all rel. documents
Query 224: 1.0000 0.4481
Query 225: 0.9667 Precision:
Query 226: 0.2958 At 5 docs: 0.3822 0.0
Query 228: 0.0000 At 10 docs: 0.3089 0.0 0.2 0.4 0.6 0.8 1.0
Query 229: 0.0000 At 15 docs: 0.2578
Query 230: 0.3016 At 20 docs: 0.2111 Recall
Query 232: 0.0000 At 30 docs: 0.1578
Query 233: 0.5743 At 100 docs: 0.0573
Query 234: 0.4803 At 200 docs: 0.0321 Run exefinmono04t
Query 235: 0.1315 At 500 docs: 0.0143 Comparison to median by topic
Query 236: 0.9167 At 1000 docs: 0.0074
Query 237: 1.0000 +1.0
Query 238: 0.8667 R-Precision (prec. after R
Query 239: 0.0003 (=num_rel) docs. retrieved):
Query 241: 0.1208 Exact: 0.4041
Query 242: 0.7000
Query 243: 0.2839
Query 244: 1.0000 +0.5
Query 245: 0.5000
Query 246: 0.1250
Query 248: 0.5367
Query 249: 0.0744
Query 250: 1.0000
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Hummingbird, Monolingual Finnish, Auto, T Run humFI04t
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 45 queries): 1.0
Query 201: 0.1319 Total number of documents
Query 202: 0.8002 over all queries
Query 203: 0.9167 Retrieved: 41042
Query 204: 0.9239 Relevant: 413
Query 205: 0.4348 Rel_ret: 401
0.8
Query 207: 0.5846
Query 208: 0.5191 Interpolated Recall -
Query 209: 0.0000 Precision Averages:
Query 210: 1.0000 at 0.00 0.7776
Query 211: 0.9875 at 0.10 0.7290 0.6
Query 212: 0.4640 at 0.20 0.6941
Query 213: 0.6958 at 0.30 0.6613
Query 214: 0.5000 at 0.40 0.6064
Precision
Query 215: 0.0909 at 0.50 0.5907
Query 216: 0.5500 at 0.60 0.5274 0.4
Query 217: 0.7609 at 0.70 0.4597
Query 218: 0.9204 at 0.80 0.4425
Query 219: 0.4351 at 0.90 0.4076
Query 220: 0.0151 at 1.00 0.3549
Query 221: 0.8111 0.2
Query 222: 0.1307 Avg. prec. (non-interpolated)
Query 223: 0.0302 for all rel. documents
Query 224: 1.0000 0.5559
Query 225: 0.9667 Precision:
Query 226: 0.9169 At 5 docs: 0.4533 0.0
Query 228: 0.0000 At 10 docs: 0.3556 0.0 0.2 0.4 0.6 0.8 1.0
Query 229: 0.3103 At 15 docs: 0.2948
Query 230: 0.6528 At 20 docs: 0.2522 Recall
Query 232: 0.0048 At 30 docs: 0.1881
Query 233: 0.5414 At 100 docs: 0.0713
Query 234: 0.6294 At 200 docs: 0.0397 Run humFI04t
Query 235: 0.9409 At 500 docs: 0.0175 Comparison to median by topic
Query 236: 0.9167 At 1000 docs: 0.0089
Query 237: 1.0000 +1.0
Query 238: 0.2079 R-Precision (prec. after R
Query 239: 0.2406 (=num_rel) docs. retrieved):
Query 241: 0.1358 Exact: 0.4828
Query 242: 0.7500
Query 243: 0.2354
Query 244: 1.0000 +0.5
Query 245: 1.0000
Query 246: 0.0022
Query 248: 0.8433
Query 249: 0.0157
Query 250: 1.0000
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Hummingbird, Monolingual Finnish, Auto, TD Run humFI04td
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 45 queries): 1.0
Query 201: 0.1059 Total number of documents
Query 202: 0.8594 over all queries
Query 203: 1.0000 Retrieved: 45000
Query 204: 0.9238 Relevant: 413
Query 205: 0.7986 Rel_ret: 410
0.8
Query 207: 0.3658
Query 208: 0.8012 Interpolated Recall -
Query 209: 0.0000 Precision Averages:
Query 210: 1.0000 at 0.00 0.7762
Query 211: 0.9951 at 0.10 0.7414 0.6
Query 212: 0.4103 at 0.20 0.7006
Query 213: 0.7659 at 0.30 0.6834
Query 214: 0.4444 at 0.40 0.6267
Precision
Query 215: 0.0345 at 0.50 0.6154
Query 216: 0.6429 at 0.60 0.5805 0.4
Query 217: 0.7784 at 0.70 0.5369
Query 218: 0.9909 at 0.80 0.5079
Query 219: 0.4603 at 0.90 0.4510
Query 220: 0.0404 at 1.00 0.4220
Query 221: 0.9667 0.2
Query 222: 0.2514 Avg. prec. (non-interpolated)
Query 223: 0.0888 for all rel. documents
Query 224: 1.0000 0.5927
Query 225: 0.9667 Precision:
Query 226: 0.9492 At 5 docs: 0.4933 0.0
Query 228: 0.0092 At 10 docs: 0.3800 0.0 0.2 0.4 0.6 0.8 1.0
Query 229: 0.3070 At 15 docs: 0.3126
Query 230: 0.8750 At 20 docs: 0.2678 Recall
Query 232: 0.0018 At 30 docs: 0.1970
Query 233: 0.5519 At 100 docs: 0.0742
Query 234: 0.5087 At 200 docs: 0.0400 Run humFI04td
Query 235: 0.8755 At 500 docs: 0.0178 Comparison to median by topic
Query 236: 0.8667 At 1000 docs: 0.0091
Query 237: 1.0000 +1.0
Query 238: 1.0000 R-Precision (prec. after R
Query 239: 0.2180 (=num_rel) docs. retrieved):
Query 241: 0.3230 Exact: 0.5308
Query 242: 1.0000
Query 243: 0.3291
Query 244: 1.0000 +0.5
Query 245: 0.5000
Query 246: 0.0385
Query 248: 0.5442
Query 249: 0.0804
Query 250: 1.0000
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Hummingbird, Monolingual Finnish, Auto, TD Run humFI04tde
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 45 queries): 1.0
Query 201: 0.1639 Total number of documents
Query 202: 0.9285 over all queries
Query 203: 0.9167 Retrieved: 45000
Query 204: 0.9694 Relevant: 413
Query 205: 0.8722 Rel_ret: 411
0.8
Query 207: 0.3739
Query 208: 0.7843 Interpolated Recall -
Query 209: 0.0139 Precision Averages:
Query 210: 1.0000 at 0.00 0.7966
Query 211: 0.9951 at 0.10 0.7747 0.6
Query 212: 0.4907 at 0.20 0.7388
Query 213: 0.8183 at 0.30 0.7245
Query 214: 0.4667 at 0.40 0.6806
Precision
Query 215: 0.2000 at 0.50 0.6613
Query 216: 0.6429 at 0.60 0.6257 0.4
Query 217: 0.7496 at 0.70 0.5890
Query 218: 0.9909 at 0.80 0.5470
Query 219: 0.6317 at 0.90 0.4859
Query 220: 0.0792 at 1.00 0.4706
Query 221: 1.0000 0.2
Query 222: 0.2778 Avg. prec. (non-interpolated)
Query 223: 0.1390 for all rel. documents
Query 224: 1.0000 0.6367
Query 225: 1.0000 Precision:
Query 226: 0.9822 At 5 docs: 0.5511 0.0
Query 228: 0.0078 At 10 docs: 0.4222 0.0 0.2 0.4 0.6 0.8 1.0
Query 229: 0.5310 At 15 docs: 0.3467
Query 230: 0.9167 At 20 docs: 0.2900 Recall
Query 232: 0.0014 At 30 docs: 0.2119
Query 233: 0.6873 At 100 docs: 0.0782
Query 234: 0.7664 At 200 docs: 0.0431 Run humFI04tde
Query 235: 0.8973 At 500 docs: 0.0181 Comparison to median by topic
Query 236: 0.9167 At 1000 docs: 0.0091
Query 237: 1.0000 +1.0
Query 238: 1.0000 R-Precision (prec. after R
Query 239: 0.4576 (=num_rel) docs. retrieved):
Query 241: 0.3958 Exact: 0.5667
Query 242: 1.0000
Query 243: 0.3041
Query 244: 1.0000 +0.5
Query 245: 0.5000
Query 246: 0.1111
Query 248: 0.5867
Query 249: 0.0864
Query 250: 1.0000
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Padua, Monolingual Finnish, Auto, TD Run IMSMFIN
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 45 queries): 1.0
Query 201: 0.0001 Total number of documents
Query 202: 0.9066 over all queries
Query 203: 0.7222 Retrieved: 42506
Query 204: 0.1494 Relevant: 413 0.8
Query 205: 0.4013 Rel_ret: 258
Query 207: 0.0024
Query 208: 0.8337 Interpolated Recall -
Query 209: 0.0000 Precision Averages:
Query 210: 0.0278 at 0.00 0.6121
Query 211: 0.9115 at 0.10 0.5732 0.6
Query 212: 0.2271 at 0.20 0.4952
Query 213: 0.6857 at 0.30 0.4476
Query 214: 0.0000 at 0.40 0.3920
Precision
Query 215: 0.1429 at 0.50 0.3784
Query 216: 0.0007 at 0.60 0.3528 0.4
Query 217: 0.5789 at 0.70 0.3411
Query 218: 0.9909 at 0.80 0.3327
Query 219: 0.1589 at 0.90 0.3052
Query 220: 0.1303 at 1.00 0.2844
Query 221: 0.3787 0.2
Query 222: 0.1349 Avg. prec. (non-interpolated)
Query 223: 0.1201 for all rel. documents
Query 224: 1.0000 0.3962
Query 225: 0.7683 Precision:
Query 226: 0.0462 At 5 docs: 0.3556 0.0
Query 228: 0.0000 At 10 docs: 0.2578 0.0 0.2 0.4 0.6 0.8 1.0
Query 229: 0.0000 At 15 docs: 0.2089
Query 230: 0.6845 At 20 docs: 0.1767 Recall
Query 232: 0.0000 At 30 docs: 0.1252
Query 233: 0.3169 At 100 docs: 0.0471
Query 234: 0.1762 At 200 docs: 0.0252 Run IMSMFIN
Query 235: 0.0459 At 500 docs: 0.0108 Comparison to median by topic
Query 236: 1.0000 At 1000 docs: 0.0057
Query 237: 1.0000 +1.0
Query 238: 1.0000 R-Precision (prec. after R
Query 239: 0.0602 (=num_rel) docs. retrieved):
Query 241: 0.0477 Exact: 0.3612
Query 242: 1.0000
Query 243: 0.4517
Query 244: 0.3333 +0.5
Query 245: 1.0000
Query 246: 0.0385
Query 248: 0.8100
Query 249: 0.0475
Query 250: 0.5000
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Padua, Monolingual Finnish, Auto, TD Run IMSMFIP
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 45 queries): 1.0
Query 201: 0.1306 Total number of documents
Query 202: 0.8569 over all queries
Query 203: 0.9167 Retrieved: 45000
Query 204: 0.7557 Relevant: 413 0.8
Query 205: 0.6898 Rel_ret: 346
Query 207: 0.0158
Query 208: 0.7876 Interpolated Recall -
Query 209: 0.0000 Precision Averages:
Query 210: 0.0476 at 0.00 0.6632
Query 211: 0.9438 at 0.10 0.6157 0.6
Query 212: 0.2565 at 0.20 0.5649
Query 213: 0.6452 at 0.30 0.5391
Query 214: 0.0000 at 0.40 0.5090
Precision
Query 215: 0.1000 at 0.50 0.4644
Query 216: 0.0007 at 0.60 0.4286 0.4
Query 217: 0.6016 at 0.70 0.3926
Query 218: 0.9833 at 0.80 0.3747
Query 219: 0.4101 at 0.90 0.3428
Query 220: 0.0955 at 1.00 0.3237
Query 221: 0.3016 0.2
Query 222: 0.1643 Avg. prec. (non-interpolated)
Query 223: 0.1020 for all rel. documents
Query 224: 1.0000 0.4631
Query 225: 0.7862 Precision:
Query 226: 0.2291 At 5 docs: 0.4133 0.0
Query 228: 0.0000 At 10 docs: 0.2956 0.0 0.2 0.4 0.6 0.8 1.0
Query 229: 0.0000 At 15 docs: 0.2504
Query 230: 0.6361 At 20 docs: 0.2111 Recall
Query 232: 0.0000 At 30 docs: 0.1578
Query 233: 0.3610 At 100 docs: 0.0611
Query 234: 0.5018 At 200 docs: 0.0340 Run IMSMFIP
Query 235: 0.1363 At 500 docs: 0.0145 Comparison to median by topic
Query 236: 0.9167 At 1000 docs: 0.0077
Query 237: 1.0000 +1.0
Query 238: 1.0000 R-Precision (prec. after R
Query 239: 0.1680 (=num_rel) docs. retrieved):
Query 241: 0.1205 Exact: 0.4371
Query 242: 0.7500
Query 243: 0.2212
Query 244: 1.0000 +0.5
Query 245: 1.0000
Query 246: 0.1250
Query 248: 0.8529
Query 249: 0.2275
Query 250: 1.0000
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Padua, Monolingual Finnish, Auto, TD Run IMSMFIPqe
Average precision Overall statistics
(individual queries): (for 45 queries):
Recall−Precision Values
1.0
Query 201: 0.0373 Total number of documents
Query 202: 0.9316 over all queries
Query 203: 0.4111 Retrieved: 45000
Query 204: 0.3439 Relevant: 413
Query 205: 0.8093 Rel_ret: 325 0.8
Query 207: 0.0117
Query 208: 0.6431 Interpolated Recall -
Query 209: 0.3333 Precision Averages:
Query 210: 0.0204 at 0.00 0.6033
Query 211: 0.9241 at 0.10 0.5657 0.6
Query 212: 0.0419 at 0.20 0.5429
Query 213: 0.6393 at 0.30 0.5182
Query 214: 0.0000 at 0.40 0.4969
Precision
Query 215: 0.0047 at 0.50 0.4695
Query 216: 0.0000 at 0.60 0.4395 0.4
Query 217: 0.6389 at 0.70 0.4106
Query 218: 0.9310 at 0.80 0.3919
Query 219: 0.8482 at 0.90 0.3244
Query 220: 0.0024 at 1.00 0.3194
Query 221: 0.4724 0.2
Query 222: 0.0980 Avg. prec. (non-interpolated)
Query 223: 0.0873 for all rel. documents
Query 224: 1.0000 0.4525
Query 225: 0.9429 Precision:
Query 226: 0.6213 At 5 docs: 0.3956 0.0
Query 228: 0.0000 At 10 docs: 0.2778 0.0 0.2 0.4 0.6 0.8 1.0
Query 229: 0.0000 At 15 docs: 0.2370
Query 230: 0.9167 At 20 docs: 0.1900 Recall
Query 232: 0.0000 At 30 docs: 0.1370
Query 233: 0.4924 At 100 docs: 0.0500
Query 234: 0.2683 At 200 docs: 0.0280 Run IMSMFIPqe
Query 235: 0.0096 At 500 docs: 0.0134
Query 236: 1.0000 At 1000 docs: 0.0072 Comparison to median by topic
Query 237: 1.0000 +1.0
Query 238: 1.0000 R-Precision (prec. after R
Query 239: 0.1518 (=num_rel) docs. retrieved):
Query 241: 0.0244 Exact: 0.4157
Query 242: 1.0000
Query 243: 0.1387
Query 244: 0.5000 +0.5
Query 245: 1.0000
Query 246: 0.0667
Query 248: 0.9429
Query 249: 0.0574
Query 250: 1.0000
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Padua, Monolingual Finnish, Auto, TD Run IMSMFIUa65
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 45 queries): 1.0
Query 201: 0.0263 Total number of documents
Query 202: 0.8957 over all queries
Query 203: 0.6111 Retrieved: 45000
Query 204: 0.3080 Relevant: 413
Query 205: 0.5146 Rel_ret: 305
0.8
Query 207: 0.0106
Query 208: 0.8034 Interpolated Recall -
Query 209: 0.0000 Precision Averages:
Query 210: 0.2000 at 0.00 0.5954
Query 211: 0.9780 at 0.10 0.5501 0.6
Query 212: 0.2750 at 0.20 0.5229
Query 213: 0.7477 at 0.30 0.4623
Query 214: 0.0000 at 0.40 0.4222
Precision
Query 215: 0.1429 at 0.50 0.3982
Query 216: 0.0006 at 0.60 0.3733 0.4
Query 217: 0.5916 at 0.70 0.3445
Query 218: 1.0000 at 0.80 0.3360
Query 219: 0.0786 at 0.90 0.3141
Query 220: 0.0391 at 1.00 0.2988
Query 221: 0.3832 0.2
Query 222: 0.0934 Avg. prec. (non-interpolated)
Query 223: 0.1195 for all rel. documents
Query 224: 1.0000 0.4070
Query 225: 0.7862 Precision:
Query 226: 0.0283 At 5 docs: 0.3689 0.0
Query 228: 0.0000 At 10 docs: 0.2733 0.0 0.2 0.4 0.6 0.8 1.0
Query 229: 0.0000 At 15 docs: 0.2193
Query 230: 0.8875 At 20 docs: 0.1889 Recall
Query 232: 0.0000 At 30 docs: 0.1430
Query 233: 0.2791 At 100 docs: 0.0547
Query 234: 0.3428 At 200 docs: 0.0298 Run IMSMFIUa65
Query 235: 0.0382 At 500 docs: 0.0130 Comparison to median by topic
Query 236: 1.0000 At 1000 docs: 0.0068
Query 237: 1.0000 +1.0
Query 238: 0.9167 R-Precision (prec. after R
Query 239: 0.0869 (=num_rel) docs. retrieved):
Query 241: 0.3645 Exact: 0.3675
Query 242: 1.0000
Query 243: 0.2635
Query 244: 1.0000 +0.5
Query 245: 0.5000
Query 246: 0.0588
Query 248: 0.7862
Query 249: 0.0313
Query 250: 0.1250
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Padua, Monolingual Finnish, Auto, TD Run IMSMFIUd65
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 45 queries): 1.0
Query 201: 0.0143 Total number of documents
Query 202: 0.8861 over all queries
Query 203: 0.8333 Retrieved: 45000
Query 204: 0.1534 Relevant: 413
Query 205: 0.3950 Rel_ret: 295
0.8
Query 207: 0.0018
Query 208: 0.8044 Interpolated Recall -
Query 209: 0.0000 Precision Averages:
Query 210: 0.0625 at 0.00 0.5842
Query 211: 0.9690 at 0.10 0.5346 0.6
Query 212: 0.1968 at 0.20 0.4859
Query 213: 0.7497 at 0.30 0.4534
Query 214: 0.0000 at 0.40 0.4074
Precision
Query 215: 0.1667 at 0.50 0.3848
Query 216: 0.0007 at 0.60 0.3657 0.4
Query 217: 0.5675 at 0.70 0.3369
Query 218: 1.0000 at 0.80 0.3337
Query 219: 0.1506 at 0.90 0.3096
Query 220: 0.0463 at 1.00 0.3008
Query 221: 0.3806 0.2
Query 222: 0.1101 Avg. prec. (non-interpolated)
Query 223: 0.1043 for all rel. documents
Query 224: 1.0000 0.3956
Query 225: 0.7683 Precision:
Query 226: 0.0444 At 5 docs: 0.3422 0.0
Query 228: 0.0000 At 10 docs: 0.2600 0.0 0.2 0.4 0.6 0.8 1.0
Query 229: 0.0000 At 15 docs: 0.2089
Query 230: 0.5333 At 20 docs: 0.1756 Recall
Query 232: 0.0000 At 30 docs: 0.1311
Query 233: 0.4143 At 100 docs: 0.0493
Query 234: 0.1667 At 200 docs: 0.0266 Run IMSMFIUd65
Query 235: 0.0421 At 500 docs: 0.0119 Comparison to median by topic
Query 236: 1.0000 At 1000 docs: 0.0066
Query 237: 1.0000 +1.0
Query 238: 0.9167 R-Precision (prec. after R
Query 239: 0.0657 (=num_rel) docs. retrieved):
Query 241: 0.0566 Exact: 0.3479
Query 242: 0.4167
Query 243: 0.3037
Query 244: 1.0000 +0.5
Query 245: 0.5000
Query 246: 0.1111
Query 248: 0.8350
Query 249: 0.0335
Query 250: 1.0000
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Alicante, Monolingual Finnish, Auto, TD Run IRn−MF−Dexp
Average precision Overall statistics
(individual queries): (for 45 queries):
Recall−Precision Values
1.0
Query 201: 0.0923 Total number of documents
Query 202: 0.9274 over all queries
Query 203: 0.4778 Retrieved: 45000
Query 204: 0.8660 Relevant: 413
Query 205: 0.3774 Rel_ret: 390 0.8
Query 207: 0.2509
Query 208: 0.6320 Interpolated Recall -
Query 209: 0.0000 Precision Averages:
Query 210: 0.0588 at 0.00 0.6849
Query 211: 1.0000 at 0.10 0.6546 0.6
Query 212: 0.4007 at 0.20 0.5673
Query 213: 0.7947 at 0.30 0.5547
Query 214: 0.0222 at 0.40 0.5327
Precision
Query 215: 0.1429 at 0.50 0.5236
Query 216: 0.0045 at 0.60 0.5030 0.4
Query 217: 0.7148 at 0.70 0.4679
Query 218: 0.9587 at 0.80 0.4337
Query 219: 0.4358 at 0.90 0.3635
Query 220: 0.0236 at 1.00 0.3227
Query 221: 0.8529 0.2
Query 222: 0.3511 Avg. prec. (non-interpolated)
Query 223: 0.1636 for all rel. documents
Query 224: 1.0000 0.4914
Query 225: 1.0000 Precision:
Query 226: 0.4742 At 5 docs: 0.4533 0.0
Query 228: 0.0000 At 10 docs: 0.3511 0.0 0.2 0.4 0.6 0.8 1.0
Query 229: 0.2780 At 15 docs: 0.2963
Query 230: 0.5561 At 20 docs: 0.2567 Recall
Query 232: 0.0000 At 30 docs: 0.1874
Query 233: 0.6786 At 100 docs: 0.0700
Query 234: 0.6457 At 200 docs: 0.0379 Run IRn−MF−Dexp
Query 235: 0.8472 At 500 docs: 0.0168
Query 236: 0.8056 At 1000 docs: 0.0087 Comparison to median by topic
Query 237: 1.0000 +1.0
Query 238: 0.4429 R-Precision (prec. after R
Query 239: 0.2835 (=num_rel) docs. retrieved):
Query 241: 0.0594 Exact: 0.4464
Query 242: 1.0000
Query 243: 0.3175
Query 244: 1.0000 +0.5
Query 245: 1.0000
Query 246: 0.0370
Query 248: 0.5311
Query 249: 0.1097
Query 250: 0.5000
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Alicante, Monolingual Finnish, Auto, TD Run IRn−MF−nexp
Average precision Overall statistics
(individual queries): (for 45 queries):
Recall−Precision Values
1.0
Query 201: 0.0820 Total number of documents
Query 202: 0.8888 over all queries
Query 203: 0.7000 Retrieved: 45000
Query 204: 0.7558 Relevant: 413
Query 205: 0.5223 Rel_ret: 384 0.8
Query 207: 0.2874
Query 208: 0.5910 Interpolated Recall -
Query 209: 0.0000 Precision Averages:
Query 210: 0.0500 at 0.00 0.6528
Query 211: 1.0000 at 0.10 0.6212 0.6
Query 212: 0.3533 at 0.20 0.5597
Query 213: 0.6982 at 0.30 0.5564
Query 214: 0.0516 at 0.40 0.4904
Precision
Query 215: 0.1667 at 0.50 0.4792
Query 216: 0.0031 at 0.60 0.4412 0.4
Query 217: 0.5938 at 0.70 0.3940
Query 218: 0.9909 at 0.80 0.3770
Query 219: 0.2676 at 0.90 0.3170
Query 220: 0.0324 at 1.00 0.2946
Query 221: 0.5191 0.2
Query 222: 0.1799 Avg. prec. (non-interpolated)
Query 223: 0.0780 for all rel. documents
Query 224: 1.0000 0.4533
Query 225: 0.9667 Precision:
Query 226: 0.2940 At 5 docs: 0.4044 0.0
Query 228: 0.0003 At 10 docs: 0.3222 0.0 0.2 0.4 0.6 0.8 1.0
Query 229: 0.2197 At 15 docs: 0.2696
Query 230: 0.8304 At 20 docs: 0.2311 Recall
Query 232: 0.0000 At 30 docs: 0.1770
Query 233: 0.6159 At 100 docs: 0.0669
Query 234: 0.5132 At 200 docs: 0.0367 Run IRn−MF−nexp
Query 235: 0.7580 At 500 docs: 0.0164
Query 236: 0.8056 At 1000 docs: 0.0085 Comparison to median by topic
Query 237: 1.0000 +1.0
Query 238: 0.3869 R-Precision (prec. after R
Query 239: 0.1621 (=num_rel) docs. retrieved):
Query 241: 0.0523 Exact: 0.3997
Query 242: 0.5833
Query 243: 0.2749
Query 244: 1.0000 +0.5
Query 245: 1.0000
Query 246: 0.0133
Query 248: 0.5033
Query 249: 0.1081
Query 250: 0.5000
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Alicante, Monolingual Finnish, Auto, TD Run IRn−MF−Pexp
Average precision Overall statistics
(individual queries): (for 45 queries):
Recall−Precision Values
1.0
Query 201: 0.0977 Total number of documents
Query 202: 0.9109 over all queries
Query 203: 0.4778 Retrieved: 45000
Query 204: 0.8660 Relevant: 413
Query 205: 0.3774 Rel_ret: 391 0.8
Query 207: 0.2509
Query 208: 0.6690 Interpolated Recall -
Query 209: 0.0000 Precision Averages:
Query 210: 0.0455 at 0.00 0.6782
Query 211: 1.0000 at 0.10 0.6563 0.6
Query 212: 0.4007 at 0.20 0.5778
Query 213: 0.7947 at 0.30 0.5590
Query 214: 0.0230 at 0.40 0.5282
Precision
Query 215: 0.2000 at 0.50 0.5152
Query 216: 0.0026 at 0.60 0.4978 0.4
Query 217: 0.7224 at 0.70 0.4645
Query 218: 0.9587 at 0.80 0.4317
Query 219: 0.4358 at 0.90 0.3643
Query 220: 0.0172 at 1.00 0.3233
Query 221: 0.8529 0.2
Query 222: 0.3413 Avg. prec. (non-interpolated)
Query 223: 0.1498 for all rel. documents
Query 224: 1.0000 0.4908
Query 225: 1.0000 Precision:
Query 226: 0.4847 At 5 docs: 0.4533 0.0
Query 228: 0.0000 At 10 docs: 0.3511 0.0 0.2 0.4 0.6 0.8 1.0
Query 229: 0.2404 At 15 docs: 0.2963
Query 230: 0.5701 At 20 docs: 0.2522 Recall
Query 232: 0.0000 At 30 docs: 0.1874
Query 233: 0.6786 At 100 docs: 0.0696
Query 234: 0.6457 At 200 docs: 0.0379 Run IRn−MF−Pexp
Query 235: 0.8472 At 500 docs: 0.0168
Query 236: 0.8056 At 1000 docs: 0.0087 Comparison to median by topic
Query 237: 1.0000 +1.0
Query 238: 0.4206 R-Precision (prec. after R
Query 239: 0.2589 (=num_rel) docs. retrieved):
Query 241: 0.0594 Exact: 0.4517
Query 242: 1.0000
Query 243: 0.3044
Query 244: 1.0000 +0.5
Query 245: 1.0000
Query 246: 0.0370
Query 248: 0.5311
Query 249: 0.1097
Query 250: 0.5000
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Thomson Legal, Monolingual Finnish, Auto, TD Run tlrfi1
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 45 queries): 1.0
Query 201: 0.0231 Total number of documents
Query 202: 0.7765 over all queries
Query 203: 1.0000 Retrieved: 45000
Query 204: 0.9186 Relevant: 413
Query 205: 0.8833 Rel_ret: 389
0.8
Query 207: 0.3981
Query 208: 0.7273 Interpolated Recall -
Query 209: 0.0000 Precision Averages:
Query 210: 0.5000 at 0.00 0.7457
Query 211: 1.0000 at 0.10 0.7179 0.6
Query 212: 0.4497 at 0.20 0.6708
Query 213: 0.7928 at 0.30 0.6262
Query 214: 0.2063 at 0.40 0.6116
Precision
Query 215: 0.0769 at 0.50 0.5958
Query 216: 0.5588 at 0.60 0.5445 0.4
Query 217: 0.6291 at 0.70 0.5016
Query 218: 1.0000 at 0.80 0.4732
Query 219: 0.5049 at 0.90 0.4021
Query 220: 0.0643 at 1.00 0.3839
Query 221: 0.6676 0.2
Query 222: 0.1860 Avg. prec. (non-interpolated)
Query 223: 0.0716 for all rel. documents
Query 224: 1.0000 0.5551
Query 225: 0.9429 Precision:
Query 226: 0.6164 At 5 docs: 0.4533 0.0
Query 228: 0.0015 At 10 docs: 0.3756 0.0 0.2 0.4 0.6 0.8 1.0
Query 229: 0.2684 At 15 docs: 0.3156
Query 230: 0.8750 At 20 docs: 0.2744 Recall
Query 232: 0.0016 At 30 docs: 0.1978
Query 233: 0.6560 At 100 docs: 0.0731
Query 234: 0.3332 At 200 docs: 0.0392 Run tlrfi1
Query 235: 0.8250 At 500 docs: 0.0165 Comparison to median by topic
Query 236: 0.9167 At 1000 docs: 0.0086
Query 237: 1.0000 +1.0
Query 238: 0.9167 R-Precision (prec. after R
Query 239: 0.3167 (=num_rel) docs. retrieved):
Query 241: 0.3018 Exact: 0.4994
Query 242: 1.0000
Query 243: 0.4392
Query 244: 1.0000 +0.5
Query 245: 0.5000
Query 246: 0.0244
Query 248: 0.4969
Query 249: 0.1106
Query 250: 1.0000
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Thomson Legal, Monolingual Finnish, Auto, TD Run tlrfi2
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 45 queries): 1.0
Query 201: 0.0475 Total number of documents
Query 202: 0.7683 over all queries
Query 203: 1.0000 Retrieved: 45000
Query 204: 0.9389 Relevant: 413
Query 205: 0.8833 Rel_ret: 383
0.8
Query 207: 0.3981
Query 208: 0.7273 Interpolated Recall -
Query 209: 0.0000 Precision Averages:
Query 210: 0.5000 at 0.00 0.7621
Query 211: 1.0000 at 0.10 0.7122 0.6
Query 212: 0.4497 at 0.20 0.6625
Query 213: 0.7928 at 0.30 0.6266
Query 214: 0.2063 at 0.40 0.6125
Precision
Query 215: 0.0769 at 0.50 0.5941
Query 216: 0.5588 at 0.60 0.5446 0.4
Query 217: 0.6291 at 0.70 0.5040
Query 218: 1.0000 at 0.80 0.4762
Query 219: 0.5193 at 0.90 0.4057
Query 220: 0.0643 at 1.00 0.3846
Query 221: 0.6676 0.2
Query 222: 0.1860 Avg. prec. (non-interpolated)
Query 223: 0.0716 for all rel. documents
Query 224: 1.0000 0.5562
Query 225: 0.9429 Precision:
Query 226: 0.6164 At 5 docs: 0.4578 0.0
Query 228: 0.0015 At 10 docs: 0.3733 0.0 0.2 0.4 0.6 0.8 1.0
Query 229: 0.2684 At 15 docs: 0.3111
Query 230: 0.8750 At 20 docs: 0.2744 Recall
Query 232: 0.0027 At 30 docs: 0.1993
Query 233: 0.6560 At 100 docs: 0.0733
Query 234: 0.4184 At 200 docs: 0.0393 Run tlrfi2
Query 235: 0.8250 At 500 docs: 0.0165 Comparison to median by topic
Query 236: 0.9167 At 1000 docs: 0.0085
Query 237: 1.0000 +1.0
Query 238: 0.9167 R-Precision (prec. after R
Query 239: 0.3167 (=num_rel) docs. retrieved):
Query 241: 0.2317 Exact: 0.5027
Query 242: 1.0000
Query 243: 0.4392
Query 244: 1.0000 +0.5
Query 245: 0.5000
Query 246: 0.0233
Query 248: 0.5367
Query 249: 0.0550
Query 250: 1.0000
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Amsterdam, Monolingual Finnish, Auto, TD Run UAmsC04FiFi4GiSb
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 45 queries): 1.0
Query 201: 0.0868 Total number of documents
Query 202: 0.9231 over all queries
Query 203: 0.4206 Retrieved: 45000
Query 204: 0.9478 Relevant: 413
Query 205: 0.8307 Rel_ret: 379
0.8
Query 207: 0.1980
Query 208: 0.7994 Interpolated Recall -
Query 209: 0.0000 Precision Averages:
Query 210: 0.0526 at 0.00 0.6180
Query 211: 0.9306 at 0.10 0.6048 0.6
Query 212: 0.3205 at 0.20 0.5736
Query 213: 0.8554 at 0.30 0.5642
Query 214: 0.0812 at 0.40 0.5251
Precision
Query 215: 0.2500 at 0.50 0.5060
Query 216: 0.0014 at 0.60 0.4902 0.4
Query 217: 0.6783 at 0.70 0.4285
Query 218: 1.0000 at 0.80 0.4019
Query 219: 0.7265 at 0.90 0.3305
Query 220: 0.0455 at 1.00 0.2842
Query 221: 0.8000 0.2
Query 222: 0.1872 Avg. prec. (non-interpolated)
Query 223: 0.2040 for all rel. documents
Query 224: 0.2500 0.4787
Query 225: 0.7962 Precision:
Query 226: 0.9822 At 5 docs: 0.4267 0.0
Query 228: 0.0055 At 10 docs: 0.3600 0.0 0.2 0.4 0.6 0.8 1.0
Query 229: 0.0017 At 15 docs: 0.3067
Query 230: 0.7095 At 20 docs: 0.2489 Recall
Query 232: 0.0013 At 30 docs: 0.1837
Query 233: 0.5577 At 100 docs: 0.0691
Query 234: 0.6921 At 200 docs: 0.0379 Run UAmsC04FiFi4GiSb
Query 235: 0.4361 At 500 docs: 0.0165 Comparison to median by topic
Query 236: 0.9167 At 1000 docs: 0.0084
Query 237: 0.9500 +1.0
Query 238: 0.7917 R-Precision (prec. after R
Query 239: 0.1804 (=num_rel) docs. retrieved):
Query 241: 0.1871 Exact: 0.4208
Query 242: 0.4167
Query 243: 0.3162
Query 244: 0.0476 +0.5
Query 245: 1.0000
Query 246: 0.0345
Query 248: 0.9250
Query 249: 0.0028
Query 250: 1.0000
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Amsterdam, Monolingual Finnish, Auto, TD Run UAmsC04FiFi4GiWd
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 45 queries): 1.0
Query 201: 0.0577 Total number of documents
Query 202: 0.9255 over all queries
Query 203: 0.4111 Retrieved: 45000
Query 204: 0.8439 Relevant: 413
Query 205: 0.8502 Rel_ret: 378
0.8
Query 207: 0.1724
Query 208: 0.8097 Interpolated Recall -
Query 209: 0.0000 Precision Averages:
Query 210: 0.0625 at 0.00 0.6568
Query 211: 0.9255 at 0.10 0.6494 0.6
Query 212: 0.3460 at 0.20 0.6189
Query 213: 0.8374 at 0.30 0.5963
Query 214: 0.3939 at 0.40 0.5473
Precision
Query 215: 0.1667 at 0.50 0.5258
Query 216: 0.0023 at 0.60 0.5002 0.4
Query 217: 0.6733 at 0.70 0.4416
Query 218: 1.0000 at 0.80 0.4099
Query 219: 0.6454 at 0.90 0.3340
Query 220: 0.0406 at 1.00 0.3007
Query 221: 0.9000 0.2
Query 222: 0.1394 Avg. prec. (non-interpolated)
Query 223: 0.1716 for all rel. documents
Query 224: 0.5000 0.5007
Query 225: 0.9429 Precision:
Query 226: 0.9752 At 5 docs: 0.4489 0.0
Query 228: 0.0094 At 10 docs: 0.3622 0.0 0.2 0.4 0.6 0.8 1.0
Query 229: 0.0669 At 15 docs: 0.3022
Query 230: 0.6679 At 20 docs: 0.2467 Recall
Query 232: 0.0000 At 30 docs: 0.1830
Query 233: 0.5749 At 100 docs: 0.0669
Query 234: 0.5509 At 200 docs: 0.0369 Run UAmsC04FiFi4GiWd
Query 235: 0.5116 At 500 docs: 0.0163 Comparison to median by topic
Query 236: 0.8056 At 1000 docs: 0.0084
Query 237: 1.0000 +1.0
Query 238: 0.7576 R-Precision (prec. after R
Query 239: 0.1667 (=num_rel) docs. retrieved):
Query 241: 0.1605 Exact: 0.4357
Query 242: 0.7500
Query 243: 0.6138
Query 244: 0.1429 +0.5
Query 245: 1.0000
Query 246: 0.0294
Query 248: 0.9250
Query 249: 0.0060
Query 250: 1.0000
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Amsterdam, Monolingual Finnish, Auto, TD Run UAmsC04FiFiAll
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 45 queries): 1.0
Query 201: 0.0881 Total number of documents
Query 202: 0.9437 over all queries
Query 203: 0.6667 Retrieved: 45000
Query 204: 0.9242 Relevant: 413
Query 205: 0.8000 Rel_ret: 393
0.8
Query 207: 0.1709
Query 208: 0.8167 Interpolated Recall -
Query 209: 0.0000 Precision Averages:
Query 210: 0.0556 at 0.00 0.6591
Query 211: 0.9342 at 0.10 0.6480 0.6
Query 212: 0.3460 at 0.20 0.6232
Query 213: 0.8402 at 0.30 0.6192
Query 214: 0.1035 at 0.40 0.5739
Precision
Query 215: 0.2000 at 0.50 0.5553
Query 216: 0.0042 at 0.60 0.5257 0.4
Query 217: 0.7577 at 0.70 0.4561
Query 218: 1.0000 at 0.80 0.4321
Query 219: 0.6928 at 0.90 0.3662
Query 220: 0.0750 at 1.00 0.3313
Query 221: 0.7878 0.2
Query 222: 0.1264 Avg. prec. (non-interpolated)
Query 223: 0.1955 for all rel. documents
Query 224: 1.0000 0.5203
Query 225: 0.9029 Precision:
Query 226: 0.9752 At 5 docs: 0.4667 0.0
Query 228: 0.0141 At 10 docs: 0.3667 0.0 0.2 0.4 0.6 0.8 1.0
Query 229: 0.0236 At 15 docs: 0.2993
Query 230: 0.8304 At 20 docs: 0.2444 Recall
Query 232: 0.0000 At 30 docs: 0.1785
Query 233: 0.5718 At 100 docs: 0.0691
Query 234: 0.5935 At 200 docs: 0.0383 Run UAmsC04FiFiAll
Query 235: 0.5084 At 500 docs: 0.0168 Comparison to median by topic
Query 236: 0.9167 At 1000 docs: 0.0087
Query 237: 1.0000 +1.0
Query 238: 0.8667 R-Precision (prec. after R
Query 239: 0.1485 (=num_rel) docs. retrieved):
Query 241: 0.1820 Exact: 0.4632
Query 242: 0.5833
Query 243: 0.4583
Query 244: 0.3333 +0.5
Query 245: 1.0000
Query 246: 0.0294
Query 248: 0.9429
Query 249: 0.0048
Query 250: 1.0000
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
SUNY Buffalo, Monolingual Finnish, Auto, TD Run UBmonoFI01
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 45 queries): 1.0
Query 201: 0.0663 Total number of documents
Query 202: 0.9199 over all queries
Query 203: 1.0000 Retrieved: 43659
Query 204: 0.8713 Relevant: 413 0.8
Query 205: 0.7633 Rel_ret: 318
Query 207: 0.0929
Query 208: 0.7382 Interpolated Recall -
Query 209: 0.0000 Precision Averages:
Query 210: 0.0625 at 0.00 0.6263
Query 211: 1.0000 at 0.10 0.5840 0.6
Query 212: 0.1913 at 0.20 0.5494
Query 213: 0.6603 at 0.30 0.5357
Query 214: 0.0000 at 0.40 0.4996
Precision
Query 215: 0.0526 at 0.50 0.4800
Query 216: 0.0000 at 0.60 0.4604 0.4
Query 217: 0.7329 at 0.70 0.4038
Query 218: 0.8656 at 0.80 0.3827
Query 219: 0.5395 at 0.90 0.3427
Query 220: 0.0000 at 1.00 0.3319
Query 221: 0.1743 0.2
Query 222: 0.0452 Avg. prec. (non-interpolated)
Query 223: 0.1328 for all rel. documents
Query 224: 1.0000 0.4599
Query 225: 0.7862 Precision:
Query 226: 0.3114 At 5 docs: 0.3956 0.0
Query 228: 0.0000 At 10 docs: 0.3067 0.0 0.2 0.4 0.6 0.8 1.0
Query 229: 0.0000 At 15 docs: 0.2563
Query 230: 1.0000 At 20 docs: 0.2189 Recall
Query 232: 0.0000 At 30 docs: 0.1541
Query 233: 0.4351 At 100 docs: 0.0562
Query 234: 0.5039 At 200 docs: 0.0310 Run UBmonoFI01
Query 235: 0.1841 At 500 docs: 0.0136 Comparison to median by topic
Query 236: 0.9167 At 1000 docs: 0.0071
Query 237: 1.0000 +1.0
Query 238: 0.7222 R-Precision (prec. after R
Query 239: 0.0921 (=num_rel) docs. retrieved):
Query 241: 0.0154 Exact: 0.4545
Query 242: 0.7500
Query 243: 0.4128
Query 244: 1.0000 +0.5
Query 245: 1.0000
Query 246: 0.0667
Query 248: 0.5867
Query 249: 0.0027
Query 250: 1.0000
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Hildesheim, Monolingual Finnish, Auto, TD Run UHIfi1
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 45 queries): 1.0
Query 201: 0.1466 Total number of documents
Query 202: 0.8313 over all queries
Query 203: 0.8667 Retrieved: 45000
Query 204: 0.9288 Relevant: 413
Query 205: 0.6202 Rel_ret: 349
0.8
Query 207: 0.0041
Query 208: 0.8142 Interpolated Recall -
Query 209: 0.0000 Precision Averages:
Query 210: 0.0500 at 0.00 0.6536
Query 211: 0.9474 at 0.10 0.6207 0.6
Query 212: 0.2611 at 0.20 0.5785
Query 213: 0.6817 at 0.30 0.5575
Query 214: 0.0000 at 0.40 0.5114
Precision
Query 215: 0.1000 at 0.50 0.4855
Query 216: 0.0009 at 0.60 0.4450 0.4
Query 217: 0.6217 at 0.70 0.3898
Query 218: 0.9909 at 0.80 0.3766
Query 219: 0.6047 at 0.90 0.3455
Query 220: 0.0952 at 1.00 0.3233
Query 221: 0.3543 0.2
Query 222: 0.1551 Avg. prec. (non-interpolated)
Query 223: 0.1792 for all rel. documents
Query 224: 1.0000 0.4699
Query 225: 0.7862 Precision:
Query 226: 0.2822 At 5 docs: 0.3956 0.0
Query 228: 0.0000 At 10 docs: 0.3067 0.0 0.2 0.4 0.6 0.8 1.0
Query 229: 0.0000 At 15 docs: 0.2637
Query 230: 0.3882 At 20 docs: 0.2244 Recall
Query 232: 0.0000 At 30 docs: 0.1704
Query 233: 0.3944 At 100 docs: 0.0633
Query 234: 0.5310 At 200 docs: 0.0346 Run UHIfi1
Query 235: 0.2140 At 500 docs: 0.0151 Comparison to median by topic
Query 236: 1.0000 At 1000 docs: 0.0078
Query 237: 1.0000 +1.0
Query 238: 0.7556 R-Precision (prec. after R
Query 239: 0.1525 (=num_rel) docs. retrieved):
Query 241: 0.1336 Exact: 0.4341
Query 242: 0.7500
Query 243: 0.2147
Query 244: 1.0000 +0.5
Query 245: 1.0000
Query 246: 0.0345
Query 248: 0.8583
Query 249: 0.3987
Query 250: 1.0000
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Hildesheim, Monolingual Finnish, Auto, TD Run UHIfi2
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 45 queries): 1.0
Query 201: 0.1456 Total number of documents
Query 202: 0.9323 over all queries
Query 203: 0.9167 Retrieved: 44199
Query 204: 0.9531 Relevant: 413
Query 205: 0.5963 Rel_ret: 367
0.8
Query 207: 0.1159
Query 208: 0.7920 Interpolated Recall -
Query 209: 0.0000 Precision Averages:
Query 210: 0.0769 at 0.00 0.6448
Query 211: 0.9659 at 0.10 0.6190 0.6
Query 212: 0.4002 at 0.20 0.5942
Query 213: 0.7228 at 0.30 0.5825
Query 214: 0.0000 at 0.40 0.5459
Precision
Query 215: 0.2500 at 0.50 0.5258
Query 216: 0.0008 at 0.60 0.5063 0.4
Query 217: 0.7108 at 0.70 0.4528
Query 218: 0.9625 at 0.80 0.4311
Query 219: 0.7827 at 0.90 0.3774
Query 220: 0.0394 at 1.00 0.3477
Query 221: 0.7683 0.2
Query 222: 0.2083 Avg. prec. (non-interpolated)
Query 223: 0.1732 for all rel. documents
Query 224: 0.5000 0.5042
Query 225: 0.9429 Precision:
Query 226: 0.3644 At 5 docs: 0.4444 0.0
Query 228: 0.0000 At 10 docs: 0.3511 0.0 0.2 0.4 0.6 0.8 1.0
Query 229: 0.0000 At 15 docs: 0.2933
Query 230: 0.3849 At 20 docs: 0.2422 Recall
Query 232: 0.0000 At 30 docs: 0.1830
Query 233: 0.3036 At 100 docs: 0.0689
Query 234: 0.5543 At 200 docs: 0.0373 Run UHIfi2
Query 235: 0.4601 At 500 docs: 0.0160 Comparison to median by topic
Query 236: 0.9167 At 1000 docs: 0.0082
Query 237: 1.0000 +1.0
Query 238: 1.0000 R-Precision (prec. after R
Query 239: 0.2818 (=num_rel) docs. retrieved):
Query 241: 0.1155 Exact: 0.4601
Query 242: 1.0000
Query 243: 0.2482
Query 244: 1.0000 +0.5
Query 245: 1.0000
Query 246: 0.0455
Query 248: 0.9429
Query 249: 0.1158
Query 250: 1.0000
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Université de Neuchâtel, Monolingual Finnish, Auto, TD Run UniNEfi1
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 45 queries): 1.0
Query 201: 0.0719 Total number of documents
Query 202: 0.9157 over all queries
Query 203: 0.5012 Retrieved: 45000
Query 204: 0.9672 Relevant: 413 0.8
Query 205: 0.9103 Rel_ret: 397
Query 207: 0.1242
Query 208: 0.8539 Interpolated Recall -
Query 209: 0.0094 Precision Averages:
Query 210: 0.5000 at 0.00 0.6590
Query 211: 0.9813 at 0.10 0.6432 0.6
Query 212: 0.2414 at 0.20 0.6170
Query 213: 0.6426 at 0.30 0.6070
Query 214: 0.5556 at 0.40 0.5342
Precision
Query 215: 0.0200 at 0.50 0.5104
Query 216: 0.0471 at 0.60 0.4861 0.4
Query 217: 0.4126 at 0.70 0.4267
Query 218: 0.9909 at 0.80 0.3972
Query 219: 0.8352 at 0.90 0.3483
Query 220: 0.0000 at 1.00 0.3201
Query 221: 0.1850 0.2
Query 222: 0.2262 Avg. prec. (non-interpolated)
Query 223: 0.1934 for all rel. documents
Query 224: 1.0000 0.4967
Query 225: 1.0000 Precision:
Query 226: 0.3148 At 5 docs: 0.4444 0.0
Query 228: 0.0135 At 10 docs: 0.3422 0.0 0.2 0.4 0.6 0.8 1.0
Query 229: 0.0519 At 15 docs: 0.2859
Query 230: 0.5563 At 20 docs: 0.2378 Recall
Query 232: 0.0011 At 30 docs: 0.1785
Query 233: 0.6988 At 100 docs: 0.0644
Query 234: 0.6416 At 200 docs: 0.0343 Run UniNEfi1
Query 235: 0.7286 At 500 docs: 0.0144 Comparison to median by topic
Query 236: 0.9167 At 1000 docs: 0.0088
Query 237: 1.0000 +1.0
Query 238: 1.0000 R-Precision (prec. after R
Query 239: 0.3757 (=num_rel) docs. retrieved):
Query 241: 0.0724 Exact: 0.4453
Query 242: 1.0000
Query 243: 0.0667
Query 244: 0.5000 +0.5
Query 245: 0.5000
Query 246: 0.0345
Query 248: 0.6595
Query 249: 0.0321
Query 250: 1.0000
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Université de Neuchâtel, Monolingual Finnish, Auto, TD Run UniNEfi2
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 45 queries): 1.0
Query 201: 0.0918 Total number of documents
Query 202: 0.9208 over all queries
Query 203: 0.7556 Retrieved: 45000
Query 204: 0.9651 Relevant: 413 0.8
Query 205: 0.9167 Rel_ret: 404
Query 207: 0.1990
Query 208: 0.7843 Interpolated Recall -
Query 209: 0.0078 Precision Averages:
Query 210: 0.3333 at 0.00 0.6622
Query 211: 0.9822 at 0.10 0.6577 0.6
Query 212: 0.3492 at 0.20 0.6395
Query 213: 0.6509 at 0.30 0.6231
Query 214: 0.5556 at 0.40 0.5834
Precision
Query 215: 0.0233 at 0.50 0.5696
Query 216: 0.0345 at 0.60 0.5594 0.4
Query 217: 0.7668 at 0.70 0.5184
Query 218: 0.9909 at 0.80 0.4787
Query 219: 0.8323 at 0.90 0.4139
Query 220: 0.0037 at 1.00 0.3832
Query 221: 0.3470 0.2
Query 222: 0.2165 Avg. prec. (non-interpolated)
Query 223: 0.1976 for all rel. documents
Query 224: 1.0000 0.5453
Query 225: 1.0000 Precision:
Query 226: 0.9103 At 5 docs: 0.4711 0.0
Query 228: 0.0085 At 10 docs: 0.3600 0.0 0.2 0.4 0.6 0.8 1.0
Query 229: 0.0934 At 15 docs: 0.3111
Query 230: 0.5269 At 20 docs: 0.2589 Recall
Query 232: 0.0012 At 30 docs: 0.1970
Query 233: 0.7131 At 100 docs: 0.0729
Query 234: 0.6854 At 200 docs: 0.0401 Run UniNEfi2
Query 235: 0.7538 At 500 docs: 0.0174 Comparison to median by topic
Query 236: 0.9167 At 1000 docs: 0.0090
Query 237: 1.0000 +1.0
Query 238: 1.0000 R-Precision (prec. after R
Query 239: 0.4109 (=num_rel) docs. retrieved):
Query 241: 0.0953 Exact: 0.5009
Query 242: 1.0000
Query 243: 0.2790
Query 244: 0.5000 +0.5
Query 245: 1.0000
Query 246: 0.0357
Query 248: 0.6595
Query 249: 0.0224
Query 250: 1.0000
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Université de Neuchâtel, Monolingual Finnish, Auto, TDN Run UniNEfi3
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 45 queries): 1.0
Query 201: 0.1138 Total number of documents
Query 202: 0.9157 over all queries
Query 203: 0.6667 Retrieved: 45000
Query 204: 0.9646 Relevant: 413 0.8
Query 205: 0.8093 Rel_ret: 405
Query 207: 0.2020
Query 208: 0.7890 Interpolated Recall -
Query 209: 0.0054 Precision Averages:
Query 210: 0.0909 at 0.00 0.6913
Query 211: 0.9881 at 0.10 0.6728 0.6
Query 212: 0.4500 at 0.20 0.6648
Query 213: 0.7957 at 0.30 0.6345
Query 214: 0.4667 at 0.40 0.5916
Precision
Query 215: 0.0081 at 0.50 0.5838
Query 216: 0.1314 at 0.60 0.5500 0.4
Query 217: 0.6999 at 0.70 0.5117
Query 218: 1.0000 at 0.80 0.4562
Query 219: 0.7661 at 0.90 0.3958
Query 220: 0.2579 at 1.00 0.3764
Query 221: 0.6176 0.2
Query 222: 0.1463 Avg. prec. (non-interpolated)
Query 223: 0.1843 for all rel. documents
Query 224: 1.0000 0.5454
Query 225: 1.0000 Precision:
Query 226: 0.8388 At 5 docs: 0.4756 0.0
Query 228: 0.0595 At 10 docs: 0.3867 0.0 0.2 0.4 0.6 0.8 1.0
Query 229: 0.4125 At 15 docs: 0.3274
Query 230: 0.5521 At 20 docs: 0.2711 Recall
Query 232: 0.0175 At 30 docs: 0.2000
Query 233: 0.7455 At 100 docs: 0.0747
Query 234: 0.7218 At 200 docs: 0.0417 Run UniNEfi3
Query 235: 0.7534 At 500 docs: 0.0176 Comparison to median by topic
Query 236: 0.9167 At 1000 docs: 0.0090
Query 237: 1.0000 +1.0
Query 238: 1.0000 R-Precision (prec. after R
Query 239: 0.3018 (=num_rel) docs. retrieved):
Query 241: 0.1084 Exact: 0.4887
Query 242: 1.0000
Query 243: 0.2996
Query 244: 0.5000 +0.5
Query 245: 0.5000
Query 246: 0.0370
Query 248: 0.6862
Query 249: 0.0247
Query 250: 1.0000
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
JHU/APL, Monolingual French, Auto, TD Run aplmofra
Average precision Overall statistics
(individual queries): (for 49 queries):
Recall−Precision Values
1.0
Query 201: 0.2999 Total number of documents
Query 202: 0.5789 over all queries
Query 203: 0.5675 Retrieved: 49000
Query 204: 0.7926 Relevant: 915
Query 205: 0.5793 Rel_ret: 888 0.8
Query 206: 0.4066
Query 207: 0.3427 Interpolated Recall -
Query 208: 0.6792 Precision Averages:
Query 209: 0.0569 at 0.00 0.6062
Query 210: 0.0904 at 0.10 0.5825 0.6
Query 211: 0.8876 at 0.20 0.5552
Query 212: 0.4281 at 0.30 0.5101
Query 213: 0.7902 at 0.40 0.4786
Precision
Query 214: 0.1085 at 0.50 0.4604
Query 215: 0.3024 at 0.60 0.4319 0.4
Query 216: 0.0543 at 0.70 0.3851
Query 217: 0.4147 at 0.80 0.3377
Query 218: 0.9151 at 0.90 0.2981
Query 219: 0.0507 at 1.00 0.2347
Query 220: 0.0170 0.2
Query 221: 0.5807 Avg. prec. (non-interpolated)
Query 222: 0.1507 for all rel. documents
Query 223: 0.0216 0.4283
Query 224: 0.9056 Precision:
Query 225: 0.0179 At 5 docs: 0.4367 0.0
Query 226: 0.2500 At 10 docs: 0.4020 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.5002 At 15 docs: 0.3619
Query 229: 0.4518 At 20 docs: 0.3337 Recall
Query 230: 0.9124 At 30 docs: 0.2891
Query 231: 0.2924 At 100 docs: 0.1396
Query 232: 0.0850 At 200 docs: 0.0788 Run aplmofra
Query 233: 0.5934 At 500 docs: 0.0350
Query 234: 0.2011 At 1000 docs: 0.0181 Comparison to median by topic
Query 235: 0.7890 +1.0
Query 236: 0.9698 R-Precision (prec. after R
Query 237: 0.8735 (=num_rel) docs. retrieved):
Query 238: 0.3963 Exact: 0.4016
Query 239: 0.0727
Query 240: 1.0000
Query 241: 0.0018 +0.5
Query 242: 0.3476
Query 243: 0.5309
Query 244: 0.1111
Query 245: 0.7763
Query 246: 0.1217
Query 247: 0.9909
Query 248: 0.6149 0.0
Query 249: 0.0333
Query 250: 0.0327
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
JHU/APL, Monolingual French, Auto, TD Run aplmofrb
Average precision Overall statistics
(individual queries): (for 49 queries):
Recall−Precision Values
1.0
Query 201: 0.3651 Total number of documents
Query 202: 0.6434 over all queries
Query 203: 0.5447 Retrieved: 49000
Query 204: 0.8262 Relevant: 915
Query 205: 0.5924 Rel_ret: 891 0.8
Query 206: 0.3764
Query 207: 0.3146 Interpolated Recall -
Query 208: 0.6792 Precision Averages:
Query 209: 0.0477 at 0.00 0.6380
Query 210: 0.0951 at 0.10 0.6009 0.6
Query 211: 0.8882 at 0.20 0.5752
Query 212: 0.3245 at 0.30 0.5362
Query 213: 0.7334 at 0.40 0.5080
Precision
Query 214: 0.1048 at 0.50 0.4901
Query 215: 0.1265 at 0.60 0.4607 0.4
Query 216: 0.0703 at 0.70 0.4146
Query 217: 0.4019 at 0.80 0.3790
Query 218: 0.9039 at 0.90 0.3351
Query 219: 0.1000 at 1.00 0.2732
Query 220: 0.0206 0.2
Query 221: 0.5162 Avg. prec. (non-interpolated)
Query 222: 0.0823 for all rel. documents
Query 223: 0.0198 0.4581
Query 224: 0.9484 Precision:
Query 225: 0.0227 At 5 docs: 0.4571 0.0
Query 226: 1.0000 At 10 docs: 0.3857 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.5347 At 15 docs: 0.3578
Query 229: 0.4974 At 20 docs: 0.3357 Recall
Query 230: 0.9114 At 30 docs: 0.2905
Query 231: 0.3594 At 100 docs: 0.1400
Query 232: 0.1105 At 200 docs: 0.0789 Run aplmofrb
Query 233: 0.5674 At 500 docs: 0.0349
Query 234: 0.3925 At 1000 docs: 0.0182 Comparison to median by topic
Query 235: 0.8050 +1.0
Query 236: 0.9809 R-Precision (prec. after R
Query 237: 0.8895 (=num_rel) docs. retrieved):
Query 238: 0.3637 Exact: 0.4289
Query 239: 0.1029
Query 240: 1.0000
Query 241: 0.0050 +0.5
Query 242: 0.3423
Query 243: 0.5487
Query 244: 0.5000
Query 245: 0.8500
Query 246: 0.2406
Query 247: 1.0000
Query 248: 0.6295 0.0
Query 249: 0.0256
Query 250: 0.0413
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
JHU/APL, Monolingual French, Auto, TD Run aplmofrc
Average precision Overall statistics
(individual queries): (for 49 queries):
Recall−Precision Values
1.0
Query 201: 0.3140 Total number of documents
Query 202: 0.6075 over all queries
Query 203: 0.5449 Retrieved: 49000
Query 204: 0.8001 Relevant: 915
Query 205: 0.5852 Rel_ret: 810 0.8
Query 206: 0.3730
Query 207: 0.3209 Interpolated Recall -
Query 208: 0.6792 Precision Averages:
Query 209: 0.0168 at 0.00 0.5989
Query 210: 0.0922 at 0.10 0.5709 0.6
Query 211: 0.8761 at 0.20 0.5466
Query 212: 0.2671 at 0.30 0.5100
Query 213: 0.7255 at 0.40 0.4702
Precision
Query 214: 0.1321 at 0.50 0.4435
Query 215: 0.2533 at 0.60 0.4178 0.4
Query 216: 0.0445 at 0.70 0.3847
Query 217: 0.4262 at 0.80 0.3404
Query 218: 0.8863 at 0.90 0.3016
Query 219: 0.0362 at 1.00 0.2408
Query 220: 0.0172 0.2
Query 221: 0.4700 Avg. prec. (non-interpolated)
Query 222: 0.1422 for all rel. documents
Query 223: 0.0203 0.4249
Query 224: 0.9306 Precision:
Query 225: 0.0200 At 5 docs: 0.4286 0.0
Query 226: 0.5000 At 10 docs: 0.3694 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.4784 At 15 docs: 0.3415
Query 229: 0.4311 At 20 docs: 0.3184 Recall
Query 230: 0.9377 At 30 docs: 0.2782
Query 231: 0.3258 At 100 docs: 0.1339
Query 232: 0.0007 At 200 docs: 0.0760 Run aplmofrc
Query 233: 0.5508 At 500 docs: 0.0320
Query 234: 0.0034 At 1000 docs: 0.0165 Comparison to median by topic
Query 235: 0.8190 +1.0
Query 236: 0.9698 R-Precision (prec. after R
Query 237: 0.8907 (=num_rel) docs. retrieved):
Query 238: 0.3586 Exact: 0.3812
Query 239: 0.0325
Query 240: 1.0000
Query 241: 0.0042 +0.5
Query 242: 0.3265
Query 243: 0.5371
Query 244: 0.5000
Query 245: 0.7572
Query 246: 0.2127
Query 247: 0.9909
Query 248: 0.5822 0.0
Query 249: 0.0256
Query 250: 0.0057
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
CLIPS, Monolingual French, Auto, TDN Run CLIPS04MNFR1
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 49 queries): 1.0
Query 201: 0.1737 Total number of documents
Query 202: 0.6059 over all queries
Query 203: 0.3415 Retrieved: 49000
Query 204: 0.8320 Relevant: 915
Query 205: 0.4995 Rel_ret: 875
0.8
Query 206: 0.3464
Query 207: 0.0837 Interpolated Recall -
Query 208: 0.8042 Precision Averages:
Query 209: 0.1453 at 0.00 0.7218
Query 210: 0.1938 at 0.10 0.6394 0.6
Query 211: 0.7769 at 0.20 0.5961
Query 212: 0.3222 at 0.30 0.5398
Query 213: 0.8111 at 0.40 0.4736
Precision
Query 214: 0.0272 at 0.50 0.4382
Query 215: 0.0925 at 0.60 0.4041 0.4
Query 216: 0.0919 at 0.70 0.3809
Query 217: 0.3340 at 0.80 0.3462
Query 218: 0.9506 at 0.90 0.2979
Query 219: 0.0063 at 1.00 0.2093
Query 220: 0.3599 0.2
Query 221: 0.4063 Avg. prec. (non-interpolated)
Query 222: 0.1198 for all rel. documents
Query 223: 0.0242 0.4443
Query 224: 1.0000 Precision:
Query 225: 0.1667 At 5 docs: 0.4653 0.0
Query 226: 0.1667 At 10 docs: 0.4061 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.3567 At 15 docs: 0.3510
Query 229: 0.2974 At 20 docs: 0.3194 Recall
Query 230: 0.8955 At 30 docs: 0.2728
Query 231: 0.7933 At 100 docs: 0.1408
Query 232: 0.5265 At 200 docs: 0.0818 Run CLIPS04MNFR1
Query 233: 0.6172 At 500 docs: 0.0348 Comparison to median by topic
Query 234: 0.4611 At 1000 docs: 0.0179
Query 235: 0.8774 +1.0
Query 236: 1.0000 R-Precision (prec. after R
Query 237: 0.8870 (=num_rel) docs. retrieved):
Query 238: 0.4429 Exact: 0.4172
Query 239: 0.1050
Query 240: 1.0000
Query 241: 0.0177 +0.5
Query 242: 0.4510
Query 243: 0.5391
Query 244: 0.0000
Query 245: 0.8409
Query 246: 0.1030
Query 247: 0.9714
Query 248: 0.8045
0.0
Query 249: 0.0182
Query 250: 0.0826
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Dublin City University, Monolingual French, Auto, TD Run exefrmono04a
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 49 queries): 1.0
Query 201: 0.3421 Total number of documents
Query 202: 0.7313 over all queries
Query 203: 0.3183 Retrieved: 49000
Query 204: 0.7999 Relevant: 915 0.8
Query 205: 0.2325 Rel_ret: 843
Query 206: 0.3927
Query 207: 0.1538 Interpolated Recall -
Query 208: 0.8042 Precision Averages:
Query 209: 0.0010 at 0.00 0.6009
Query 210: 0.0927 at 0.10 0.5712 0.6
Query 211: 0.8649 at 0.20 0.5526
Query 212: 0.4084 at 0.30 0.4907
Query 213: 0.7559 at 0.40 0.4728
Precision
Query 214: 0.0002 at 0.50 0.4404
Query 215: 0.0448 at 0.60 0.4199 0.4
Query 216: 0.0024 at 0.70 0.3920
Query 217: 0.5037 at 0.80 0.3458
Query 218: 0.9252 at 0.90 0.2748
Query 219: 0.2529 at 1.00 0.2127
Query 220: 0.1326 0.2
Query 221: 0.5203 Avg. prec. (non-interpolated)
Query 222: 0.0200 for all rel. documents
Query 223: 0.0207 0.4236
Query 224: 0.8770 Precision:
Query 225: 0.0076 At 5 docs: 0.4286 0.0
Query 226: 1.0000 At 10 docs: 0.3633 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.5726 At 15 docs: 0.3347
Query 229: 0.5147 At 20 docs: 0.2949 Recall
Query 230: 0.8155 At 30 docs: 0.2619
Query 231: 0.5657 At 100 docs: 0.1308
Query 232: 0.0711 At 200 docs: 0.0739 Run exefrmono04a
Query 233: 0.4963 At 500 docs: 0.0326 Comparison to median by topic
Query 234: 0.0076 At 1000 docs: 0.0172
Query 235: 0.8626 +1.0
Query 236: 0.9540 R-Precision (prec. after R
Query 237: 0.7872 (=num_rel) docs. retrieved):
Query 238: 0.3960 Exact: 0.3900
Query 239: 0.0176
Query 240: 1.0000
Query 241: 0.0001 +0.5
Query 242: 0.1646
Query 243: 0.5256
Query 244: 0.0047
Query 245: 0.8409
Query 246: 0.1319
Query 247: 0.9833
0.0
Query 248: 0.7548
Query 249: 0.0357
Query 250: 0.0499
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Dublin City University, Monolingual French, Auto, TD Run exefrmono04q
Average precision Overall statistics
(individual queries): (for 49 queries): Recall−Precision Values
1.0
Query 201: 0.4130 Total number of documents
Query 202: 0.7442 over all queries
Query 203: 0.3183 Retrieved: 49000
Query 204: 0.8476 Relevant: 915
Query 205: 0.2537 Rel_ret: 849 0.8
Query 206: 0.4086
Query 207: 0.2152 Interpolated Recall -
Query 208: 0.8042 Precision Averages:
Query 209: 0.0009 at 0.00 0.6009
Query 210: 0.0922 at 0.10 0.5741 0.6
Query 211: 0.8595 at 0.20 0.5444
Query 212: 0.3853 at 0.30 0.4896
Query 213: 0.7571 at 0.40 0.4611
Precision
Query 214: 0.0142 at 0.50 0.4275
Query 215: 0.0420 at 0.60 0.4107 0.4
Query 216: 0.0041 at 0.70 0.3750
Query 217: 0.5631 at 0.80 0.3284
Query 218: 0.9131 at 0.90 0.2600
Query 219: 0.2143 at 1.00 0.2038
Query 220: 0.1673 0.2
Query 221: 0.5239 Avg. prec. (non-interpolated)
Query 222: 0.0188 for all rel. documents
Query 223: 0.0189 0.4143
Query 224: 0.8626 Precision:
Query 225: 0.0091 At 5 docs: 0.4367 0.0
Query 226: 0.3333 At 10 docs: 0.3653 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.4263 At 15 docs: 0.3388
Query 229: 0.5234 At 20 docs: 0.3051 Recall
Query 230: 0.8148 At 30 docs: 0.2599
Query 231: 0.5705 At 100 docs: 0.1292
Query 232: 0.0622 At 200 docs: 0.0724 Run exefrmono04q
Query 233: 0.5011 At 500 docs: 0.0326
Query 234: 0.0075 At 1000 docs: 0.0173 Comparison to median by topic
Query 235: 0.8626 +1.0
Query 236: 0.9415 R-Precision (prec. after R
Query 237: 0.7924 (=num_rel) docs. retrieved):
Query 238: 0.4561 Exact: 0.3706
Query 239: 0.0217
Query 240: 1.0000
Query 241: 0.0001 +0.5
Query 242: 0.2006
Query 243: 0.4373
Query 244: 0.0050
Query 245: 0.8750
Query 246: 0.1771
Query 247: 0.9809
Query 248: 0.7793 0.0
Query 249: 0.0294
Query 250: 0.0521
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Dublin City University, Monolingual French, Auto, TD Run exefrmono04t
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 49 queries): 1.0
Query 201: 0.3817 Total number of documents
Query 202: 0.7242 over all queries
Query 203: 0.3154 Retrieved: 49000
Query 204: 0.7862 Relevant: 915 0.8
Query 205: 0.2459 Rel_ret: 844
Query 206: 0.3959
Query 207: 0.2020 Interpolated Recall -
Query 208: 0.8042 Precision Averages:
Query 209: 0.0010 at 0.00 0.5978
Query 210: 0.0920 at 0.10 0.5612 0.6
Query 211: 0.8489 at 0.20 0.5337
Query 212: 0.3914 at 0.30 0.4814
Query 213: 0.7437 at 0.40 0.4558
Precision
Query 214: 0.0002 at 0.50 0.4226
Query 215: 0.0377 at 0.60 0.3999 0.4
Query 216: 0.0040 at 0.70 0.3762
Query 217: 0.5270 at 0.80 0.3261
Query 218: 0.9197 at 0.90 0.2587
Query 219: 0.2666 at 1.00 0.1981
Query 220: 0.1638 0.2
Query 221: 0.5551 Avg. prec. (non-interpolated)
Query 222: 0.0203 for all rel. documents
Query 223: 0.0183 0.4097
Query 224: 0.9242 Precision:
Query 225: 0.0079 At 5 docs: 0.4286 0.0
Query 226: 0.1667 At 10 docs: 0.3612 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.5833 At 15 docs: 0.3265
Query 229: 0.5016 At 20 docs: 0.2980 Recall
Query 230: 0.8078 At 30 docs: 0.2578
Query 231: 0.5705 At 100 docs: 0.1288
Query 232: 0.0613 At 200 docs: 0.0738 Run exefrmono04t
Query 233: 0.4551 At 500 docs: 0.0323 Comparison to median by topic
Query 234: 0.0074 At 1000 docs: 0.0172
Query 235: 0.8825 +1.0
Query 236: 0.9327 R-Precision (prec. after R
Query 237: 0.7923 (=num_rel) docs. retrieved):
Query 238: 0.3960 Exact: 0.3729
Query 239: 0.0140
Query 240: 1.0000
Query 241: 0.0001 +0.5
Query 242: 0.1828
Query 243: 0.5279
Query 244: 0.0051
Query 245: 0.8333
Query 246: 0.1711
Query 247: 0.9909
0.0
Query 248: 0.7314
Query 249: 0.0345
Query 250: 0.0512
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Dublin City University, Monolingual French, Auto, TD Run exefrmonosys04a
Average precision Overall statistics
(individual queries): (for 49 queries): Recall−Precision Values
1.0
Query 201: 0.3647 Total number of documents
Query 202: 0.6327 over all queries
Query 203: 0.4882 Retrieved: 49000
Query 204: 0.7502 Relevant: 915
Query 205: 0.1332 Rel_ret: 774 0.8
Query 206: 0.3746
Query 207: 0.2784 Interpolated Recall -
Query 208: 0.8042 Precision Averages:
Query 209: 0.0634 at 0.00 0.5973
Query 210: 0.0786 at 0.10 0.5422 0.6
Query 211: 0.8092 at 0.20 0.5070
Query 212: 0.1147 at 0.30 0.4610
Query 213: 0.8699 at 0.40 0.4201
Precision
Query 214: 0.0013 at 0.50 0.4019
Query 215: 0.0427 at 0.60 0.3868 0.4
Query 216: 0.0596 at 0.70 0.3454
Query 217: 0.3875 at 0.80 0.3130
Query 218: 0.9155 at 0.90 0.2736
Query 219: 0.5404 at 1.00 0.2059
Query 220: 0.0103 0.2
Query 221: 0.7446 Avg. prec. (non-interpolated)
Query 222: 0.0039 for all rel. documents
Query 223: 0.0469 0.3929
Query 224: 0.6453 Precision:
Query 225: 0.3333 At 5 docs: 0.4000 0.0
Query 226: 0.5000 At 10 docs: 0.3469 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.0012 At 15 docs: 0.3170
Query 229: 0.2233 At 20 docs: 0.2857 Recall
Query 230: 0.9005 At 30 docs: 0.2463
Query 231: 0.1668 At 100 docs: 0.1257
Query 232: 0.0060 At 200 docs: 0.0705 Run exefrmonosys04a
Query 233: 0.3553 At 500 docs: 0.0302
Query 234: 0.1004 At 1000 docs: 0.0158 Comparison to median by topic
Query 235: 0.6808 +1.0
Query 236: 0.8822 R-Precision (prec. after R
Query 237: 0.9310 (=num_rel) docs. retrieved):
Query 238: 0.4442 Exact: 0.3425
Query 239: 0.0907
Query 240: 1.0000
Query 241: 0.0031 +0.5
Query 242: 0.3020
Query 243: 0.6541
Query 244: 0.0051
Query 245: 0.8929
Query 246: 0.1015
Query 247: 0.9909
Query 248: 0.4915 0.0
Query 249: 0.0179
Query 250: 0.0154
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Daedalus, Monolingual French, Auto, TD Run frav7
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 49 queries): 1.0
Query 201: 0.2962 Total number of documents
Query 202: 0.6803 over all queries
Query 203: 0.4764 Retrieved: 49000
Query 204: 0.8487 Relevant: 915 0.8
Query 205: 0.5378 Rel_ret: 854
Query 206: 0.4926
Query 207: 0.2742 Interpolated Recall -
Query 208: 0.8875 Precision Averages:
Query 209: 0.2224 at 0.00 0.7169
Query 210: 0.1389 at 0.10 0.6420 0.6
Query 211: 0.8450 at 0.20 0.5897
Query 212: 0.3678 at 0.30 0.5381
Query 213: 0.8213 at 0.40 0.4984
Precision
Query 214: 0.0639 at 0.50 0.4757
Query 215: 0.1032 at 0.60 0.4553 0.4
Query 216: 0.1008 at 0.70 0.4096
Query 217: 0.4297 at 0.80 0.3665
Query 218: 0.9145 at 0.90 0.3089
Query 219: 0.3201 at 1.00 0.2378
Query 220: 0.3213 0.2
Query 221: 0.4090 Avg. prec. (non-interpolated)
Query 222: 0.1157 for all rel. documents
Query 223: 0.0180 0.4624
Query 224: 0.9762 Precision:
Query 225: 0.0189 At 5 docs: 0.4653 0.0
Query 226: 1.0000 At 10 docs: 0.4102 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.3344 At 15 docs: 0.3660
Query 229: 0.3933 At 20 docs: 0.3184 Recall
Query 230: 0.9090 At 30 docs: 0.2762
Query 231: 0.6503 At 100 docs: 0.1390
Query 232: 0.0526 At 200 docs: 0.0786 Run frav7
Query 233: 0.4718 At 500 docs: 0.0337 Comparison to median by topic
Query 234: 0.2341 At 1000 docs: 0.0174
Query 235: 0.8524 +1.0
Query 236: 0.9264 R-Precision (prec. after R
Query 237: 0.9119 (=num_rel) docs. retrieved):
Query 238: 0.4217 Exact: 0.4294
Query 239: 0.1402
Query 240: 1.0000
Query 241: 0.0106 +0.5
Query 242: 0.3096
Query 243: 0.4582
Query 244: 0.0192
Query 245: 0.9167
Query 246: 0.2127
Query 247: 0.9263
0.0
Query 248: 0.7212
Query 249: 0.0192
Query 250: 0.0846
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Daedalus, Monolingual French, Auto, TD Run frav8
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 49 queries): 1.0
Query 201: 0.2918 Total number of documents
Query 202: 0.6775 over all queries
Query 203: 0.4442 Retrieved: 49000
Query 204: 0.8301 Relevant: 915 0.8
Query 205: 0.5314 Rel_ret: 855
Query 206: 0.4934
Query 207: 0.2752 Interpolated Recall -
Query 208: 0.8875 Precision Averages:
Query 209: 0.2133 at 0.00 0.7113
Query 210: 0.1376 at 0.10 0.6424 0.6
Query 211: 0.8401 at 0.20 0.5868
Query 212: 0.3650 at 0.30 0.5367
Query 213: 0.8255 at 0.40 0.4950
Precision
Query 214: 0.0623 at 0.50 0.4717
Query 215: 0.1034 at 0.60 0.4454 0.4
Query 216: 0.1484 at 0.70 0.4065
Query 217: 0.4301 at 0.80 0.3656
Query 218: 0.9204 at 0.90 0.3067
Query 219: 0.3262 at 1.00 0.2371
Query 220: 0.3026 0.2
Query 221: 0.4125 Avg. prec. (non-interpolated)
Query 222: 0.1063 for all rel. documents
Query 223: 0.0181 0.4589
Query 224: 0.9762 Precision:
Query 225: 0.0227 At 5 docs: 0.4612 0.0
Query 226: 1.0000 At 10 docs: 0.4143 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.3250 At 15 docs: 0.3578
Query 229: 0.3439 At 20 docs: 0.3194 Recall
Query 230: 0.9119 At 30 docs: 0.2701
Query 231: 0.6532 At 100 docs: 0.1392
Query 232: 0.0454 At 200 docs: 0.0782 Run frav8
Query 233: 0.4762 At 500 docs: 0.0336 Comparison to median by topic
Query 234: 0.1813 At 1000 docs: 0.0174
Query 235: 0.8383 +1.0
Query 236: 0.9332 R-Precision (prec. after R
Query 237: 0.9119 (=num_rel) docs. retrieved):
Query 238: 0.4217 Exact: 0.4301
Query 239: 0.1316
Query 240: 1.0000
Query 241: 0.0112 +0.5
Query 242: 0.3173
Query 243: 0.4492
Query 244: 0.0263
Query 245: 0.9167
Query 246: 0.2117
Query 247: 0.9263
0.0
Query 248: 0.7058
Query 249: 0.0217
Query 250: 0.0858
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Daedalus, Monolingual French, Auto, TD Run frcomb1s201
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 49 queries): 1.0
Query 201: 0.3191 Total number of documents
Query 202: 0.6619 over all queries
Query 203: 0.4885 Retrieved: 49000
Query 204: 0.8820 Relevant: 915
Query 205: 0.5701 Rel_ret: 860
0.8
Query 206: 0.4918
Query 207: 0.2588 Interpolated Recall -
Query 208: 0.8875 Precision Averages:
Query 209: 0.2412 at 0.00 0.7111
Query 210: 0.1207 at 0.10 0.6578 0.6
Query 211: 0.8528 at 0.20 0.6048
Query 212: 0.3843 at 0.30 0.5506
Query 213: 0.8168 at 0.40 0.4943
Precision
Query 214: 0.0241 at 0.50 0.4816
Query 215: 0.0962 at 0.60 0.4513 0.4
Query 216: 0.0491 at 0.70 0.4074
Query 217: 0.4102 at 0.80 0.3704
Query 218: 0.8993 at 0.90 0.3185
Query 219: 0.3356 at 1.00 0.2459
Query 220: 0.3135 0.2
Query 221: 0.4532 Avg. prec. (non-interpolated)
Query 222: 0.0840 for all rel. documents
Query 223: 0.0148 0.4673
Query 224: 1.0000 Precision:
Query 225: 0.0120 At 5 docs: 0.4694 0.0
Query 226: 1.0000 At 10 docs: 0.3980 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.3318 At 15 docs: 0.3592
Query 229: 0.4810 At 20 docs: 0.3245 Recall
Query 230: 0.8982 At 30 docs: 0.2762
Query 231: 0.6032 At 100 docs: 0.1398
Query 232: 0.0815 At 200 docs: 0.0789 Run frcomb1s201
Query 233: 0.4456 At 500 docs: 0.0336 Comparison to median by topic
Query 234: 0.4471 At 1000 docs: 0.0176
Query 235: 0.8889 +1.0
Query 236: 0.9452 R-Precision (prec. after R
Query 237: 0.8985 (=num_rel) docs. retrieved):
Query 238: 0.4319 Exact: 0.4288
Query 239: 0.0970
Query 240: 1.0000
Query 241: 0.0181 +0.5
Query 242: 0.2962
Query 243: 0.4337
Query 244: 0.0072
Query 245: 0.9167
Query 246: 0.2078
Query 247: 0.9430
Query 248: 0.7584
0.0
Query 249: 0.0118
Query 250: 0.0888
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Daedalus, Monolingual French, Auto, TD Run frcomb2s201
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 49 queries): 1.0
Query 201: 0.3240 Total number of documents
Query 202: 0.6497 over all queries
Query 203: 0.4755 Retrieved: 49000
Query 204: 0.8811 Relevant: 915
Query 205: 0.6005 Rel_ret: 853
0.8
Query 206: 0.4803
Query 207: 0.2537 Interpolated Recall -
Query 208: 0.8875 Precision Averages:
Query 209: 0.2587 at 0.00 0.7100
Query 210: 0.1185 at 0.10 0.6501 0.6
Query 211: 0.8514 at 0.20 0.6083
Query 212: 0.3702 at 0.30 0.5446
Query 213: 0.8174 at 0.40 0.4993
Precision
Query 214: 0.0225 at 0.50 0.4807
Query 215: 0.0961 at 0.60 0.4511 0.4
Query 216: 0.0371 at 0.70 0.4048
Query 217: 0.4098 at 0.80 0.3702
Query 218: 0.9046 at 0.90 0.3216
Query 219: 0.3267 at 1.00 0.2477
Query 220: 0.2857 0.2
Query 221: 0.4442 Avg. prec. (non-interpolated)
Query 222: 0.1153 for all rel. documents
Query 223: 0.0133 0.4670
Query 224: 1.0000 Precision:
Query 225: 0.0123 At 5 docs: 0.4735 0.0
Query 226: 1.0000 At 10 docs: 0.4041 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.3381 At 15 docs: 0.3565
Query 229: 0.4628 At 20 docs: 0.3214 Recall
Query 230: 0.8980 At 30 docs: 0.2755
Query 231: 0.6722 At 100 docs: 0.1392
Query 232: 0.0692 At 200 docs: 0.0785 Run frcomb2s201
Query 233: 0.4427 At 500 docs: 0.0333 Comparison to median by topic
Query 234: 0.5263 At 1000 docs: 0.0174
Query 235: 0.8965 +1.0
Query 236: 0.9387 R-Precision (prec. after R
Query 237: 0.9119 (=num_rel) docs. retrieved):
Query 238: 0.4264 Exact: 0.4332
Query 239: 0.0941
Query 240: 1.0000
Query 241: 0.0046 +0.5
Query 242: 0.2406
Query 243: 0.4284
Query 244: 0.0081
Query 245: 0.9167
Query 246: 0.2042
Query 247: 0.9188
Query 248: 0.7449
0.0
Query 249: 0.0135
Query 250: 0.0913
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Hummingbird, Monolingual French, Auto, T Run humFR04t
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 49 queries): 1.0
Query 201: 0.0713 Total number of documents
Query 202: 0.5722 over all queries
Query 203: 0.3347 Retrieved: 44387
Query 204: 0.7272 Relevant: 915
Query 205: 0.6427 Rel_ret: 852
0.8
Query 206: 0.1424
Query 207: 0.3462 Interpolated Recall -
Query 208: 0.2710 Precision Averages:
Query 209: 0.1582 at 0.00 0.6733
Query 210: 0.2957 at 0.10 0.6107 0.6
Query 211: 0.8351 at 0.20 0.5661
Query 212: 0.3985 at 0.30 0.5088
Query 213: 0.7298 at 0.40 0.4598
Precision
Query 214: 0.0489 at 0.50 0.4376
Query 215: 0.0842 at 0.60 0.4058 0.4
Query 216: 0.0442 at 0.70 0.3676
Query 217: 0.4419 at 0.80 0.3239
Query 218: 0.9043 at 0.90 0.2669
Query 219: 0.3182 at 1.00 0.1827
Query 220: 0.3026 0.2
Query 221: 0.3113 Avg. prec. (non-interpolated)
Query 222: 0.0151 for all rel. documents
Query 223: 0.0084 0.4205
Query 224: 0.9333 Precision:
Query 225: 0.0476 At 5 docs: 0.4408 0.0
Query 226: 1.0000 At 10 docs: 0.3735 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.2162 At 15 docs: 0.3333
Query 229: 0.4729 At 20 docs: 0.3122 Recall
Query 230: 0.9058 At 30 docs: 0.2694
Query 231: 0.6967 At 100 docs: 0.1310
Query 232: 0.2552 At 200 docs: 0.0760 Run humFR04t
Query 233: 0.4559 At 500 docs: 0.0330 Comparison to median by topic
Query 234: 0.4859 At 1000 docs: 0.0174
Query 235: 0.8306 +1.0
Query 236: 1.0000 R-Precision (prec. after R
Query 237: 0.9066 (=num_rel) docs. retrieved):
Query 238: 0.2017 Exact: 0.3912
Query 239: 0.0445
Query 240: 1.0000
Query 241: 0.1446 +0.5
Query 242: 0.1153
Query 243: 0.4949
Query 244: 0.0000
Query 245: 0.7519
Query 246: 0.0657
Query 247: 0.6979
Query 248: 0.7981
0.0
Query 249: 0.0036
Query 250: 0.0752
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Hummingbird, Monolingual French, Auto, TD Run humFR04td
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 49 queries): 1.0
Query 201: 0.1954 Total number of documents
Query 202: 0.6385 over all queries
Query 203: 0.4272 Retrieved: 49000
Query 204: 0.8551 Relevant: 915
Query 205: 0.5867 Rel_ret: 852
0.8
Query 206: 0.4716
Query 207: 0.3462 Interpolated Recall -
Query 208: 0.8875 Precision Averages:
Query 209: 0.3366 at 0.00 0.7007
Query 210: 0.1511 at 0.10 0.6527 0.6
Query 211: 0.8430 at 0.20 0.6249
Query 212: 0.3471 at 0.30 0.5519
Query 213: 0.8032 at 0.40 0.4915
Precision
Query 214: 0.0843 at 0.50 0.4737
Query 215: 0.0707 at 0.60 0.4479 0.4
Query 216: 0.0829 at 0.70 0.4049
Query 217: 0.4416 at 0.80 0.3479
Query 218: 0.9049 at 0.90 0.2960
Query 219: 0.2556 at 1.00 0.2210
Query 220: 0.2970 0.2
Query 221: 0.4568 Avg. prec. (non-interpolated)
Query 222: 0.0876 for all rel. documents
Query 223: 0.0160 0.4584
Query 224: 1.0000 Precision:
Query 225: 0.0303 At 5 docs: 0.4816 0.0
Query 226: 1.0000 At 10 docs: 0.3980 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.3060 At 15 docs: 0.3442
Query 229: 0.4729 At 20 docs: 0.3184 Recall
Query 230: 0.9197 At 30 docs: 0.2748
Query 231: 0.5042 At 100 docs: 0.1363
Query 232: 0.0264 At 200 docs: 0.0777 Run humFR04td
Query 233: 0.4252 At 500 docs: 0.0332 Comparison to median by topic
Query 234: 0.4133 At 1000 docs: 0.0174
Query 235: 0.8445 +1.0
Query 236: 0.8376 R-Precision (prec. after R
Query 237: 0.9110 (=num_rel) docs. retrieved):
Query 238: 0.4632 Exact: 0.4249
Query 239: 0.1110
Query 240: 1.0000
Query 241: 0.0304 +0.5
Query 242: 0.2982
Query 243: 0.5567
Query 244: 0.0109
Query 245: 0.7575
Query 246: 0.1213
Query 247: 0.9622
Query 248: 0.7219
0.0
Query 249: 0.0233
Query 250: 0.1282
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Hummingbird, Monolingual French, Auto, TD Run humFR04tde
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 49 queries): 1.0
Query 201: 0.2486 Total number of documents
Query 202: 0.6488 over all queries
Query 203: 0.5525 Retrieved: 49000
Query 204: 0.7257 Relevant: 915
Query 205: 0.5881 Rel_ret: 853
0.8
Query 206: 0.6171
Query 207: 0.3805 Interpolated Recall -
Query 208: 0.8875 Precision Averages:
Query 209: 0.3544 at 0.00 0.7107
Query 210: 0.1003 at 0.10 0.6752 0.6
Query 211: 0.8953 at 0.20 0.6498
Query 212: 0.3561 at 0.30 0.5964
Query 213: 0.8579 at 0.40 0.5435
Precision
Query 214: 0.1441 at 0.50 0.5238
Query 215: 0.0702 at 0.60 0.4851 0.4
Query 216: 0.0597 at 0.70 0.4356
Query 217: 0.4448 at 0.80 0.3856
Query 218: 0.9163 at 0.90 0.3406
Query 219: 0.5798 at 1.00 0.2659
Query 220: 0.2007 0.2
Query 221: 0.5144 Avg. prec. (non-interpolated)
Query 222: 0.0949 for all rel. documents
Query 223: 0.0195 0.4926
Query 224: 1.0000 Precision:
Query 225: 0.0189 At 5 docs: 0.5143 0.0
Query 226: 1.0000 At 10 docs: 0.4306 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.5017 At 15 docs: 0.3810
Query 229: 0.4932 At 20 docs: 0.3520 Recall
Query 230: 0.9122 At 30 docs: 0.2966
Query 231: 0.7683 At 100 docs: 0.1437
Query 232: 0.0454 At 200 docs: 0.0794 Run humFR04tde
Query 233: 0.3719 At 500 docs: 0.0335 Comparison to median by topic
Query 234: 0.4474 At 1000 docs: 0.0174
Query 235: 0.8524 +1.0
Query 236: 0.9332 R-Precision (prec. after R
Query 237: 0.9000 (=num_rel) docs. retrieved):
Query 238: 0.4550 Exact: 0.4583
Query 239: 0.1357
Query 240: 1.0000
Query 241: 0.0648 +0.5
Query 242: 0.1892
Query 243: 0.6489
Query 244: 0.0076
Query 245: 0.7692
Query 246: 0.2176
Query 247: 0.9909
Query 248: 0.8487
0.0
Query 249: 0.0189
Query 250: 0.2879
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Padua, Monolingual French, Auto, TD Run IMSMFRN
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 49 queries): 1.0
Query 201: 0.1270 Total number of documents
Query 202: 0.5620 over all queries
Query 203: 0.3357 Retrieved: 49000
Query 204: 0.5992 Relevant: 915 0.8
Query 205: 0.2401 Rel_ret: 763
Query 206: 0.3156
Query 207: 0.1076 Interpolated Recall -
Query 208: 0.6792 Precision Averages:
Query 209: 0.1461 at 0.00 0.6171
Query 210: 0.3041 at 0.10 0.5575 0.6
Query 211: 0.7411 at 0.20 0.5174
Query 212: 0.2922 at 0.30 0.4625
Query 213: 0.5040 at 0.40 0.4325
Precision
Query 214: 0.0617 at 0.50 0.4072
Query 215: 0.0608 at 0.60 0.3668 0.4
Query 216: 0.2978 at 0.70 0.3341
Query 217: 0.4868 at 0.80 0.2939
Query 218: 0.9117 at 0.90 0.2490
Query 219: 0.0340 at 1.00 0.1992
Query 220: 0.1023 0.2
Query 221: 0.2953 Avg. prec. (non-interpolated)
Query 222: 0.0261 for all rel. documents
Query 223: 0.0174 0.3864
Query 224: 0.9762 Precision:
Query 225: 0.0769 At 5 docs: 0.4245 0.0
Query 226: 1.0000 At 10 docs: 0.3612 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.3001 At 15 docs: 0.3184
Query 229: 0.0472 At 20 docs: 0.2755 Recall
Query 230: 0.9450 At 30 docs: 0.2272
Query 231: 0.3979 At 100 docs: 0.1180
Query 232: 0.0050 At 200 docs: 0.0688 Run IMSMFRN
Query 233: 0.3919 At 500 docs: 0.0292 Comparison to median by topic
Query 234: 0.1136 At 1000 docs: 0.0156
Query 235: 0.6494 +1.0
Query 236: 1.0000 R-Precision (prec. after R
Query 237: 0.9643 (=num_rel) docs. retrieved):
Query 238: 0.3116 Exact: 0.3864
Query 239: 0.0518
Query 240: 1.0000
Query 241: 0.0013 +0.5
Query 242: 0.2470
Query 243: 0.4881
Query 244: 0.0909
Query 245: 0.7628
Query 246: 0.1071
Query 247: 0.9809
0.0
Query 248: 0.6822
Query 249: 0.0323
Query 250: 0.0614
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Padua, Monolingual French, Auto, TD Run IMSMFRP
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 49 queries): 1.0
Query 201: 0.1309 Total number of documents
Query 202: 0.5888 over all queries
Query 203: 0.4272 Retrieved: 49000
Query 204: 0.8135 Relevant: 915 0.8
Query 205: 0.4190 Rel_ret: 832
Query 206: 0.3117
Query 207: 0.2397 Interpolated Recall -
Query 208: 0.6792 Precision Averages:
Query 209: 0.3472 at 0.00 0.6914
Query 210: 0.3580 at 0.10 0.6128 0.6
Query 211: 0.7624 at 0.20 0.5763
Query 212: 0.2642 at 0.30 0.5166
Query 213: 0.7121 at 0.40 0.4469
Precision
Query 214: 0.0758 at 0.50 0.4218
Query 215: 0.0551 at 0.60 0.4035 0.4
Query 216: 0.0363 at 0.70 0.3711
Query 217: 0.5322 at 0.80 0.3332
Query 218: 0.9072 at 0.90 0.2855
Query 219: 0.2271 at 1.00 0.2261
Query 220: 0.1439 0.2
Query 221: 0.4128 Avg. prec. (non-interpolated)
Query 222: 0.0366 for all rel. documents
Query 223: 0.0187 0.4253
Query 224: 0.9762 Precision:
Query 225: 0.0227 At 5 docs: 0.4367 0.0
Query 226: 1.0000 At 10 docs: 0.3673 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.3469 At 15 docs: 0.3170
Query 229: 0.3754 At 20 docs: 0.2918 Recall
Query 230: 0.8980 At 30 docs: 0.2510
Query 231: 0.3663 At 100 docs: 0.1300
Query 232: 0.0236 At 200 docs: 0.0744 Run IMSMFRP
Query 233: 0.2654 At 500 docs: 0.0322 Comparison to median by topic
Query 234: 0.3596 At 1000 docs: 0.0170
Query 235: 0.6829 +1.0
Query 236: 1.0000 R-Precision (prec. after R
Query 237: 0.9610 (=num_rel) docs. retrieved):
Query 238: 0.3186 Exact: 0.3871
Query 239: 0.0814
Query 240: 1.0000
Query 241: 0.0112 +0.5
Query 242: 0.1084
Query 243: 0.5930
Query 244: 0.0185
Query 245: 0.9167
Query 246: 0.1129
Query 247: 0.9769
0.0
Query 248: 0.7441
Query 249: 0.0303
Query 250: 0.1524
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Padua, Monolingual French, Auto, TD Run IMSMFRPqe
Average precision Overall statistics
(individual queries): (for 49 queries):
Recall−Precision Values
1.0
Query 201: 0.1967 Total number of documents
Query 202: 0.6728 over all queries
Query 203: 0.4818 Retrieved: 49000
Query 204: 0.3041 Relevant: 915
Query 205: 0.3174 Rel_ret: 707 0.8
Query 206: 0.5225
Query 207: 0.0236 Interpolated Recall -
Query 208: 0.1585 Precision Averages:
Query 209: 0.1047 at 0.00 0.6661
Query 210: 0.0619 at 0.10 0.6091 0.6
Query 211: 0.6980 at 0.20 0.5422
Query 212: 0.0447 at 0.30 0.4847
Query 213: 0.5635 at 0.40 0.4503
Precision
Query 214: 0.3581 at 0.50 0.4094
Query 215: 0.0123 at 0.60 0.3585 0.4
Query 216: 0.0007 at 0.70 0.2530
Query 217: 0.2046 at 0.80 0.2102
Query 218: 0.8002 at 0.90 0.1609
Query 219: 0.7533 at 1.00 0.1323
Query 220: 0.0004 0.2
Query 221: 0.5411 Avg. prec. (non-interpolated)
Query 222: 0.0006 for all rel. documents
Query 223: 0.0036 0.3775
Query 224: 0.9762 Precision:
Query 225: 0.5000 At 5 docs: 0.4694 0.0
Query 226: 1.0000 At 10 docs: 0.3735 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.6309 At 15 docs: 0.2980
Query 229: 0.1582 At 20 docs: 0.2541 Recall
Query 230: 0.6191 At 30 docs: 0.2082
Query 231: 0.2061 At 100 docs: 0.0984
Query 232: 0.0277 At 200 docs: 0.0562 Run IMSMFRPqe
Query 233: 0.0927 At 500 docs: 0.0264
Query 234: 0.6667 At 1000 docs: 0.0144 Comparison to median by topic
Query 235: 0.6727 +1.0
Query 236: 1.0000 R-Precision (prec. after R
Query 237: 0.5632 (=num_rel) docs. retrieved):
Query 238: 0.2141 Exact: 0.3558
Query 239: 0.0534
Query 240: 1.0000
Query 241: 0.0027 +0.5
Query 242: 0.1666
Query 243: 0.1586
Query 244: 0.5000
Query 245: 0.7525
Query 246: 0.0864
Query 247: 0.8817
Query 248: 0.2623 0.0
Query 249: 0.0072
Query 250: 0.4751
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Padua, Monolingual French, Auto, TD Run IMSMFRUd65
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 49 queries): 1.0
Query 201: 0.1479 Total number of documents
Query 202: 0.5741 over all queries
Query 203: 0.3023 Retrieved: 49000
Query 204: 0.7672 Relevant: 915
Query 205: 0.3778 Rel_ret: 809
0.8
Query 206: 0.3302
Query 207: 0.1446 Interpolated Recall -
Query 208: 0.6792 Precision Averages:
Query 209: 0.2227 at 0.00 0.6857
Query 210: 0.5635 at 0.10 0.5950 0.6
Query 211: 0.7282 at 0.20 0.5406
Query 212: 0.2376 at 0.30 0.4922
Query 213: 0.7210 at 0.40 0.4501
Precision
Query 214: 0.0782 at 0.50 0.4228
Query 215: 0.0662 at 0.60 0.3938 0.4
Query 216: 0.0455 at 0.70 0.3567
Query 217: 0.5154 at 0.80 0.3228
Query 218: 0.9205 at 0.90 0.2788
Query 219: 0.1435 at 1.00 0.2240
Query 220: 0.2391 0.2
Query 221: 0.3345 Avg. prec. (non-interpolated)
Query 222: 0.0230 for all rel. documents
Query 223: 0.0201 0.4153
Query 224: 0.9762 Precision:
Query 225: 0.0357 At 5 docs: 0.4490 0.0
Query 226: 1.0000 At 10 docs: 0.3653 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.3394 At 15 docs: 0.3252
Query 229: 0.3675 At 20 docs: 0.2959 Recall
Query 230: 0.9332 At 30 docs: 0.2524
Query 231: 0.3194 At 100 docs: 0.1276
Query 232: 0.0183 At 200 docs: 0.0731 Run IMSMFRUd65
Query 233: 0.4027 At 500 docs: 0.0316 Comparison to median by topic
Query 234: 0.0921 At 1000 docs: 0.0165
Query 235: 0.6688 +1.0
Query 236: 1.0000 R-Precision (prec. after R
Query 237: 0.9520 (=num_rel) docs. retrieved):
Query 238: 0.2888 Exact: 0.3955
Query 239: 0.1049
Query 240: 1.0000
Query 241: 0.0017 +0.5
Query 242: 0.1240
Query 243: 0.5484
Query 244: 0.0244
Query 245: 0.8929
Query 246: 0.1364
Query 247: 0.9669
Query 248: 0.7788
0.0
Query 249: 0.0400
Query 250: 0.1534
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Alicante, Monolingual French, Auto, TD Run IRn−MFr−Dexp
Average precision Overall statistics
(individual queries): (for 49 queries):
Recall−Precision Values
1.0
Query 201: 0.1282 Total number of documents
Query 202: 0.5485 over all queries
Query 203: 0.5513 Retrieved: 49000
Query 204: 0.7944 Relevant: 915
Query 205: 0.5386 Rel_ret: 842 0.8
Query 206: 0.2259
Query 207: 0.2887 Interpolated Recall -
Query 208: 0.5208 Precision Averages:
Query 209: 0.1941 at 0.00 0.6517
Query 210: 0.1274 at 0.10 0.5885 0.6
Query 211: 0.7975 at 0.20 0.5353
Query 212: 0.3102 at 0.30 0.4899
Query 213: 0.7000 at 0.40 0.4585
Precision
Query 214: 0.0373 at 0.50 0.4355
Query 215: 0.0781 at 0.60 0.4141 0.4
Query 216: 0.0078 at 0.70 0.3734
Query 217: 0.3079 at 0.80 0.3423
Query 218: 0.8935 at 0.90 0.2942
Query 219: 0.0358 at 1.00 0.2278
Query 220: 0.0222 0.2
Query 221: 0.6081 Avg. prec. (non-interpolated)
Query 222: 0.0192 for all rel. documents
Query 223: 0.0125 0.4217
Query 224: 1.0000 Precision:
Query 225: 0.0175 At 5 docs: 0.4163 0.0
Query 226: 1.0000 At 10 docs: 0.3612 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.3878 At 15 docs: 0.3211
Query 229: 0.4508 At 20 docs: 0.3010 Recall
Query 230: 0.8922 At 30 docs: 0.2537
Query 231: 0.3909 At 100 docs: 0.1339
Query 232: 0.0148 At 200 docs: 0.0763 Run IRn−MFr−Dexp
Query 233: 0.4311 At 500 docs: 0.0331
Query 234: 0.2831 At 1000 docs: 0.0172 Comparison to median by topic
Query 235: 0.7774 +1.0
Query 236: 0.9698 R-Precision (prec. after R
Query 237: 0.8808 (=num_rel) docs. retrieved):
Query 238: 0.3608 Exact: 0.3969
Query 239: 0.1710
Query 240: 1.0000
Query 241: 0.0290 +0.5
Query 242: 0.3125
Query 243: 0.4112
Query 244: 0.0100
Query 245: 1.0000
Query 246: 0.0944
Query 247: 0.9714
Query 248: 0.6636 0.0
Query 249: 0.3333
Query 250: 0.0628
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Alicante, Monolingual French, Auto, TD Run IRn−MFr−nexp
Average precision Overall statistics
(individual queries): (for 49 queries):
Recall−Precision Values
1.0
Query 201: 0.1340 Total number of documents
Query 202: 0.6507 over all queries
Query 203: 0.4620 Retrieved: 49000
Query 204: 0.9036 Relevant: 915
Query 205: 0.6249 Rel_ret: 829 0.8
Query 206: 0.3072
Query 207: 0.3100 Interpolated Recall -
Query 208: 0.4891 Precision Averages:
Query 209: 0.0419 at 0.00 0.6797
Query 210: 0.4000 at 0.10 0.6192 0.6
Query 211: 0.7514 at 0.20 0.5218
Query 212: 0.3340 at 0.30 0.4663
Query 213: 0.6733 at 0.40 0.4356
Precision
Query 214: 0.0448 at 0.50 0.4251
Query 215: 0.0650 at 0.60 0.3885 0.4
Query 216: 0.0131 at 0.70 0.3546
Query 217: 0.3446 at 0.80 0.3228
Query 218: 0.8962 at 0.90 0.2661
Query 219: 0.2234 at 1.00 0.1928
Query 220: 0.0187 0.2
Query 221: 0.3824 Avg. prec. (non-interpolated)
Query 222: 0.0299 for all rel. documents
Query 223: 0.0046 0.4086
Query 224: 0.9762 Precision:
Query 225: 0.0130 At 5 docs: 0.4531 0.0
Query 226: 0.5000 At 10 docs: 0.3612 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.2559 At 15 docs: 0.3143
Query 229: 0.3752 At 20 docs: 0.2929 Recall
Query 230: 0.9037 At 30 docs: 0.2497
Query 231: 0.3073 At 100 docs: 0.1308
Query 232: 0.0170 At 200 docs: 0.0757 Run IRn−MFr−nexp
Query 233: 0.3286 At 500 docs: 0.0324
Query 234: 0.2353 At 1000 docs: 0.0169 Comparison to median by topic
Query 235: 0.7519 +1.0
Query 236: 0.8029 R-Precision (prec. after R
Query 237: 0.9162 (=num_rel) docs. retrieved):
Query 238: 0.3491 Exact: 0.3941
Query 239: 0.2069
Query 240: 1.0000
Query 241: 0.0371 +0.5
Query 242: 0.3400
Query 243: 0.4302
Query 244: 0.0250
Query 245: 1.0000
Query 246: 0.1156
Query 247: 0.9556
Query 248: 0.6852 0.0
Query 249: 0.2500
Query 250: 0.1386
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Alicante, Monolingual French, Auto, TD Run IRn−MFr−Pexp
Average precision Overall statistics
(individual queries): (for 49 queries):
Recall−Precision Values
1.0
Query 201: 0.1282 Total number of documents
Query 202: 0.5485 over all queries
Query 203: 0.5513 Retrieved: 49000
Query 204: 0.7944 Relevant: 915
Query 205: 0.5386 Rel_ret: 836 0.8
Query 206: 0.2259
Query 207: 0.4075 Interpolated Recall -
Query 208: 0.5208 Precision Averages:
Query 209: 0.1767 at 0.00 0.6733
Query 210: 0.1274 at 0.10 0.6147 0.6
Query 211: 0.7975 at 0.20 0.5331
Query 212: 0.3288 at 0.30 0.4944
Query 213: 0.7046 at 0.40 0.4558
Precision
Query 214: 0.0401 at 0.50 0.4347
Query 215: 0.0708 at 0.60 0.4152 0.4
Query 216: 0.0079 at 0.70 0.3777
Query 217: 0.3079 at 0.80 0.3442
Query 218: 0.8935 at 0.90 0.3026
Query 219: 0.0248 at 1.00 0.2281
Query 220: 0.0107 0.2
Query 221: 0.6081 Avg. prec. (non-interpolated)
Query 222: 0.0274 for all rel. documents
Query 223: 0.0118 0.4251
Query 224: 1.0000 Precision:
Query 225: 0.0175 At 5 docs: 0.4204 0.0
Query 226: 1.0000 At 10 docs: 0.3694 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.3913 At 15 docs: 0.3211
Query 229: 0.4508 At 20 docs: 0.2990 Recall
Query 230: 0.9060 At 30 docs: 0.2531
Query 231: 0.3909 At 100 docs: 0.1333
Query 232: 0.0102 At 200 docs: 0.0759 Run IRn−MFr−Pexp
Query 233: 0.4537 At 500 docs: 0.0331
Query 234: 0.4128 At 1000 docs: 0.0171 Comparison to median by topic
Query 235: 0.6826 +1.0
Query 236: 0.9698 R-Precision (prec. after R
Query 237: 0.8808 (=num_rel) docs. retrieved):
Query 238: 0.3608 Exact: 0.3978
Query 239: 0.1710
Query 240: 1.0000
Query 241: 0.0338 +0.5
Query 242: 0.3125
Query 243: 0.4112
Query 244: 0.0097
Query 245: 1.0000
Query 246: 0.0944
Query 247: 0.9556
Query 248: 0.6636 0.0
Query 249: 0.3333
Query 250: 0.0648
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
ILTG, Monolingual French, Auto, TDN Run ltrcmonofr1
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 49 queries): 1.0
Query 201: 0.2541 Total number of documents
Query 202: 0.5812 over all queries
Query 203: 0.4195 Retrieved: 49000
Query 204: 0.3014 Relevant: 915
Query 205: 0.4249 Rel_ret: 703
0.8
Query 206: 0.1685
Query 207: 0.1137 Interpolated Recall -
Query 208: 0.4863 Precision Averages:
Query 209: 0.0700 at 0.00 0.5947
Query 210: 0.1352 at 0.10 0.5530 0.6
Query 211: 0.7753 at 0.20 0.4798
Query 212: 0.0665 at 0.30 0.4101
Query 213: 0.4411 at 0.40 0.3710
Precision
Query 214: 0.1350 at 0.50 0.3452
Query 215: 0.0982 at 0.60 0.3220 0.4
Query 216: 0.0081 at 0.70 0.2878
Query 217: 0.1529 at 0.80 0.2420
Query 218: 0.8491 at 0.90 0.1802
Query 219: 0.1638 at 1.00 0.1280
Query 220: 0.0543 0.2
Query 221: 0.4384 Avg. prec. (non-interpolated)
Query 222: 0.0682 for all rel. documents
Query 223: 0.0041 0.3434
Query 224: 1.0000 Precision:
Query 225: 0.2000 At 5 docs: 0.3959 0.0
Query 226: 1.0000 At 10 docs: 0.3265 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.1160 At 15 docs: 0.2871
Query 229: 0.0030 At 20 docs: 0.2571 Recall
Query 230: 0.9097 At 30 docs: 0.2265
Query 231: 0.3999 At 100 docs: 0.1061
Query 232: 0.0000 At 200 docs: 0.0598 Run ltrcmonofr1
Query 233: 0.5745 At 500 docs: 0.0268 Comparison to median by topic
Query 234: 0.0081 At 1000 docs: 0.0143
Query 235: 0.1362 +1.0
Query 236: 1.0000 R-Precision (prec. after R
Query 237: 0.5511 (=num_rel) docs. retrieved):
Query 238: 0.2926 Exact: 0.3489
Query 239: 0.0156
Query 240: 1.0000
Query 241: 0.0005 +0.5
Query 242: 0.5250
Query 243: 0.3601
Query 244: 0.0024
Query 245: 0.7500
Query 246: 0.1786
Query 247: 0.7877
Query 248: 0.6850
0.0
Query 249: 0.1111
Query 250: 0.0092
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
ILTG, Monolingual French, Auto, TDN Run ltrcmonofr2
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 49 queries): 1.0
Query 201: 0.2156 Total number of documents
Query 202: 0.5472 over all queries
Query 203: 0.3717 Retrieved: 49000
Query 204: 0.1194 Relevant: 915
Query 205: 0.3135 Rel_ret: 665
0.8
Query 206: 0.2683
Query 207: 0.1629 Interpolated Recall -
Query 208: 0.6042 Precision Averages:
Query 209: 0.0627 at 0.00 0.5713
Query 210: 0.0775 at 0.10 0.4816 0.6
Query 211: 0.8229 at 0.20 0.4099
Query 212: 0.1257 at 0.30 0.3679
Query 213: 0.1991 at 0.40 0.3336
Precision
Query 214: 0.0362 at 0.50 0.2970
Query 215: 0.0935 at 0.60 0.2528 0.4
Query 216: 0.1269 at 0.70 0.2028
Query 217: 0.0523 at 0.80 0.1553
Query 218: 0.6750 at 0.90 0.0959
Query 219: 0.0736 at 1.00 0.0160
Query 220: 0.0634 0.2
Query 221: 0.4942 Avg. prec. (non-interpolated)
Query 222: 0.1003 for all rel. documents
Query 223: 0.0059 0.2754
Query 224: 0.7708 Precision:
Query 225: 0.0196 At 5 docs: 0.3429 0.0
Query 226: 0.0000 At 10 docs: 0.2837 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.1179 At 15 docs: 0.2544
Query 229: 0.0148 At 20 docs: 0.2296 Recall
Query 230: 0.8836 At 30 docs: 0.2014
Query 231: 0.5306 At 100 docs: 0.0990
Query 232: 0.0011 At 200 docs: 0.0562 Run ltrcmonofr2
Query 233: 0.5457 At 500 docs: 0.0255 Comparison to median by topic
Query 234: 0.0004 At 1000 docs: 0.0136
Query 235: 0.1712 +1.0
Query 236: 0.8818 R-Precision (prec. after R
Query 237: 0.4151 (=num_rel) docs. retrieved):
Query 238: 0.4181 Exact: 0.2770
Query 239: 0.0296
Query 240: 0.0000
Query 241: 0.0011 +0.5
Query 242: 0.7220
Query 243: 0.5581
Query 244: 0.0000
Query 245: 0.5112
Query 246: 0.2475
Query 247: 0.5116
Query 248: 0.4474
0.0
Query 249: 0.0204
Query 250: 0.0626
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
ILTG, Monolingual French, Auto, TDN Run ltrcmonofr3
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 49 queries): 1.0
Query 201: 0.0969 Total number of documents
Query 202: 0.5940 over all queries
Query 203: 0.2202 Retrieved: 49000
Query 204: 0.3250 Relevant: 915
Query 205: 0.3066 Rel_ret: 728
0.8
Query 206: 0.2581
Query 207: 0.2196 Interpolated Recall -
Query 208: 0.8875 Precision Averages:
Query 209: 0.0994 at 0.00 0.5698
Query 210: 0.0334 at 0.10 0.5205 0.6
Query 211: 0.6302 at 0.20 0.4783
Query 212: 0.2592 at 0.30 0.4130
Query 213: 0.5195 at 0.40 0.3717
Precision
Query 214: 0.1331 at 0.50 0.3351
Query 215: 0.2486 at 0.60 0.3161 0.4
Query 216: 0.0104 at 0.70 0.2969
Query 217: 0.0124 at 0.80 0.2358
Query 218: 0.8625 at 0.90 0.2078
Query 219: 0.3355 at 1.00 0.1646
Query 220: 0.0288 0.2
Query 221: 0.4614 Avg. prec. (non-interpolated)
Query 222: 0.0877 for all rel. documents
Query 223: 0.0696 0.3365
Query 224: 0.8734 Precision:
Query 225: 0.1667 At 5 docs: 0.3306 0.0
Query 226: 1.0000 At 10 docs: 0.3143 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.1762 At 15 docs: 0.2830
Query 229: 0.0023 At 20 docs: 0.2510 Recall
Query 230: 0.8379 At 30 docs: 0.2143
Query 231: 0.0135 At 100 docs: 0.1061
Query 232: 0.0086 At 200 docs: 0.0649 Run ltrcmonofr3
Query 233: 0.5777 At 500 docs: 0.0278 Comparison to median by topic
Query 234: 0.0040 At 1000 docs: 0.0149
Query 235: 0.3600 +1.0
Query 236: 1.0000 R-Precision (prec. after R
Query 237: 0.6760 (=num_rel) docs. retrieved):
Query 238: 0.3324 Exact: 0.3242
Query 239: 0.0231
Query 240: 1.0000
Query 241: 0.0004 +0.5
Query 242: 0.4750
Query 243: 0.4344
Query 244: 0.0040
Query 245: 0.7500
Query 246: 0.0744
Query 247: 0.1858
Query 248: 0.6816
0.0
Query 249: 0.0833
Query 250: 0.0493
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
ILTG, Monolingual French, Auto, TDN Run ltrcmonofr4
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 49 queries): 1.0
Query 201: 0.0166 Total number of documents
Query 202: 0.6231 over all queries
Query 203: 0.1952 Retrieved: 49000
Query 204: 0.2924 Relevant: 915
Query 205: 0.2051 Rel_ret: 635
0.8
Query 206: 0.2920
Query 207: 0.1881 Interpolated Recall -
Query 208: 0.8875 Precision Averages:
Query 209: 0.1242 at 0.00 0.4977
Query 210: 0.0310 at 0.10 0.4527 0.6
Query 211: 0.6302 at 0.20 0.4159
Query 212: 0.1586 at 0.30 0.3666
Query 213: 0.0120 at 0.40 0.3147
Precision
Query 214: 0.2484 at 0.50 0.2826
Query 215: 0.1399 at 0.60 0.2598 0.4
Query 216: 0.0089 at 0.70 0.2382
Query 217: 0.0086 at 0.80 0.1989
Query 218: 0.8801 at 0.90 0.1665
Query 219: 0.4690 at 1.00 0.1331
Query 220: 0.0157 0.2
Query 221: 0.4774 Avg. prec. (non-interpolated)
Query 222: 0.0877 for all rel. documents
Query 223: 0.0696 0.2865
Query 224: 0.9333 Precision:
Query 225: 0.1667 At 5 docs: 0.3224 0.0
Query 226: 0.0104 At 10 docs: 0.2939 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.1950 At 15 docs: 0.2639
Query 229: 0.0012 At 20 docs: 0.2347 Recall
Query 230: 0.8379 At 30 docs: 0.2027
Query 231: 0.0135 At 100 docs: 0.0916
Query 232: 0.1046 At 200 docs: 0.0586 Run ltrcmonofr4
Query 233: 0.4646 At 500 docs: 0.0249 Comparison to median by topic
Query 234: 0.0000 At 1000 docs: 0.0130
Query 235: 0.3064 +1.0
Query 236: 1.0000 R-Precision (prec. after R
Query 237: 0.6760 (=num_rel) docs. retrieved):
Query 238: 0.3039 Exact: 0.2793
Query 239: 0.0238
Query 240: 0.5000
Query 241: 0.0000 +0.5
Query 242: 0.2767
Query 243: 0.3667
Query 244: 0.0044
Query 245: 0.7500
Query 246: 0.0755
Query 247: 0.1987
Query 248: 0.7235
0.0
Query 249: 0.0400
Query 250: 0.0041
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
NII Group, Monolingual French, Auto, TD Run NiiFF01
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 49 queries): 1.0
Query 201: 0.3699 Total number of documents
Query 202: 0.6254 over all queries
Query 203: 0.4625 Retrieved: 49000
Query 204: 0.8509 Relevant: 915
Query 205: 0.5013 Rel_ret: 837
0.8
Query 206: 0.3215
Query 207: 0.3452 Interpolated Recall -
Query 208: 0.5191 Precision Averages:
Query 209: 0.2032 at 0.00 0.5734
Query 210: 0.0592 at 0.10 0.5452 0.6
Query 211: 0.8503 at 0.20 0.5041
Query 212: 0.4620 at 0.30 0.4645
Query 213: 0.8065 at 0.40 0.4294
Precision
Query 214: 0.0651 at 0.50 0.4163
Query 215: 0.0005 at 0.60 0.3922 0.4
Query 216: 0.0039 at 0.70 0.3609
Query 217: 0.5449 at 0.80 0.3100
Query 218: 0.9356 at 0.90 0.2635
Query 219: 0.0141 at 1.00 0.1886
Query 220: 0.0027 0.2
Query 221: 0.6226 Avg. prec. (non-interpolated)
Query 222: 0.0427 for all rel. documents
Query 223: 0.0192 0.3944
Query 224: 1.0000 Precision:
Query 225: 0.0025 At 5 docs: 0.4204 0.0
Query 226: 0.1667 At 10 docs: 0.3429 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.0004 At 15 docs: 0.3143
Query 229: 0.3770 At 20 docs: 0.2990 Recall
Query 230: 0.8521 At 30 docs: 0.2619
Query 231: 0.4975 At 100 docs: 0.1341
Query 232: 0.0656 At 200 docs: 0.0751 Run NiiFF01
Query 233: 0.4837 At 500 docs: 0.0326 Comparison to median by topic
Query 234: 0.0258 At 1000 docs: 0.0171
Query 235: 0.6556 +1.0
Query 236: 0.9206 R-Precision (prec. after R
Query 237: 0.8844 (=num_rel) docs. retrieved):
Query 238: 0.3467 Exact: 0.3783
Query 239: 0.0159
Query 240: 1.0000
Query 241: 0.0186 +0.5
Query 242: 0.1905
Query 243: 0.4083
Query 244: 0.0175
Query 245: 0.7561
Query 246: 0.1355
Query 247: 0.9833
Query 248: 0.6545
0.0
Query 249: 0.2000
Query 250: 0.0371
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Amsterdam, Monolingual French, Auto, TD Run UAmsC04FrFr4GiSb
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 49 queries): 1.0
Query 201: 0.3712 Total number of documents
Query 202: 0.6980 over all queries
Query 203: 0.5176 Retrieved: 49000
Query 204: 0.7903 Relevant: 915
Query 205: 0.3546 Rel_ret: 829
0.8
Query 206: 0.5251
Query 207: 0.1489 Interpolated Recall -
Query 208: 0.8042 Precision Averages:
Query 209: 0.1992 at 0.00 0.7007
Query 210: 0.0925 at 0.10 0.6394 0.6
Query 211: 0.8996 at 0.20 0.5933
Query 212: 0.3391 at 0.30 0.5360
Query 213: 0.7083 at 0.40 0.4900
Precision
Query 214: 0.1713 at 0.50 0.4679
Query 215: 0.0600 at 0.60 0.4166 0.4
Query 216: 0.0333 at 0.70 0.3733
Query 217: 0.5011 at 0.80 0.3230
Query 218: 0.8730 at 0.90 0.2594
Query 219: 0.5727 at 1.00 0.2075
Query 220: 0.0901 0.2
Query 221: 0.6760 Avg. prec. (non-interpolated)
Query 222: 0.0046 for all rel. documents
Query 223: 0.0227 0.4410
Query 224: 0.7523 Precision:
Query 225: 0.0185 At 5 docs: 0.4816 0.0
Query 226: 1.0000 At 10 docs: 0.4041 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.6105 At 15 docs: 0.3537
Query 229: 0.3896 At 20 docs: 0.3235 Recall
Query 230: 0.8724 At 30 docs: 0.2748
Query 231: 0.3625 At 100 docs: 0.1357
Query 232: 0.1313 At 200 docs: 0.0774 Run UAmsC04FrFr4GiSb
Query 233: 0.5241 At 500 docs: 0.0332 Comparison to median by topic
Query 234: 0.1094 At 1000 docs: 0.0169
Query 235: 0.7111 +1.0
Query 236: 0.8091 R-Precision (prec. after R
Query 237: 0.8326 (=num_rel) docs. retrieved):
Query 238: 0.3548 Exact: 0.4154
Query 239: 0.0841
Query 240: 1.0000
Query 241: 0.0081 +0.5
Query 242: 0.2685
Query 243: 0.3731
Query 244: 0.2500
Query 245: 0.7569
Query 246: 0.1390
Query 247: 0.9909
Query 248: 0.7564
0.0
Query 249: 0.0312
Query 250: 0.0165
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Amsterdam, Monolingual French, Auto, TD Run UAmsC04FrFr4GiWd
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 49 queries): 1.0
Query 201: 0.2616 Total number of documents
Query 202: 0.6802 over all queries
Query 203: 0.5632 Retrieved: 49000
Query 204: 0.8121 Relevant: 915
Query 205: 0.2515 Rel_ret: 772
0.8
Query 206: 0.5211
Query 207: 0.1923 Interpolated Recall -
Query 208: 0.8042 Precision Averages:
Query 209: 0.2236 at 0.00 0.6452
Query 210: 0.0668 at 0.10 0.6070 0.6
Query 211: 0.8918 at 0.20 0.5555
Query 212: 0.2886 at 0.30 0.5070
Query 213: 0.8243 at 0.40 0.4632
Precision
Query 214: 0.0673 at 0.50 0.4178
Query 215: 0.0741 at 0.60 0.3731 0.4
Query 216: 0.0278 at 0.70 0.3375
Query 217: 0.5095 at 0.80 0.2959
Query 218: 0.8900 at 0.90 0.2479
Query 219: 0.4039 at 1.00 0.1881
Query 220: 0.1291 0.2
Query 221: 0.6973 Avg. prec. (non-interpolated)
Query 222: 0.0067 for all rel. documents
Query 223: 0.0206 0.4092
Query 224: 0.6777 Precision:
Query 225: 0.0333 At 5 docs: 0.4612 0.0
Query 226: 0.1111 At 10 docs: 0.3816 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.5557 At 15 docs: 0.3415
Query 229: 0.3264 At 20 docs: 0.3020 Recall
Query 230: 0.8799 At 30 docs: 0.2639
Query 231: 0.2559 At 100 docs: 0.1324
Query 232: 0.0013 At 200 docs: 0.0742 Run UAmsC04FrFr4GiWd
Query 233: 0.5166 At 500 docs: 0.0310 Comparison to median by topic
Query 234: 0.0833 At 1000 docs: 0.0158
Query 235: 0.7759 +1.0
Query 236: 0.8919 R-Precision (prec. after R
Query 237: 0.8292 (=num_rel) docs. retrieved):
Query 238: 0.3671 Exact: 0.3753
Query 239: 0.0458
Query 240: 1.0000
Query 241: 0.0025 +0.5
Query 242: 0.3867
Query 243: 0.3624
Query 244: 0.0909
Query 245: 0.7559
Query 246: 0.0821
Query 247: 0.9909
Query 248: 0.7413
0.0
Query 249: 0.0286
Query 250: 0.0505
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Amsterdam, Monolingual French, Auto, TD Run UAmsC04FrFrAll
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 49 queries): 1.0
Query 201: 0.2764 Total number of documents
Query 202: 0.6848 over all queries
Query 203: 0.5210 Retrieved: 49000
Query 204: 0.8127 Relevant: 915
Query 205: 0.4093 Rel_ret: 830
0.8
Query 206: 0.5054
Query 207: 0.2055 Interpolated Recall -
Query 208: 0.8042 Precision Averages:
Query 209: 0.2133 at 0.00 0.6977
Query 210: 0.0918 at 0.10 0.6491 0.6
Query 211: 0.9014 at 0.20 0.6024
Query 212: 0.3394 at 0.30 0.5503
Query 213: 0.8465 at 0.40 0.5098
Precision
Query 214: 0.1180 at 0.50 0.4688
Query 215: 0.0636 at 0.60 0.4239 0.4
Query 216: 0.0344 at 0.70 0.3811
Query 217: 0.5319 at 0.80 0.3330
Query 218: 0.9106 at 0.90 0.2806
Query 219: 0.4858 at 1.00 0.2193
Query 220: 0.0981 0.2
Query 221: 0.6545 Avg. prec. (non-interpolated)
Query 222: 0.0051 for all rel. documents
Query 223: 0.0235 0.4499
Query 224: 0.7857 Precision:
Query 225: 0.0294 At 5 docs: 0.4816 0.0
Query 226: 1.0000 At 10 docs: 0.3959 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.5614 At 15 docs: 0.3510
Query 229: 0.3747 At 20 docs: 0.3194 Recall
Query 230: 0.9047 At 30 docs: 0.2721
Query 231: 0.3633 At 100 docs: 0.1365
Query 232: 0.0339 At 200 docs: 0.0762 Run UAmsC04FrFrAll
Query 233: 0.5201 At 500 docs: 0.0324 Comparison to median by topic
Query 234: 0.0867 At 1000 docs: 0.0169
Query 235: 0.7851 +1.0
Query 236: 0.8949 R-Precision (prec. after R
Query 237: 0.8348 (=num_rel) docs. retrieved):
Query 238: 0.4210 Exact: 0.4107
Query 239: 0.0635
Query 240: 1.0000
Query 241: 0.0036 +0.5
Query 242: 0.4029
Query 243: 0.3765
Query 244: 0.3333
Query 245: 0.7603
Query 246: 0.1388
Query 247: 0.9909
Query 248: 0.7598
0.0
Query 249: 0.0370
Query 250: 0.0459
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
SUNY Buffalo, Monolingual French, Auto, TD Run UBmonoFR01
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 49 queries): 1.0
Query 201: 0.3020 Total number of documents
Query 202: 0.6394 over all queries
Query 203: 0.4743 Retrieved: 49000
Query 204: 0.8405 Relevant: 915 0.8
Query 205: 0.6522 Rel_ret: 863
Query 206: 0.3861
Query 207: 0.3233 Interpolated Recall -
Query 208: 0.9500 Precision Averages:
Query 209: 0.2480 at 0.00 0.7146
Query 210: 0.1366 at 0.10 0.6418 0.6
Query 211: 0.8484 at 0.20 0.6069
Query 212: 0.3777 at 0.30 0.5499
Query 213: 0.8025 at 0.40 0.5192
Precision
Query 214: 0.0769 at 0.50 0.4907
Query 215: 0.0761 at 0.60 0.4477 0.4
Query 216: 0.0225 at 0.70 0.4006
Query 217: 0.4496 at 0.80 0.3626
Query 218: 0.8967 at 0.90 0.3130
Query 219: 0.3395 at 1.00 0.2446
Query 220: 0.1543 0.2
Query 221: 0.3317 Avg. prec. (non-interpolated)
Query 222: 0.0604 for all rel. documents
Query 223: 0.0268 0.4629
Query 224: 0.8774 Precision:
Query 225: 0.0099 At 5 docs: 0.4653 0.0
Query 226: 1.0000 At 10 docs: 0.4143 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.3881 At 15 docs: 0.3633
Query 229: 0.4311 At 20 docs: 0.3255 Recall
Query 230: 0.8575 At 30 docs: 0.2680
Query 231: 0.6923 At 100 docs: 0.1390
Query 232: 0.0796 At 200 docs: 0.0786 Run UBmonoFR01
Query 233: 0.4759 At 500 docs: 0.0334 Comparison to median by topic
Query 234: 0.1558 At 1000 docs: 0.0176
Query 235: 0.7978 +1.0
Query 236: 0.8614 R-Precision (prec. after R
Query 237: 0.8264 (=num_rel) docs. retrieved):
Query 238: 0.5167 Exact: 0.4239
Query 239: 0.1022
Query 240: 1.0000
Query 241: 0.0083 +0.5
Query 242: 0.2583
Query 243: 0.8481
Query 244: 0.0043
Query 245: 1.0000
Query 246: 0.2346
Query 247: 0.9263
0.0
Query 248: 0.7296
Query 249: 0.0208
Query 250: 0.1620
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Université de Neuchâtel, Monolingual French, Auto, TD Run UniNEfr1
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 49 queries): 1.0
Query 201: 0.2356 Total number of documents
Query 202: 0.6322 over all queries
Query 203: 0.5961 Retrieved: 49000
Query 204: 0.8707 Relevant: 915 0.8
Query 205: 0.5208 Rel_ret: 864
Query 206: 0.4015
Query 207: 0.3042 Interpolated Recall -
Query 208: 0.6792 Precision Averages:
Query 209: 0.1705 at 0.00 0.6248
Query 210: 0.1213 at 0.10 0.5939 0.6
Query 211: 0.8526 at 0.20 0.5588
Query 212: 0.3801 at 0.30 0.5448
Query 213: 0.8281 at 0.40 0.5187
Precision
Query 214: 0.0446 at 0.50 0.4710
Query 215: 0.2354 at 0.60 0.4377 0.4
Query 216: 0.0176 at 0.70 0.3869
Query 217: 0.3518 at 0.80 0.3598
Query 218: 0.9425 at 0.90 0.3142
Query 219: 0.5213 at 1.00 0.2548
Query 220: 0.1381 0.2
Query 221: 0.4849 Avg. prec. (non-interpolated)
Query 222: 0.1280 for all rel. documents
Query 223: 0.0220 0.4437
Query 224: 0.9762 Precision:
Query 225: 0.0062 At 5 docs: 0.4571 0.0
Query 226: 0.1111 At 10 docs: 0.3980 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.4793 At 15 docs: 0.3592
Query 229: 0.3984 At 20 docs: 0.3286 Recall
Query 230: 0.9151 At 30 docs: 0.2816
Query 231: 0.2995 At 100 docs: 0.1429
Query 232: 0.0259 At 200 docs: 0.0793 Run UniNEfr1
Query 233: 0.4378 At 500 docs: 0.0341 Comparison to median by topic
Query 234: 0.7167 At 1000 docs: 0.0176
Query 235: 0.8417 +1.0
Query 236: 0.9430 R-Precision (prec. after R
Query 237: 0.9599 (=num_rel) docs. retrieved):
Query 238: 0.3655 Exact: 0.4136
Query 239: 0.1612
Query 240: 1.0000
Query 241: 0.0136 +0.5
Query 242: 0.3054
Query 243: 0.5084
Query 244: 0.0042
Query 245: 0.9500
Query 246: 0.1605
Query 247: 0.9573
0.0
Query 248: 0.6469
Query 249: 0.0333
Query 250: 0.0433
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Université de Neuchâtel, Monolingual French, Auto, TD Run UniNEfr2
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 49 queries): 1.0
Query 201: 0.2389 Total number of documents
Query 202: 0.6943 over all queries
Query 203: 0.6010 Retrieved: 49000
Query 204: 0.8470 Relevant: 915 0.8
Query 205: 0.5551 Rel_ret: 840
Query 206: 0.5280
Query 207: 0.4631 Interpolated Recall -
Query 208: 0.8042 Precision Averages:
Query 209: 0.3179 at 0.00 0.6946
Query 210: 0.0752 at 0.10 0.6725 0.6
Query 211: 0.8814 at 0.20 0.6327
Query 212: 0.4124 at 0.30 0.5919
Query 213: 0.8465 at 0.40 0.5328
Precision
Query 214: 0.0483 at 0.50 0.4916
Query 215: 0.2660 at 0.60 0.4546 0.4
Query 216: 0.0379 at 0.70 0.4150
Query 217: 0.3600 at 0.80 0.3886
Query 218: 0.9343 at 0.90 0.3467
Query 219: 0.3830 at 1.00 0.2736
Query 220: 0.2544 0.2
Query 221: 0.5349 Avg. prec. (non-interpolated)
Query 222: 0.1667 for all rel. documents
Query 223: 0.0203 0.4849
Query 224: 1.0000 Precision:
Query 225: 0.0097 At 5 docs: 0.4857 0.0
Query 226: 0.5000 At 10 docs: 0.4245 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.6289 At 15 docs: 0.3837
Query 229: 0.5024 At 20 docs: 0.3500 Recall
Query 230: 0.9042 At 30 docs: 0.2891
Query 231: 0.7089 At 100 docs: 0.1437
Query 232: 0.0025 At 200 docs: 0.0796 Run UniNEfr2
Query 233: 0.4193 At 500 docs: 0.0334 Comparison to median by topic
Query 234: 0.4961 At 1000 docs: 0.0171
Query 235: 0.8107 +1.0
Query 236: 0.9833 R-Precision (prec. after R
Query 237: 0.9245 (=num_rel) docs. retrieved):
Query 238: 0.4830 Exact: 0.4475
Query 239: 0.1704
Query 240: 1.0000
Query 241: 0.0316 +0.5
Query 242: 0.4643
Query 243: 0.4638
Query 244: 0.0036
Query 245: 1.0000
Query 246: 0.2222
Query 247: 1.0000
0.0
Query 248: 0.6658
Query 249: 0.0200
Query 250: 0.0724
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Université de Neuchâtel, Monolingual French, Auto, TDN Run UniNEfr3
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 49 queries): 1.0
Query 201: 0.1955 Total number of documents
Query 202: 0.5769 over all queries
Query 203: 0.5778 Retrieved: 49000
Query 204: 0.8581 Relevant: 915 0.8
Query 205: 0.5614 Rel_ret: 898
Query 206: 0.4279
Query 207: 0.3328 Interpolated Recall -
Query 208: 0.6792 Precision Averages:
Query 209: 0.2563 at 0.00 0.6909
Query 210: 0.0786 at 0.10 0.6653 0.6
Query 211: 0.8536 at 0.20 0.6340
Query 212: 0.4074 at 0.30 0.5781
Query 213: 0.8561 at 0.40 0.5442
Precision
Query 214: 0.0872 at 0.50 0.4870
Query 215: 0.3012 at 0.60 0.4612 0.4
Query 216: 0.0233 at 0.70 0.4133
Query 217: 0.2926 at 0.80 0.3796
Query 218: 0.9142 at 0.90 0.3291
Query 219: 0.6306 at 1.00 0.2627
Query 220: 0.5050 0.2
Query 221: 0.6447 Avg. prec. (non-interpolated)
Query 222: 0.1433 for all rel. documents
Query 223: 0.0222 0.4785
Query 224: 1.0000 Precision:
Query 225: 0.0323 At 5 docs: 0.5102 0.0
Query 226: 0.2000 At 10 docs: 0.4388 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.5372 At 15 docs: 0.3918
Query 229: 0.4925 At 20 docs: 0.3571 Recall
Query 230: 0.8943 At 30 docs: 0.3075
Query 231: 0.3807 At 100 docs: 0.1537
Query 232: 0.5790 At 200 docs: 0.0850 Run UniNEfr3
Query 233: 0.6700 At 500 docs: 0.0359 Comparison to median by topic
Query 234: 0.3162 At 1000 docs: 0.0183
Query 235: 0.6968 +1.0
Query 236: 1.0000 R-Precision (prec. after R
Query 237: 0.9103 (=num_rel) docs. retrieved):
Query 238: 0.3693 Exact: 0.4488
Query 239: 0.1777
Query 240: 1.0000
Query 241: 0.0161 +0.5
Query 242: 0.4295
Query 243: 0.5433
Query 244: 0.0023
Query 245: 0.9500
Query 246: 0.1494
Query 247: 1.0000
0.0
Query 248: 0.7797
Query 249: 0.0263
Query 250: 0.0705
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Glasgow, Monolingual French, Auto, TDN Run UOGLQ
Average precision Overall statistics
Recall−Precision Values
(individual queries): (for 49 queries):
1.0
Query 201: 0.2097 Total number of documents
Query 202: 0.6740 over all queries
Query 203: 0.4347 Retrieved: 49000
Query 204: 0.8720 Relevant: 915
Query 205: 0.5787 Rel_ret: 846 0.8
Query 206: 0.2972
Query 207: 0.1984 Interpolated Recall -
Query 208: 0.7708 Precision Averages:
Query 209: 0.0538 at 0.00 0.6513
Query 210: 0.2028 at 0.10 0.5901 0.6
Query 211: 0.6823 at 0.20 0.5668
Query 212: 0.3427 at 0.30 0.5380
Query 213: 0.8206 at 0.40 0.4856
Precision
Query 214: 0.0941 at 0.50 0.4593
Query 215: 0.0000 at 0.60 0.4274 0.4
Query 216: 0.0063 at 0.70 0.3617
Query 217: 0.3264 at 0.80 0.3094
Query 218: 0.9169 at 0.90 0.2594
Query 219: 0.0087 at 1.00 0.1735
Query 220: 0.5179 0.2
Query 221: 0.2150 Avg. prec. (non-interpolated)
Query 222: 0.0425 for all rel. documents
Query 223: 0.0114 0.4244
Query 224: 1.0000 Precision:
Query 225: 0.0027 At 5 docs: 0.4449 0.0
Query 226: 0.3333 At 10 docs: 0.3735 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.0006 At 15 docs: 0.3320
Query 229: 0.4661 At 20 docs: 0.3031 Recall
Query 230: 0.8982 At 30 docs: 0.2673
Query 231: 0.6247 At 100 docs: 0.1349
Query 232: 0.5407 At 200 docs: 0.0767 Run UOGLQ
Query 233: 0.4107 At 500 docs: 0.0329
Query 234: 0.2489 At 1000 docs: 0.0173
Comparison to median by topic
Query 235: 0.8357 +1.0
Query 236: 0.9733 R-Precision (prec. after R
Query 237: 0.8476 (=num_rel) docs. retrieved):
Query 238: 0.5061 Exact: 0.3937
Query 239: 0.1345
Query 240: 1.0000
Query 241: 0.0269 +0.5
Query 242: 0.3539
Query 243: 0.4969
Query 244: 0.0000
Query 245: 0.7917
Query 246: 0.3647
Query 247: 0.8727
Query 248: 0.5566 0.0
Query 249: 0.2000
Query 250: 0.0324
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Glasgow, Monolingual French, Auto, TDN Run UOGLQQE
Average precision Overall statistics
Recall−Precision Values
(individual queries): (for 49 queries):
1.0
Query 201: 0.0030 Total number of documents
Query 202: 0.6481 over all queries
Query 203: 0.6692 Retrieved: 49000
Query 204: 0.7935 Relevant: 915
Query 205: 0.5400 Rel_ret: 838 0.8
Query 206: 0.5073
Query 207: 0.3208 Interpolated Recall -
Query 208: 0.2028 Precision Averages:
Query 209: 0.3105 at 0.00 0.6142
Query 210: 0.0762 at 0.10 0.5911 0.6
Query 211: 0.8711 at 0.20 0.5715
Query 212: 0.5101 at 0.30 0.5068
Query 213: 0.8776 at 0.40 0.4680
Precision
Query 214: 0.0994 at 0.50 0.4290
Query 215: 0.0781 at 0.60 0.3987 0.4
Query 216: 0.0039 at 0.70 0.3659
Query 217: 0.0320 at 0.80 0.3090
Query 218: 0.9276 at 0.90 0.2656
Query 219: 0.0002 at 1.00 0.1851
Query 220: 0.1882 0.2
Query 221: 0.1707 Avg. prec. (non-interpolated)
Query 222: 0.1797 for all rel. documents
Query 223: 0.0234 0.4186
Query 224: 0.8089 Precision:
Query 225: 0.0370 At 5 docs: 0.4286 0.0
Query 226: 0.5000 At 10 docs: 0.3735 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.0144 At 15 docs: 0.3320
Query 229: 0.3977 At 20 docs: 0.3031 Recall
Query 230: 0.8123 At 30 docs: 0.2701
Query 231: 0.6181 At 100 docs: 0.1396
Query 232: 0.7143 At 200 docs: 0.0774 Run UOGLQQE
Query 233: 0.5229 At 500 docs: 0.0327
Query 234: 0.2411 At 1000 docs: 0.0171
Comparison to median by topic
Query 235: 0.8024 +1.0
Query 236: 1.0000 R-Precision (prec. after R
Query 237: 0.8698 (=num_rel) docs. retrieved):
Query 238: 0.5531 Exact: 0.3623
Query 239: 0.0450
Query 240: 1.0000
Query 241: 0.0000 +0.5
Query 242: 0.3488
Query 243: 0.4021
Query 244: 0.0045
Query 245: 0.7672
Query 246: 0.2026
Query 247: 0.9833
Query 248: 0.8194 0.0
Query 249: 0.0122
Query 250: 0.0021
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Glasgow, Monolingual French, Auto, T Run UOGSQ
Average precision Overall statistics
Recall−Precision Values
(individual queries): (for 49 queries):
1.0
Query 201: 0.2378 Total number of documents
Query 202: 0.6413 over all queries
Query 203: 0.4619 Retrieved: 49000
Query 204: 0.8243 Relevant: 915
Query 205: 0.5670 Rel_ret: 842 0.8
Query 206: 0.3802
Query 207: 0.2482 Interpolated Recall -
Query 208: 0.9500 Precision Averages:
Query 209: 0.0852 at 0.00 0.6653
Query 210: 0.1613 at 0.10 0.5962 0.6
Query 211: 0.7004 at 0.20 0.5663
Query 212: 0.3463 at 0.30 0.5182
Query 213: 0.8054 at 0.40 0.4844
Precision
Query 214: 0.1047 at 0.50 0.4453
Query 215: 0.0000 at 0.60 0.4273 0.4
Query 216: 0.0182 at 0.70 0.3556
Query 217: 0.3383 at 0.80 0.3080
Query 218: 0.8811 at 0.90 0.2589
Query 219: 0.0119 at 1.00 0.1963
Query 220: 0.2953 0.2
Query 221: 0.2404 Avg. prec. (non-interpolated)
Query 222: 0.0582 for all rel. documents
Query 223: 0.0142 0.4237
Query 224: 0.9306 Precision:
Query 225: 0.0015 At 5 docs: 0.4408 0.0
Query 226: 0.2500 At 10 docs: 0.4000 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.0006 At 15 docs: 0.3551
Query 229: 0.4310 At 20 docs: 0.3102 Recall
Query 230: 0.8825 At 30 docs: 0.2612
Query 231: 0.6255 At 100 docs: 0.1339
Query 232: 0.4712 At 200 docs: 0.0764 Run UOGSQ
Query 233: 0.4291 At 500 docs: 0.0330
Query 234: 0.1758 At 1000 docs: 0.0172
Comparison to median by topic
Query 235: 0.8274 +1.0
Query 236: 0.9207 R-Precision (prec. after R
Query 237: 0.7993 (=num_rel) docs. retrieved):
Query 238: 0.6103 Exact: 0.3893
Query 239: 0.1079
Query 240: 1.0000
Query 241: 0.0216 +0.5
Query 242: 0.3609
Query 243: 0.5329
Query 244: 0.0000
Query 245: 0.8929
Query 246: 0.3929
Query 247: 0.8267
Query 248: 0.4864 0.0
Query 249: 0.3333
Query 250: 0.0766
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Glasgow, Monolingual French, Auto, T Run UOGSQQE
Average precision Overall statistics
Recall−Precision Values
(individual queries): (for 49 queries):
1.0
Query 201: 0.0001 Total number of documents
Query 202: 0.6450 over all queries
Query 203: 0.5399 Retrieved: 49000
Query 204: 0.7636 Relevant: 915
Query 205: 0.6703 Rel_ret: 720 0.8
Query 206: 0.1891
Query 207: 0.2483 Interpolated Recall -
Query 208: 0.0004 Precision Averages:
Query 209: 0.2504 at 0.00 0.5589
Query 210: 0.1281 at 0.10 0.4719 0.6
Query 211: 0.8339 at 0.20 0.4293
Query 212: 0.3648 at 0.30 0.3948
Query 213: 0.0128 at 0.40 0.3724
Precision
Query 214: 0.1746 at 0.50 0.3614
Query 215: 0.3778 at 0.60 0.3253 0.4
Query 216: 0.0029 at 0.70 0.2845
Query 217: 0.0176 at 0.80 0.2689
Query 218: 0.0871 at 0.90 0.2378
Query 219: 0.4499 at 1.00 0.1923
Query 220: 0.0811 0.2
Query 221: 0.0193 Avg. prec. (non-interpolated)
Query 222: 0.0067 for all rel. documents
Query 223: 0.0176 0.3400
Query 224: 1.0000 Precision:
Query 225: 0.0233 At 5 docs: 0.3673 0.0
Query 226: 0.3333 At 10 docs: 0.2918 0.0 0.2 0.4 0.6 0.8 1.0
Query 228: 0.0014 At 15 docs: 0.2667
Query 229: 0.1923 At 20 docs: 0.2418 Recall
Query 230: 0.7681 At 30 docs: 0.2061
Query 231: 0.0090 At 100 docs: 0.1039
Query 232: 0.5794 At 200 docs: 0.0605 Run UOGSQQE
Query 233: 0.2549 At 500 docs: 0.0273
Query 234: 0.2881 At 1000 docs: 0.0147
Comparison to median by topic
Query 235: 0.8190 +1.0
Query 236: 1.0000 R-Precision (prec. after R
Query 237: 0.8799 (=num_rel) docs. retrieved):
Query 238: 0.0002 Exact: 0.2975
Query 239: 0.0781
Query 240: 1.0000
Query 241: 0.0000 +0.5
Query 242: 0.4368
Query 243: 0.2552
Query 244: 0.0033
Query 245: 1.0000
Query 246: 0.1347
Query 247: 0.8567
Query 248: 0.8647 0.0
Query 249: 0.0000
Query 250: 0.0004
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Universidad de Evora, Monolingual Portuguese, Auto, T Run alentejo1
Average precision Overall statistics
(individual queries): (for 46 queries): Recall−Precision Values
1.0
Query 201: 0.0271 Total number of documents
Query 202: 0.1335 over all queries
Query 203: 0.0267 Retrieved: 40134
Query 204: 0.1694 Relevant: 678
Query 205: 0.7500 Rel_ret: 442 0.8
Query 206: 0.0321
Query 207: 0.1964 Interpolated Recall -
Query 208: 0.2233 Precision Averages:
Query 209: 0.0000 at 0.00 0.3875
Query 210: 0.0588 at 0.10 0.3318 0.6
Query 211: 0.5799 at 0.20 0.2502
Query 212: 0.0019 at 0.30 0.2045
Query 213: 0.1743 at 0.40 0.1946
Precision
Query 214: 0.0000 at 0.50 0.1872
Query 215: 0.0000 at 0.60 0.1676 0.4
Query 217: 0.0005 at 0.70 0.1253
Query 218: 0.4980 at 0.80 0.1240
Query 219: 0.0031 at 0.90 0.1216
Query 221: 0.6050 at 1.00 0.1101
Query 222: 0.0160 0.2
Query 223: 0.0000 Avg. prec. (non-interpolated)
Query 224: 0.1964 for all rel. documents
Query 225: 0.0115 0.1827
Query 226: 0.4762 Precision:
Query 228: 0.0206 At 5 docs: 0.2000 0.0
Query 229: 0.6585 At 10 docs: 0.1652 0.0 0.2 0.4 0.6 0.8 1.0
Query 230: 0.1971 At 15 docs: 0.1377
Query 231: 0.0000 At 20 docs: 0.1141 Recall
Query 232: 0.0328 At 30 docs: 0.0913
Query 233: 0.2399 At 100 docs: 0.0496
Query 234: 0.0081 At 200 docs: 0.0339 Run alentejo1
Query 235: 0.0164 At 500 docs: 0.0177
Query 236: 0.6667 At 1000 docs: 0.0096 Comparison to median by topic
Query 237: 1.0000 +1.0
Query 238: 0.0029 R-Precision (prec. after R
Query 239: 0.0226 (=num_rel) docs. retrieved):
Query 241: 0.0343 Exact: 0.1640
Query 242: 0.0000
Query 243: 0.0015
Query 244: 0.0000 +0.5
Query 245: 0.9167
Query 246: 0.0000
Query 247: 0.2853
Query 248: 0.1008
Query 249: 0.0043
Query 250: 0.0136
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Universidad de Evora, Monolingual Portuguese, Auto, T Run alentejo2
Average precision Overall statistics
(individual queries): (for 46 queries): Recall−Precision Values
1.0
Query 201: 0.0068 Total number of documents
Query 202: 0.1339 over all queries
Query 203: 0.0231 Retrieved: 39128
Query 204: 0.0021 Relevant: 678
Query 205: 0.0352 Rel_ret: 422 0.8
Query 206: 0.0340
Query 207: 0.0966 Interpolated Recall -
Query 208: 0.2233 Precision Averages:
Query 209: 0.0006 at 0.00 0.2587
Query 210: 0.0663 at 0.10 0.2216 0.6
Query 211: 0.4424 at 0.20 0.1861
Query 212: 0.0035 at 0.30 0.1528
Query 213: 0.1686 at 0.40 0.1358
Precision
Query 214: 0.0000 at 0.50 0.1135
Query 215: 0.0000 at 0.60 0.0989 0.4
Query 217: 0.0008 at 0.70 0.0883
Query 218: 0.6214 at 0.80 0.0859
Query 219: 0.0066 at 0.90 0.0731
Query 221: 0.1499 at 1.00 0.0707
Query 222: 0.0246 0.2
Query 223: 0.0000 Avg. prec. (non-interpolated)
Query 224: 0.1964 for all rel. documents
Query 225: 0.0204 0.1243
Query 226: 0.1785 Precision:
Query 228: 0.0337 At 5 docs: 0.1348 0.0
Query 229: 0.6746 At 10 docs: 0.1130 0.0 0.2 0.4 0.6 0.8 1.0
Query 230: 0.1971 At 15 docs: 0.1101
Query 231: 0.0000 At 20 docs: 0.0957 Recall
Query 232: 0.0028 At 30 docs: 0.0790
Query 233: 0.0016 At 100 docs: 0.0487
Query 234: 0.0263 At 200 docs: 0.0313 Run alentejo2
Query 235: 0.0000 At 500 docs: 0.0167
Query 236: 0.0390 At 1000 docs: 0.0092 Comparison to median by topic
Query 237: 1.0000 +1.0
Query 238: 0.0029 R-Precision (prec. after R
Query 239: 0.0077 (=num_rel) docs. retrieved):
Query 241: 0.0789 Exact: 0.1080
Query 242: 0.0000
Query 243: 0.0031
Query 244: 0.0000 +0.5
Query 245: 0.9167
Query 246: 0.0000
Query 247: 0.2942
Query 248: 0.0001
Query 249: 0.0030
Query 250: 0.0006
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
JHU/APL, Monolingual Portuguese, Auto, TD Run aplmopta
Average precision Overall statistics
(individual queries): (for 46 queries):
Recall−Precision Values
1.0
Query 201: 0.0044 Total number of documents
Query 202: 0.8155 over all queries
Query 203: 0.4075 Retrieved: 46000
Query 204: 0.8571 Relevant: 678
Query 205: 0.8333 Rel_ret: 582 0.8
Query 206: 0.5385
Query 207: 0.0619 Interpolated Recall -
Query 208: 1.0000 Precision Averages:
Query 209: 0.0007 at 0.00 0.5514
Query 210: 0.6242 at 0.10 0.5351 0.6
Query 211: 0.9551 at 0.20 0.5217
Query 212: 0.3556 at 0.30 0.4942
Query 213: 0.6575 at 0.40 0.4826
Precision
Query 214: 0.0850 at 0.50 0.4486
Query 215: 0.3333 at 0.60 0.4096 0.4
Query 217: 0.0009 at 0.70 0.3816
Query 218: 0.8156 at 0.80 0.3563
Query 219: 0.0146 at 0.90 0.3287
Query 221: 0.9107 at 1.00 0.2783
Query 222: 0.0031 0.2
Query 223: 1.0000 Avg. prec. (non-interpolated)
Query 224: 0.1964 for all rel. documents
Query 225: 0.2500 0.4231
Query 226: 0.4929 Precision:
Query 228: 0.5183 At 5 docs: 0.3696 0.0
Query 229: 0.7998 At 10 docs: 0.3000 0.0 0.2 0.4 0.6 0.8 1.0
Query 230: 0.6247 At 15 docs: 0.2435
Query 231: 0.0004 At 20 docs: 0.2174 Recall
Query 232: 0.1284 At 30 docs: 0.1841
Query 233: 0.7362 At 100 docs: 0.0883
Query 234: 0.0048 At 200 docs: 0.0536 Run aplmopta
Query 235: 0.0019 At 500 docs: 0.0245
Query 236: 0.5317 At 1000 docs: 0.0127 Comparison to median by topic
Query 237: 1.0000 +1.0
Query 238: 0.0034 R-Precision (prec. after R
Query 239: 0.0711 (=num_rel) docs. retrieved):
Query 241: 0.0005 Exact: 0.3562
Query 242: 0.4507
Query 243: 0.3333
Query 244: 0.0069 +0.5
Query 245: 1.0000
Query 246: 0.2500
Query 247: 1.0000
Query 248: 0.6391
Query 249: 0.1415
Query 250: 0.0055
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
JHU/APL, Monolingual Portuguese, Auto, TD Run aplmoptb
Average precision Overall statistics
(individual queries): (for 46 queries):
Recall−Precision Values
1.0
Query 201: 0.0005 Total number of documents
Query 202: 0.7844 over all queries
Query 203: 0.3953 Retrieved: 46000
Query 204: 0.8560 Relevant: 678
Query 205: 1.0000 Rel_ret: 604 0.8
Query 206: 0.6429
Query 207: 0.0779 Interpolated Recall -
Query 208: 1.0000 Precision Averages:
Query 209: 0.0007 at 0.00 0.5969
Query 210: 0.4227 at 0.10 0.5617 0.6
Query 211: 0.9482 at 0.20 0.5469
Query 212: 0.3188 at 0.30 0.5112
Query 213: 0.6562 at 0.40 0.4873
Precision
Query 214: 0.1225 at 0.50 0.4713
Query 215: 0.3333 at 0.60 0.4311 0.4
Query 217: 0.7597 at 0.70 0.4144
Query 218: 0.7878 at 0.80 0.3817
Query 219: 0.0013 at 0.90 0.3522
Query 221: 0.8552 at 1.00 0.3103
Query 222: 0.0397 0.2
Query 223: 1.0000 Avg. prec. (non-interpolated)
Query 224: 0.2083 for all rel. documents
Query 225: 0.1111 0.4445
Query 226: 0.4929 Precision:
Query 228: 0.4971 At 5 docs: 0.3957 0.0
Query 229: 0.8204 At 10 docs: 0.3065 0.0 0.2 0.4 0.6 0.8 1.0
Query 230: 0.6253 At 15 docs: 0.2623
Query 231: 0.0016 At 20 docs: 0.2446 Recall
Query 232: 0.2137 At 30 docs: 0.2007
Query 233: 0.6762 At 100 docs: 0.0913
Query 234: 0.0021 At 200 docs: 0.0558 Run aplmoptb
Query 235: 0.0025 At 500 docs: 0.0256
Query 236: 0.6389 At 1000 docs: 0.0131 Comparison to median by topic
Query 237: 1.0000 +1.0
Query 238: 0.0169 R-Precision (prec. after R
Query 239: 0.1538 (=num_rel) docs. retrieved):
Query 241: 0.0152 Exact: 0.3907
Query 242: 0.4921
Query 243: 0.3333
Query 244: 0.0027 +0.5
Query 245: 1.0000
Query 246: 0.3333
Query 247: 1.0000
Query 248: 0.6019
Query 249: 0.2021
Query 250: 0.0016
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
JHU/APL, Monolingual Portuguese, Auto, TD Run aplmoptc
Average precision Overall statistics
(individual queries): (for 46 queries):
Recall−Precision Values
1.0
Query 201: 0.0052 Total number of documents
Query 202: 0.7849 over all queries
Query 203: 0.4230 Retrieved: 46000
Query 204: 0.8228 Relevant: 678
Query 205: 1.0000 Rel_ret: 589 0.8
Query 206: 0.5526
Query 207: 0.3551 Interpolated Recall -
Query 208: 1.0000 Precision Averages:
Query 209: 0.0029 at 0.00 0.6553
Query 210: 0.5762 at 0.10 0.6225 0.6
Query 211: 0.9405 at 0.20 0.5890
Query 212: 0.3410 at 0.30 0.5366
Query 213: 0.6745 at 0.40 0.5095
Precision
Query 214: 0.1781 at 0.50 0.4910
Query 215: 0.3333 at 0.60 0.4407 0.4
Query 217: 0.6060 at 0.70 0.4223
Query 218: 0.8102 at 0.80 0.3900
Query 219: 0.0125 at 0.90 0.3526
Query 221: 0.7885 at 1.00 0.3197
Query 222: 0.0456 0.2
Query 223: 1.0000 Avg. prec. (non-interpolated)
Query 224: 1.0000 for all rel. documents
Query 225: 0.1250 0.4691
Query 226: 0.6917 Precision:
Query 228: 0.5455 At 5 docs: 0.4130 0.0
Query 229: 0.8240 At 10 docs: 0.3174 0.0 0.2 0.4 0.6 0.8 1.0
Query 230: 0.6244 At 15 docs: 0.2667
Query 231: 0.0014 At 20 docs: 0.2348 Recall
Query 232: 0.0011 At 30 docs: 0.1906
Query 233: 0.7545 At 100 docs: 0.0883
Query 234: 0.0083 At 200 docs: 0.0539 Run aplmoptc
Query 235: 0.0039 At 500 docs: 0.0247
Query 236: 0.6389 At 1000 docs: 0.0128 Comparison to median by topic
Query 237: 1.0000 +1.0
Query 238: 0.0263 R-Precision (prec. after R
Query 239: 0.1218 (=num_rel) docs. retrieved):
Query 241: 0.0266 Exact: 0.4219
Query 242: 0.4507
Query 243: 0.3333
Query 244: 0.0083 +0.5
Query 245: 1.0000
Query 246: 0.3333
Query 247: 1.0000
Query 248: 0.5974
Query 249: 0.2032
Query 250: 0.0043
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Hummingbird, Monolingual Portuguese, Auto, T Run humPT04t
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 46 queries): 1.0
Query 201: 0.0166 Total number of documents
Query 202: 0.5174 over all queries
Query 203: 0.2225 Retrieved: 40815
Query 204: 0.4234 Relevant: 678
Query 205: 0.7500 Rel_ret: 588
0.8
Query 206: 0.1650
Query 207: 0.2279 Interpolated Recall -
Query 208: 0.6290 Precision Averages:
Query 209: 0.0000 at 0.00 0.6270
Query 210: 0.4389 at 0.10 0.5865 0.6
Query 211: 0.9076 at 0.20 0.5416
Query 212: 0.2216 at 0.30 0.4752
Query 213: 0.6177 at 0.40 0.4422
Precision
Query 214: 0.0000 at 0.50 0.4234
Query 215: 0.0385 at 0.60 0.3666 0.4
Query 217: 0.9405 at 0.70 0.3293
Query 218: 0.8089 at 0.80 0.3120
Query 219: 0.0221 at 0.90 0.2729
Query 221: 0.8179 at 1.00 0.2382
Query 222: 0.0105 0.2
Query 223: 0.2500 Avg. prec. (non-interpolated)
Query 224: 0.5244 for all rel. documents
Query 225: 1.0000 0.4051
Query 226: 0.8929 Precision:
Query 228: 0.0408 At 5 docs: 0.3783 0.0
Query 229: 0.7982 At 10 docs: 0.2935 0.0 0.2 0.4 0.6 0.8 1.0
Query 230: 0.4925 At 15 docs: 0.2478
Query 231: 0.0296 At 20 docs: 0.2109 Recall
Query 232: 0.2062 At 30 docs: 0.1804
Query 233: 0.6345 At 100 docs: 0.0835
Query 234: 0.4167 At 200 docs: 0.0514 Run humPT04t
Query 235: 0.0909 At 500 docs: 0.0241 Comparison to median by topic
Query 236: 0.5744 At 1000 docs: 0.0128
Query 237: 1.0000 +1.0
Query 238: 0.0303 R-Precision (prec. after R
Query 239: 0.0579 (=num_rel) docs. retrieved):
Query 241: 0.1717 Exact: 0.3418
Query 242: 0.5242
Query 243: 0.3333
Query 244: 0.0000 +0.5
Query 245: 1.0000
Query 246: 0.2000
Query 247: 0.9861
Query 248: 0.5373
Query 249: 0.0423
Query 250: 0.0234
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Hummingbird, Monolingual Portuguese, Auto, TD Run humPT04td
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 46 queries): 1.0
Query 201: 0.0281 Total number of documents
Query 202: 0.5441 over all queries
Query 203: 0.2371 Retrieved: 46000
Query 204: 0.5474 Relevant: 678
Query 205: 0.7500 Rel_ret: 613
0.8
Query 206: 0.8333
Query 207: 0.2742 Interpolated Recall -
Query 208: 1.0000 Precision Averages:
Query 209: 0.0000 at 0.00 0.6140
Query 210: 0.4800 at 0.10 0.5850 0.6
Query 211: 0.8943 at 0.20 0.5475
Query 212: 0.1327 at 0.30 0.5132
Query 213: 0.7478 at 0.40 0.5075
Precision
Query 214: 0.0046 at 0.50 0.4921
Query 215: 0.0476 at 0.60 0.4312 0.4
Query 217: 0.6235 at 0.70 0.4112
Query 218: 0.8145 at 0.80 0.3762
Query 219: 0.0285 at 0.90 0.3418
Query 221: 1.0000 at 1.00 0.2999
Query 222: 0.0205 0.2
Query 223: 0.5000 Avg. prec. (non-interpolated)
Query 224: 1.0000 for all rel. documents
Query 225: 0.5000 0.4534
Query 226: 0.8750 Precision:
Query 228: 0.3584 At 5 docs: 0.4087 0.0
Query 229: 0.7982 At 10 docs: 0.3196 0.0 0.2 0.4 0.6 0.8 1.0
Query 230: 0.5023 At 15 docs: 0.2594
Query 231: 0.0097 At 20 docs: 0.2261 Recall
Query 232: 0.0245 At 30 docs: 0.1891
Query 233: 0.7963 At 100 docs: 0.0887
Query 234: 0.1625 At 200 docs: 0.0542 Run humPT04td
Query 235: 0.0455 At 500 docs: 0.0255 Comparison to median by topic
Query 236: 0.5333 At 1000 docs: 0.0133
Query 237: 1.0000 +1.0
Query 238: 0.0833 R-Precision (prec. after R
Query 239: 0.1658 (=num_rel) docs. retrieved):
Query 241: 0.1125 Exact: 0.3791
Query 242: 0.7088
Query 243: 0.2500
Query 244: 0.0023 +0.5
Query 245: 1.0000
Query 246: 0.5000
Query 247: 1.0000
Query 248: 0.8075
Query 249: 0.0931
Query 250: 0.0190
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Hummingbird, Monolingual Portuguese, Auto, TD Run humPT04tde
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 46 queries): 1.0
Query 201: 0.0492 Total number of documents
Query 202: 0.6080 over all queries
Query 203: 0.2617 Retrieved: 46000
Query 204: 0.5914 Relevant: 678
Query 205: 0.5833 Rel_ret: 616
0.8
Query 206: 0.8333
Query 207: 0.3538 Interpolated Recall -
Query 208: 1.0000 Precision Averages:
Query 209: 0.0017 at 0.00 0.6260
Query 210: 0.5949 at 0.10 0.5786 0.6
Query 211: 0.9278 at 0.20 0.5541
Query 212: 0.2641 at 0.30 0.5360
Query 213: 0.7939 at 0.40 0.5245
Precision
Query 214: 0.0050 at 0.50 0.5132
Query 215: 0.2000 at 0.60 0.4727 0.4
Query 217: 0.7296 at 0.70 0.4412
Query 218: 0.8545 at 0.80 0.4180
Query 219: 0.0101 at 0.90 0.3801
Query 221: 1.0000 at 1.00 0.3323
Query 222: 0.0565 0.2
Query 223: 0.5000 Avg. prec. (non-interpolated)
Query 224: 1.0000 for all rel. documents
Query 225: 0.5000 0.4750
Query 226: 1.0000 Precision:
Query 228: 0.4505 At 5 docs: 0.4304 0.0
Query 229: 0.8180 At 10 docs: 0.3326 0.0 0.2 0.4 0.6 0.8 1.0
Query 230: 0.4989 At 15 docs: 0.2725
Query 231: 0.0038 At 20 docs: 0.2337 Recall
Query 232: 0.0570 At 30 docs: 0.1928
Query 233: 0.8507 At 100 docs: 0.0907
Query 234: 0.1409 At 200 docs: 0.0564 Run humPT04tde
Query 235: 0.0149 At 500 docs: 0.0260 Comparison to median by topic
Query 236: 0.5333 At 1000 docs: 0.0134
Query 237: 1.0000 +1.0
Query 238: 0.0769 R-Precision (prec. after R
Query 239: 0.1061 (=num_rel) docs. retrieved):
Query 241: 0.0731 Exact: 0.4071
Query 242: 0.8750
Query 243: 0.2500
Query 244: 0.0073 +0.5
Query 245: 1.0000
Query 246: 0.5000
Query 247: 1.0000
Query 248: 0.8057
Query 249: 0.0569
Query 250: 0.0141
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Alicante, Monolingual Portuguese, Auto, TD Run IRn−MP−Dexp
Average precision Overall statistics
(individual queries): (for 46 queries):
Recall−Precision Values
1.0
Query 201: 0.0212 Total number of documents
Query 202: 0.4325 over all queries
Query 203: 0.2288 Retrieved: 46000
Query 204: 0.3459 Relevant: 678
Query 205: 0.0595 Rel_ret: 538 0.8
Query 206: 0.7500
Query 207: 0.0384 Interpolated Recall -
Query 208: 1.0000 Precision Averages:
Query 209: 0.0019 at 0.00 0.5781
Query 210: 0.7019 at 0.10 0.5465 0.6
Query 211: 0.8224 at 0.20 0.4868
Query 212: 0.1817 at 0.30 0.4505
Query 213: 0.6419 at 0.40 0.4238
Precision
Query 214: 0.0000 at 0.50 0.3921
Query 215: 0.0278 at 0.60 0.3576 0.4
Query 217: 0.9325 at 0.70 0.3369
Query 218: 0.7071 at 0.80 0.3126
Query 219: 0.0008 at 0.90 0.2796
Query 221: 0.8552 at 1.00 0.2521
Query 222: 0.0033 0.2
Query 223: 0.2500 Avg. prec. (non-interpolated)
Query 224: 1.0000 for all rel. documents
Query 225: 1.0000 0.3909
Query 226: 0.1125 Precision:
Query 228: 0.3614 At 5 docs: 0.3696 0.0
Query 229: 0.2972 At 10 docs: 0.2870 0.0 0.2 0.4 0.6 0.8 1.0
Query 230: 0.4860 At 15 docs: 0.2275
Query 231: 0.0281 At 20 docs: 0.2011 Recall
Query 232: 0.0439 At 30 docs: 0.1587
Query 233: 0.7045 At 100 docs: 0.0713
Query 234: 0.0000 At 200 docs: 0.0437 Run IRn−MP−Dexp
Query 235: 0.0909 At 500 docs: 0.0212
Query 236: 0.7556 At 1000 docs: 0.0117 Comparison to median by topic
Query 237: 1.0000 +1.0
Query 238: 0.0145 R-Precision (prec. after R
Query 239: 0.1889 (=num_rel) docs. retrieved):
Query 241: 0.0162 Exact: 0.3533
Query 242: 0.5556
Query 243: 0.2500
Query 244: 0.2500 +0.5
Query 245: 1.0000
Query 246: 0.0250
Query 247: 1.0000
Query 248: 0.6585
Query 249: 0.1335
Query 250: 0.0058
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Alicante, Monolingual Portuguese, Auto, TD Run IRn−MP−nexp
Average precision Overall statistics
(individual queries): (for 46 queries):
Recall−Precision Values
1.0
Query 201: 0.0484 Total number of documents
Query 202: 0.2607 over all queries
Query 203: 0.2145 Retrieved: 46000
Query 204: 0.3690 Relevant: 678
Query 205: 0.1169 Rel_ret: 471 0.8
Query 206: 0.7000
Query 207: 0.1106 Interpolated Recall -
Query 208: 0.9250 Precision Averages:
Query 209: 0.0000 at 0.00 0.5799
Query 210: 0.3667 at 0.10 0.5078 0.6
Query 211: 0.7556 at 0.20 0.4636
Query 212: 0.0660 at 0.30 0.4066
Query 213: 0.5558 at 0.40 0.3838
Precision
Query 214: 0.0000 at 0.50 0.3634
Query 215: 0.0139 at 0.60 0.3169 0.4
Query 217: 0.8347 at 0.70 0.2963
Query 218: 0.7339 at 0.80 0.2736
Query 219: 0.0015 at 0.90 0.2439
Query 221: 0.7903 at 1.00 0.2193
Query 222: 0.0034 0.2
Query 223: 0.1667 Avg. prec. (non-interpolated)
Query 224: 1.0000 for all rel. documents
Query 225: 1.0000 0.3532
Query 226: 0.1052 Precision:
Query 228: 0.2327 At 5 docs: 0.3391 0.0
Query 229: 0.1751 At 10 docs: 0.2630 0.0 0.2 0.4 0.6 0.8 1.0
Query 230: 0.5051 At 15 docs: 0.2261
Query 231: 0.0837 At 20 docs: 0.1967 Recall
Query 232: 0.0396 At 30 docs: 0.1558
Query 233: 0.6798 At 100 docs: 0.0678
Query 234: 0.0000 At 200 docs: 0.0393 Run IRn−MP−nexp
Query 235: 0.0667 At 500 docs: 0.0188
Query 236: 0.5556 At 1000 docs: 0.0102 Comparison to median by topic
Query 237: 1.0000 +1.0
Query 238: 0.0154 R-Precision (prec. after R
Query 239: 0.1748 (=num_rel) docs. retrieved):
Query 241: 0.0298 Exact: 0.3302
Query 242: 0.5005
Query 243: 0.1429
Query 244: 0.0556 +0.5
Query 245: 1.0000
Query 246: 0.0185
Query 247: 1.0000
Query 248: 0.5699
Query 249: 0.2557
Query 250: 0.0050
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Alicante, Monolingual Portuguese, Auto, TD Run IRn−MP−Pexp
Average precision Overall statistics
(individual queries): (for 46 queries):
Recall−Precision Values
1.0
Query 201: 0.0190 Total number of documents
Query 202: 0.4297 over all queries
Query 203: 0.2478 Retrieved: 46000
Query 204: 0.4204 Relevant: 678
Query 205: 0.0595 Rel_ret: 497 0.8
Query 206: 0.4167
Query 207: 0.0426 Interpolated Recall -
Query 208: 1.0000 Precision Averages:
Query 209: 0.0342 at 0.00 0.5512
Query 210: 0.7332 at 0.10 0.5114 0.6
Query 211: 0.8302 at 0.20 0.4721
Query 212: 0.1330 at 0.30 0.4304
Query 213: 0.6254 at 0.40 0.4068
Precision
Query 214: 0.0000 at 0.50 0.3816
Query 215: 0.0244 at 0.60 0.3544 0.4
Query 217: 0.9325 at 0.70 0.3291
Query 218: 0.6876 at 0.80 0.2929
Query 219: 0.0008 at 0.90 0.2633
Query 221: 0.8552 at 1.00 0.2354
Query 222: 0.0079 0.2
Query 223: 0.2500 Avg. prec. (non-interpolated)
Query 224: 1.0000 for all rel. documents
Query 225: 0.3333 0.3750
Query 226: 0.1613 Precision:
Query 228: 0.3614 At 5 docs: 0.3739 0.0
Query 229: 0.2151 At 10 docs: 0.2870 0.0 0.2 0.4 0.6 0.8 1.0
Query 230: 0.5649 At 15 docs: 0.2261
Query 231: 0.0281 At 20 docs: 0.1978 Recall
Query 232: 0.0511 At 30 docs: 0.1594
Query 233: 0.7045 At 100 docs: 0.0720
Query 234: 0.0000 At 200 docs: 0.0427 Run IRn−MP−Pexp
Query 235: 0.1111 At 500 docs: 0.0196
Query 236: 0.7222 At 1000 docs: 0.0108 Comparison to median by topic
Query 237: 1.0000 +1.0
Query 238: 0.0143 R-Precision (prec. after R
Query 239: 0.1483 (=num_rel) docs. retrieved):
Query 241: 0.0125 Exact: 0.3225
Query 242: 0.8088
Query 243: 0.1429
Query 244: 0.2500 +0.5
Query 245: 1.0000
Query 246: 0.0238
Query 247: 1.0000
Query 248: 0.7028
Query 249: 0.1335
Query 250: 0.0078
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Thomson Legal, Monolingual Portuguese, Auto, TD Run tlrpt1
Average precision Overall statistics
(individual queries): (for 46 queries): Recall−Precision Values
1.0
Query 201: 0.0295 Total number of documents
Query 202: 0.4328 over all queries
Query 203: 0.2695 Retrieved: 46000
Query 204: 0.5495 Relevant: 678
Query 205: 0.5000 Rel_ret: 616 0.8
Query 206: 0.6667
Query 207: 0.2383 Interpolated Recall -
Query 208: 1.0000 Precision Averages:
Query 209: 0.0000 at 0.00 0.6021
Query 210: 0.4190 at 0.10 0.5979 0.6
Query 211: 0.8267 at 0.20 0.5505
Query 212: 0.1368 at 0.30 0.4922
Query 213: 0.6509 at 0.40 0.4826
Precision
Query 214: 0.0042 at 0.50 0.4723
Query 215: 0.0455 at 0.60 0.4174 0.4
Query 217: 0.6738 at 0.70 0.4003
Query 218: 0.7513 at 0.80 0.3605
Query 219: 0.0071 at 0.90 0.3282
Query 221: 0.9151 at 1.00 0.3052
Query 222: 0.0193 0.2
Query 223: 0.5000 Avg. prec. (non-interpolated)
Query 224: 1.0000 for all rel. documents
Query 225: 1.0000 0.4458
Query 226: 0.9167 Precision:
Query 228: 0.3557 At 5 docs: 0.3870 0.0
Query 229: 0.8013 At 10 docs: 0.2913 0.0 0.2 0.4 0.6 0.8 1.0
Query 230: 0.4529 At 15 docs: 0.2464
Query 231: 0.0300 At 20 docs: 0.2130 Recall
Query 232: 0.0630 At 30 docs: 0.1775
Query 233: 0.5369 At 100 docs: 0.0857
Query 234: 0.0406 At 200 docs: 0.0539 Run tlrpt1
Query 235: 0.0263 At 500 docs: 0.0253
Query 236: 0.5000 At 1000 docs: 0.0134 Comparison to median by topic
Query 237: 1.0000 +1.0
Query 238: 0.0400 R-Precision (prec. after R
Query 239: 0.0933 (=num_rel) docs. retrieved):
Query 241: 0.0701 Exact: 0.4017
Query 242: 0.8500
Query 243: 0.1111
Query 244: 0.0026 +0.5
Query 245: 1.0000
Query 246: 1.0000
Query 247: 1.0000
Query 248: 0.7496
Query 249: 0.1863
Query 250: 0.0446
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Thomson Legal, Monolingual Portuguese, Auto, TD Run tlrpt2
Average precision Overall statistics
(individual queries): (for 46 queries): Recall−Precision Values
1.0
Query 201: 0.0343 Total number of documents
Query 202: 0.4317 over all queries
Query 203: 0.2695 Retrieved: 46000
Query 204: 0.5495 Relevant: 678
Query 205: 0.5000 Rel_ret: 616 0.8
Query 206: 0.6667
Query 207: 0.2383 Interpolated Recall -
Query 208: 1.0000 Precision Averages:
Query 209: 0.0000 at 0.00 0.6053
Query 210: 0.4377 at 0.10 0.6002 0.6
Query 211: 0.8267 at 0.20 0.5550
Query 212: 0.1393 at 0.30 0.4953
Query 213: 0.6509 at 0.40 0.4869
Precision
Query 214: 0.0038 at 0.50 0.4735
Query 215: 0.0455 at 0.60 0.4211 0.4
Query 217: 0.6738 at 0.70 0.4049
Query 218: 0.7546 at 0.80 0.3624
Query 219: 0.0085 at 0.90 0.3323
Query 221: 0.9151 at 1.00 0.3085
Query 222: 0.0239 0.2
Query 223: 0.5000 Avg. prec. (non-interpolated)
Query 224: 1.0000 for all rel. documents
Query 225: 1.0000 0.4469
Query 226: 0.9167 Precision:
Query 228: 0.3557 At 5 docs: 0.3913 0.0
Query 229: 0.8013 At 10 docs: 0.2935 0.0 0.2 0.4 0.6 0.8 1.0
Query 230: 0.4529 At 15 docs: 0.2464
Query 231: 0.0421 At 20 docs: 0.2098 Recall
Query 232: 0.0647 At 30 docs: 0.1812
Query 233: 0.5369 At 100 docs: 0.0867
Query 234: 0.0489 At 200 docs: 0.0541 Run tlrpt2
Query 235: 0.0263 At 500 docs: 0.0253
Query 236: 0.5333 At 1000 docs: 0.0134 Comparison to median by topic
Query 237: 1.0000 +1.0
Query 238: 0.0400 R-Precision (prec. after R
Query 239: 0.0746 (=num_rel) docs. retrieved):
Query 241: 0.0701 Exact: 0.4044
Query 242: 0.8500
Query 243: 0.1111
Query 244: 0.0026 +0.5
Query 245: 1.0000
Query 246: 1.0000
Query 247: 1.0000
Query 248: 0.7264
Query 249: 0.1891
Query 250: 0.0446
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Amsterdam, Monolingual Portuguese, Auto, TD Run UAmsC04PoPo4GiSb
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 46 queries): 1.0
Query 201: 0.0146 Total number of documents
Query 202: 0.7994 over all queries
Query 203: 0.2342 Retrieved: 46000
Query 204: 0.8571 Relevant: 678
Query 205: 0.5909 Rel_ret: 605
0.8
Query 206: 0.8333
Query 207: 0.3349 Interpolated Recall -
Query 208: 1.0000 Precision Averages:
Query 209: 0.0348 at 0.00 0.5467
Query 210: 0.8509 at 0.10 0.5372 0.6
Query 211: 0.9328 at 0.20 0.5121
Query 212: 0.1517 at 0.30 0.4852
Query 213: 0.7426 at 0.40 0.4667
Precision
Query 214: 0.0819 at 0.50 0.4489
Query 215: 0.1000 at 0.60 0.3897 0.4
Query 217: 0.0702 at 0.70 0.3555
Query 218: 0.8109 at 0.80 0.3389
Query 219: 0.1224 at 0.90 0.3015
Query 221: 0.8542 at 1.00 0.2666
Query 222: 0.0045 0.2
Query 223: 0.5000 Avg. prec. (non-interpolated)
Query 224: 1.0000 for all rel. documents
Query 225: 0.0833 0.4110
Query 226: 0.5012 Precision:
Query 228: 0.4452 At 5 docs: 0.3565 0.0
Query 229: 0.5779 At 10 docs: 0.2804 0.0 0.2 0.4 0.6 0.8 1.0
Query 230: 0.3873 At 15 docs: 0.2464
Query 231: 0.0125 At 20 docs: 0.2174 Recall
Query 232: 0.0360 At 30 docs: 0.1725
Query 233: 0.5322 At 100 docs: 0.0848
Query 234: 0.0711 At 200 docs: 0.0526 Run UAmsC04PoPo4GiSb
Query 235: 0.0137 At 500 docs: 0.0253 Comparison to median by topic
Query 236: 0.5536 At 1000 docs: 0.0132
Query 237: 1.0000 +1.0
Query 238: 0.0625 R-Precision (prec. after R
Query 239: 0.1574 (=num_rel) docs. retrieved):
Query 241: 0.0103 Exact: 0.3647
Query 242: 0.3500
Query 243: 0.0769
Query 244: 0.0132 +0.5
Query 245: 1.0000
Query 246: 0.3333
Query 247: 1.0000
Query 248: 0.5913
Query 249: 0.1440
Query 250: 0.0314
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Amsterdam, Monolingual Portuguese, Auto, TD Run UAmsC04PoPo4GiWd
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 46 queries): 1.0
Query 201: 0.0085 Total number of documents
Query 202: 0.8027 over all queries
Query 203: 0.2394 Retrieved: 46000
Query 204: 0.8075 Relevant: 678
Query 205: 0.3167 Rel_ret: 595
0.8
Query 206: 0.6667
Query 207: 0.1986 Interpolated Recall -
Query 208: 1.0000 Precision Averages:
Query 209: 0.0278 at 0.00 0.5534
Query 210: 0.8833 at 0.10 0.5311 0.6
Query 211: 0.9333 at 0.20 0.5184
Query 212: 0.2149 at 0.30 0.5052
Query 213: 0.7459 at 0.40 0.4703
Precision
Query 214: 0.0227 at 0.50 0.4494
Query 215: 0.0556 at 0.60 0.3991 0.4
Query 217: 0.8766 at 0.70 0.3719
Query 218: 0.8250 at 0.80 0.3476
Query 219: 0.2292 at 0.90 0.3094
Query 221: 0.8819 at 1.00 0.2768
Query 222: 0.0029 0.2
Query 223: 1.0000 Avg. prec. (non-interpolated)
Query 224: 1.0000 for all rel. documents
Query 225: 0.1111 0.4180
Query 226: 0.5012 Precision:
Query 228: 0.4175 At 5 docs: 0.3565 0.0
Query 229: 0.5891 At 10 docs: 0.2957 0.0 0.2 0.4 0.6 0.8 1.0
Query 230: 0.4467 At 15 docs: 0.2507
Query 231: 0.0021 At 20 docs: 0.2130 Recall
Query 232: 0.0071 At 30 docs: 0.1768
Query 233: 0.5463 At 100 docs: 0.0817
Query 234: 0.0046 At 200 docs: 0.0522 Run UAmsC04PoPo4GiWd
Query 235: 0.0769 At 500 docs: 0.0248 Comparison to median by topic
Query 236: 0.5873 At 1000 docs: 0.0129
Query 237: 0.5873 +1.0
Query 238: 0.0312 R-Precision (prec. after R
Query 239: 0.1414 (=num_rel) docs. retrieved):
Query 241: 0.0205 Exact: 0.3713
Query 242: 0.2264
Query 243: 0.0833
Query 244: 0.0833 +0.5
Query 245: 1.0000
Query 246: 0.3333
Query 247: 1.0000
Query 248: 0.5400
Query 249: 0.1024
Query 250: 0.0506
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Amsterdam, Monolingual Portuguese, Auto, TD Run UAmsC04PoPoAll
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 46 queries): 1.0
Query 201: 0.0105 Total number of documents
Query 202: 0.8166 over all queries
Query 203: 0.2728 Retrieved: 46000
Query 204: 0.8857 Relevant: 678
Query 205: 0.3611 Rel_ret: 610
0.8
Query 206: 0.6667
Query 207: 0.2163 Interpolated Recall -
Query 208: 1.0000 Precision Averages:
Query 209: 0.0159 at 0.00 0.5827
Query 210: 0.8509 at 0.10 0.5638 0.6
Query 211: 0.9514 at 0.20 0.5345
Query 212: 0.2085 at 0.30 0.5008
Query 213: 0.7752 at 0.40 0.4827
Precision
Query 214: 0.0519 at 0.50 0.4659
Query 215: 0.1667 at 0.60 0.4039 0.4
Query 217: 0.6782 at 0.70 0.3737
Query 218: 0.8533 at 0.80 0.3564
Query 219: 0.1294 at 0.90 0.3249
Query 221: 0.8774 at 1.00 0.2892
Query 222: 0.0038 0.2
Query 223: 0.5000 Avg. prec. (non-interpolated)
Query 224: 1.0000 for all rel. documents
Query 225: 0.2000 0.4326
Query 226: 0.5250 Precision:
Query 228: 0.4795 At 5 docs: 0.4043 0.0
Query 229: 0.6324 At 10 docs: 0.3174 0.0 0.2 0.4 0.6 0.8 1.0
Query 230: 0.4509 At 15 docs: 0.2522
Query 231: 0.0092 At 20 docs: 0.2207 Recall
Query 232: 0.0207 At 30 docs: 0.1790
Query 233: 0.5643 At 100 docs: 0.0870
Query 234: 0.0218 At 200 docs: 0.0540 Run UAmsC04PoPoAll
Query 235: 0.0476 At 500 docs: 0.0254 Comparison to median by topic
Query 236: 0.6095 At 1000 docs: 0.0133
Query 237: 1.0000 +1.0
Query 238: 0.0312 R-Precision (prec. after R
Query 239: 0.1825 (=num_rel) docs. retrieved):
Query 241: 0.0228 Exact: 0.3706
Query 242: 0.4083
Query 243: 0.1111
Query 244: 0.0204 +0.5
Query 245: 1.0000
Query 246: 0.3333
Query 247: 1.0000
Query 248: 0.6178
Query 249: 0.2759
Query 250: 0.0446
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Université de Neuchâtel, Monolingual Portuguese, Auto, TD Run UniNEpt1
Average precision Overall statistics
(individual queries): (for 46 queries):
Recall−Precision Values
1.0
Query 201: 0.0466 Total number of documents
Query 202: 0.6865 over all queries
Query 203: 0.3278 Retrieved: 46000
Query 204: 0.8044 Relevant: 678
Query 205: 0.6429 Rel_ret: 611 0.8
Query 206: 0.8333
Query 207: 0.2633 Interpolated Recall -
Query 208: 1.0000 Precision Averages:
Query 209: 0.0175 at 0.00 0.6586
Query 210: 0.8262 at 0.10 0.6319 0.6
Query 211: 0.9325 at 0.20 0.5947
Query 212: 0.3272 at 0.30 0.5549
Query 213: 0.6872 at 0.40 0.5364
Precision
Query 214: 0.0066 at 0.50 0.5225
Query 215: 0.0714 at 0.60 0.4735 0.4
Query 217: 1.0000 at 0.70 0.4488
Query 218: 0.8405 at 0.80 0.4201
Query 219: 0.2436 at 0.90 0.3936
Query 221: 0.9762 at 1.00 0.3534
Query 222: 0.0409 0.2
Query 223: 1.0000 Avg. prec. (non-interpolated)
Query 224: 1.0000 for all rel. documents
Query 225: 0.2500 0.5004
Query 226: 0.9500 Precision:
Query 228: 0.5512 At 5 docs: 0.4522 0.0
Query 229: 0.7751 At 10 docs: 0.3457 0.0 0.2 0.4 0.6 0.8 1.0
Query 230: 0.4431 At 15 docs: 0.2855
Query 231: 0.0051 At 20 docs: 0.2446 Recall
Query 232: 0.1626 At 30 docs: 0.1928
Query 233: 0.8335 At 100 docs: 0.0909
Query 234: 0.2679 At 200 docs: 0.0542 Run UniNEpt1
Query 235: 0.0400 At 500 docs: 0.0256
Query 236: 0.8667 At 1000 docs: 0.0133 Comparison to median by topic
Query 237: 1.0000 +1.0
Query 238: 0.0556 R-Precision (prec. after R
Query 239: 0.1359 (=num_rel) docs. retrieved):
Query 241: 0.0122 Exact: 0.4243
Query 242: 0.4409
Query 243: 0.1429
Query 244: 0.0012 +0.5
Query 245: 1.0000
Query 246: 0.5000
Query 247: 1.0000
Query 248: 0.7213
Query 249: 0.2719
Query 250: 0.0157
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Université de Neuchâtel, Monolingual Portuguese, Auto, TD Run UniNEpt2
Average precision Overall statistics
(individual queries): (for 46 queries):
Recall−Precision Values
1.0
Query 201: 0.0233 Total number of documents
Query 202: 0.7243 over all queries
Query 203: 0.2808 Retrieved: 46000
Query 204: 0.9367 Relevant: 678
Query 205: 0.6667 Rel_ret: 617 0.8
Query 206: 0.8333
Query 207: 0.2787 Interpolated Recall -
Query 208: 1.0000 Precision Averages:
Query 209: 0.0081 at 0.00 0.6584
Query 210: 0.7862 at 0.10 0.6348 0.6
Query 211: 0.9358 at 0.20 0.6167
Query 212: 0.3576 at 0.30 0.5841
Query 213: 0.8002 at 0.40 0.5691
Precision
Query 214: 0.0081 at 0.50 0.5552
Query 215: 0.0588 at 0.60 0.4883 0.4
Query 217: 0.9683 at 0.70 0.4657
Query 218: 0.8420 at 0.80 0.4376
Query 219: 0.6111 at 0.90 0.3950
Query 221: 0.9583 at 1.00 0.3533
Query 222: 0.0581 0.2
Query 223: 1.0000 Avg. prec. (non-interpolated)
Query 224: 1.0000 for all rel. documents
Query 225: 0.0667 0.5105
Query 226: 0.5250 Precision:
Query 228: 0.5618 At 5 docs: 0.4565 0.0
Query 229: 0.8232 At 10 docs: 0.3522 0.0 0.2 0.4 0.6 0.8 1.0
Query 230: 0.4486 At 15 docs: 0.2841
Query 231: 0.0066 At 20 docs: 0.2478 Recall
Query 232: 0.1419 At 30 docs: 0.1964
Query 233: 0.8216 At 100 docs: 0.0928
Query 234: 0.5833 At 200 docs: 0.0555 Run UniNEpt2
Query 235: 0.1000 At 500 docs: 0.0255
Query 236: 0.8056 At 1000 docs: 0.0134 Comparison to median by topic
Query 237: 1.0000 +1.0
Query 238: 0.0455 R-Precision (prec. after R
Query 239: 0.1800 (=num_rel) docs. retrieved):
Query 241: 0.0176 Exact: 0.4565
Query 242: 0.6838
Query 243: 0.3333
Query 244: 0.0018 +0.5
Query 245: 1.0000
Query 246: 0.3333
Query 247: 1.0000
Query 248: 0.7126
Query 249: 0.1508
Query 250: 0.0058
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Université de Neuchâtel, Monolingual Portuguese, Auto, TD Run UniNEpt3
Average precision Overall statistics
(individual queries): (for 46 queries):
Recall−Precision Values
1.0
Query 201: 0.0269 Total number of documents
Query 202: 0.7639 over all queries
Query 203: 0.3180 Retrieved: 46000
Query 204: 0.8121 Relevant: 678
Query 205: 0.6000 Rel_ret: 611 0.8
Query 206: 0.8333
Query 207: 0.2845 Interpolated Recall -
Query 208: 1.0000 Precision Averages:
Query 209: 0.0136 at 0.00 0.6701
Query 210: 0.9667 at 0.10 0.6467 0.6
Query 211: 0.9427 at 0.20 0.6143
Query 212: 0.3275 at 0.30 0.5726
Query 213: 0.7518 at 0.40 0.5605
Precision
Query 214: 0.0120 at 0.50 0.5467
Query 215: 0.0476 at 0.60 0.4893 0.4
Query 217: 1.0000 at 0.70 0.4700
Query 218: 0.8679 at 0.80 0.4492
Query 219: 0.1625 at 0.90 0.4128
Query 221: 0.9444 at 1.00 0.3744
Query 222: 0.0629 0.2
Query 223: 1.0000 Avg. prec. (non-interpolated)
Query 224: 1.0000 for all rel. documents
Query 225: 0.2000 0.5188
Query 226: 0.8167 Precision:
Query 228: 0.5514 At 5 docs: 0.4478 0.0
Query 229: 0.7466 At 10 docs: 0.3522 0.0 0.2 0.4 0.6 0.8 1.0
Query 230: 0.4527 At 15 docs: 0.2826
Query 231: 0.0046 At 20 docs: 0.2391 Recall
Query 232: 0.1358 At 30 docs: 0.1949
Query 233: 0.7702 At 100 docs: 0.0907
Query 234: 1.0000 At 200 docs: 0.0540 Run UniNEpt3
Query 235: 0.0286 At 500 docs: 0.0250
Query 236: 0.7556 At 1000 docs: 0.0133 Comparison to median by topic
Query 237: 1.0000 +1.0
Query 238: 0.0667 R-Precision (prec. after R
Query 239: 0.0944 (=num_rel) docs. retrieved):
Query 241: 0.0090 Exact: 0.4669
Query 242: 0.3930
Query 243: 0.1111
Query 244: 0.0015 +0.5
Query 245: 1.0000
Query 246: 1.0000
Query 247: 1.0000
Query 248: 0.6926
Query 249: 0.2685
Query 250: 0.0283
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
FCUL Lisbon, Monolingual Portuguese, Manual, missing Run XLDBTumba01
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 46 queries): 1.0
Query 201: 0.0000 Total number of documents
Query 202: 0.1570 over all queries
Query 203: 0.0405 Retrieved: 209
Query 204: 0.1667 Relevant: 678
Query 205: 0.6111 Rel_ret: 79
0.8
Query 206: 0.0000
Query 207: 0.1817 Interpolated Recall -
Query 208: 0.6000 Precision Averages:
Query 209: 0.0000 at 0.00 0.4738
Query 210: 0.0286 at 0.10 0.3578 0.6
Query 211: 0.2500 at 0.20 0.3578
Query 212: 0.4714 at 0.30 0.2928
Query 213: 0.0464 at 0.40 0.2717
Precision
Query 214: 0.2205 at 0.50 0.2564
Query 215: 0.0000 at 0.60 0.1483 0.4
Query 217: 0.0000 at 0.70 0.1121
Query 218: 0.0476 at 0.80 0.1121
Query 219: 0.0000 at 0.90 0.1121
Query 221: 1.0000 at 1.00 0.1121
Query 222: 0.0000 0.2
Query 223: 0.0000 Avg. prec. (non-interpolated)
Query 224: 0.0000 for all rel. documents
Query 225: 1.0000 0.2184
Query 226: 0.2500 Precision:
Query 228: 0.0510 At 5 docs: 0.2696 0.0
Query 229: 0.0026 At 10 docs: 0.1587 0.0 0.2 0.4 0.6 0.8 1.0
Query 230: 0.0256 At 15 docs: 0.1145
Query 231: 0.0000 At 20 docs: 0.0859 Recall
Query 232: 0.0000 At 30 docs: 0.0572
Query 233: 0.0000 At 100 docs: 0.0172
Query 234: 0.5833 At 200 docs: 0.0086 Run XLDBTumba01
Query 235: 0.0000 At 500 docs: 0.0034 Comparison to median by topic
Query 236: 0.5333 At 1000 docs: 0.0017
Query 237: 1.0000 +1.0
Query 238: 0.0000 R-Precision (prec. after R
Query 239: 0.0000 (=num_rel) docs. retrieved):
Query 241: 0.0259 Exact: 0.2241
Query 242: 0.2250
Query 243: 0.0000
Query 244: 0.0000 +0.5
Query 245: 0.5556
Query 246: 0.0000
Query 247: 0.5000
Query 248: 0.1400
Query 249: 0.5000
Query 250: 0.8333
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
FCUL Lisbon, Monolingual Portuguese, Manual, missing Run XLDBTumba02
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 46 queries): 1.0
Query 201: 0.0000 Total number of documents
Query 202: 0.1667 over all queries
Query 203: 0.1592 Retrieved: 2350
Query 204: 0.2517 Relevant: 678
Query 205: 0.0714 Rel_ret: 168
0.8
Query 206: 0.0000
Query 207: 0.4167 Interpolated Recall -
Query 208: 1.0000 Precision Averages:
Query 209: 0.0000 at 0.00 0.5677
Query 210: 0.0286 at 0.10 0.5054 0.6
Query 211: 0.5364 at 0.20 0.4216
Query 212: 0.4689 at 0.30 0.3363
Query 213: 0.0000 at 0.40 0.2922
Precision
Query 214: 0.1547 at 0.50 0.2457
Query 215: 0.0000 at 0.60 0.2124 0.4
Query 217: 0.4275 at 0.70 0.1938
Query 218: 0.7416 at 0.80 0.1815
Query 219: 0.0000 at 0.90 0.1671
Query 221: 0.5812 at 1.00 0.1542
Query 222: 0.0000 0.2
Query 223: 1.0000 Avg. prec. (non-interpolated)
Query 224: 0.0000 for all rel. documents
Query 225: 1.0000 0.2810
Query 226: 0.3435 Precision:
Query 228: 0.0154 At 5 docs: 0.2783 0.0
Query 229: 0.0026 At 10 docs: 0.2022 0.0 0.2 0.4 0.6 0.8 1.0
Query 230: 0.4200 At 15 docs: 0.1609
Query 231: 0.0000 At 20 docs: 0.1359 Recall
Query 232: 0.0737 At 30 docs: 0.0978
Query 233: 0.2902 At 100 docs: 0.0354
Query 234: 0.2679 At 200 docs: 0.0183 Run XLDBTumba02
Query 235: 0.0000 At 500 docs: 0.0073 Comparison to median by topic
Query 236: 0.5333 At 1000 docs: 0.0037
Query 237: 1.0000 +1.0
Query 238: 0.0000 R-Precision (prec. after R
Query 239: 0.0123 (=num_rel) docs. retrieved):
Query 241: 0.0175 Exact: 0.2628
Query 242: 0.5469
Query 243: 0.0357
Query 244: 0.0000 +0.5
Query 245: 1.0000
Query 246: 0.3333
Query 247: 0.3750
Query 248: 0.2750
Query 249: 0.3344
Query 250: 0.0435
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
FCUL Lisbon, Monolingual Portuguese, Manual, missing Run XLDBTumba04
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 46 queries): 1.0
Query 201: 0.0000 Total number of documents
Query 202: 0.1556 over all queries
Query 203: 0.1430 Retrieved: 2350
Query 204: 0.2517 Relevant: 678
Query 205: 0.2500 Rel_ret: 168
0.8
Query 206: 0.0000
Query 207: 0.3375 Interpolated Recall -
Query 208: 1.0000 Precision Averages:
Query 209: 0.0000 at 0.00 0.5532
Query 210: 0.0286 at 0.10 0.4689 0.6
Query 211: 0.5036 at 0.20 0.3996
Query 212: 0.3282 at 0.30 0.3614
Query 213: 0.0000 at 0.40 0.3064
Precision
Query 214: 0.0488 at 0.50 0.2561
Query 215: 0.0000 at 0.60 0.2081 0.4
Query 217: 0.4110 at 0.70 0.1918
Query 218: 0.8040 at 0.80 0.1794
Query 219: 0.0000 at 0.90 0.1670
Query 221: 0.6416 at 1.00 0.1545
Query 222: 0.0000 0.2
Query 223: 0.2000 Avg. prec. (non-interpolated)
Query 224: 0.0000 for all rel. documents
Query 225: 1.0000 0.2775
Query 226: 0.4050 Precision:
Query 228: 0.0176 At 5 docs: 0.2957 0.0
Query 229: 0.0026 At 10 docs: 0.2087 0.0 0.2 0.4 0.6 0.8 1.0
Query 230: 0.4200 At 15 docs: 0.1638
Query 231: 0.0000 At 20 docs: 0.1326 Recall
Query 232: 0.0737 At 30 docs: 0.1007
Query 233: 0.2902 At 100 docs: 0.0359
Query 234: 0.2679 At 200 docs: 0.0183 Run XLDBTumba04
Query 235: 0.0000 At 500 docs: 0.0073 Comparison to median by topic
Query 236: 0.7000 At 1000 docs: 0.0037
Query 237: 1.0000 +1.0
Query 238: 0.0000 R-Precision (prec. after R
Query 239: 0.0123 (=num_rel) docs. retrieved):
Query 241: 0.0669 Exact: 0.2726
Query 242: 0.5469
Query 243: 0.0357
Query 244: 0.0000 +0.5
Query 245: 1.0000
Query 246: 1.0000
Query 247: 0.3750
Query 248: 0.2750
Query 249: 0.1271
Query 250: 0.0435
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
FCUL Lisbon, Monolingual Portuguese, Manual, missing Run XLDBTumba05
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 46 queries): 1.0
Query 201: 0.0000 Total number of documents
Query 202: 0.0648 over all queries
Query 203: 0.0962 Retrieved: 2350
Query 204: 0.1374 Relevant: 678
Query 205: 0.2500 Rel_ret: 168
0.8
Query 206: 0.0000
Query 207: 0.3375 Interpolated Recall -
Query 208: 1.0000 Precision Averages:
Query 209: 0.0000 at 0.00 0.4694
Query 210: 0.0222 at 0.10 0.4101 0.6
Query 211: 0.4391 at 0.20 0.3716
Query 212: 0.4571 at 0.30 0.3397
Query 213: 0.0000 at 0.40 0.2854
Precision
Query 214: 0.0576 at 0.50 0.2508
Query 215: 0.0000 at 0.60 0.1989 0.4
Query 217: 0.3608 at 0.70 0.1787
Query 218: 0.7852 at 0.80 0.1663
Query 219: 0.0000 at 0.90 0.1538
Query 221: 0.4957 at 1.00 0.1412
Query 222: 0.0000 0.2
Query 223: 0.1667 Avg. prec. (non-interpolated)
Query 224: 0.0000 for all rel. documents
Query 225: 1.0000 0.2513
Query 226: 0.1758 Precision:
Query 228: 0.0154 At 5 docs: 0.2565 0.0
Query 229: 0.0026 At 10 docs: 0.1870 0.0 0.2 0.4 0.6 0.8 1.0
Query 230: 0.1409 At 15 docs: 0.1406
Query 231: 0.0000 At 20 docs: 0.1185 Recall
Query 232: 0.0368 At 30 docs: 0.0899
Query 233: 0.1322 At 100 docs: 0.0352
Query 234: 0.4167 At 200 docs: 0.0183 Run XLDBTumba05
Query 235: 0.0000 At 500 docs: 0.0073 Comparison to median by topic
Query 236: 0.7000 At 1000 docs: 0.0037
Query 237: 1.0000 +1.0
Query 238: 0.0000 R-Precision (prec. after R
Query 239: 0.0123 (=num_rel) docs. retrieved):
Query 241: 0.0519 Exact: 0.2673
Query 242: 0.5469
Query 243: 0.0345
Query 244: 0.0000 +0.5
Query 245: 0.7222
Query 246: 1.0000
Query 247: 0.3750
Query 248: 0.2100
Query 249: 0.0570
Query 250: 0.2579
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
JHU/APL, Monolingual Russian, Auto, TD Run aplmorua
Average precision Overall statistics
(individual queries): (for 34 queries):
Recall−Precision Values
1.0
Query 201: 0.0097 Total number of documents
Query 202: 0.2619 over all queries
Query 203: 0.0040 Retrieved: 34000
Query 207: 0.0000 Relevant: 123
Query 209: 0.8333 Rel_ret: 98 0.8
Query 210: 0.4446
Query 211: 1.0000 Interpolated Recall -
Query 212: 0.2109 Precision Averages:
Query 213: 0.4278 at 0.00 0.4481
Query 214: 0.1151 at 0.10 0.4448 0.6
Query 215: 0.3333 at 0.20 0.4289
Query 216: 0.0357 at 0.30 0.3900
Query 218: 0.2500 at 0.40 0.3487
Precision
Query 220: 0.0272 at 0.50 0.3394
Query 221: 0.3167 at 0.60 0.2526 0.4
Query 224: 0.1000 at 0.70 0.2003
Query 225: 0.5436 at 0.80 0.1926
Query 226: 0.5000 at 0.90 0.1778
Query 227: 0.1250 at 1.00 0.1766
Query 228: 0.0052 0.2
Query 230: 0.3818 Avg. prec. (non-interpolated)
Query 231: 0.5000 for all rel. documents
Query 232: 0.0440 0.2974
Query 233: 0.0878 Precision:
Query 234: 0.0492 At 5 docs: 0.1882 0.0
Query 235: 0.0367 At 10 docs: 0.1353 0.0 0.2 0.4 0.6 0.8 1.0
Query 237: 0.4167 At 15 docs: 0.1059
Query 238: 1.0000 At 20 docs: 0.0838 Recall
Query 239: 0.6754 At 30 docs: 0.0647
Query 241: 0.1261 At 100 docs: 0.0235
Query 242: 0.0345 At 200 docs: 0.0129 Run aplmorua
Query 244: 1.0000 At 500 docs: 0.0055
Query 245: 0.1157 At 1000 docs: 0.0029 Comparison to median by topic
Query 250: 0.1000 +1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.2472
+0.5
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
JHU/APL, Monolingual Russian, Auto, TD Run aplmorub
Average precision Overall statistics
(individual queries): (for 34 queries):
Recall−Precision Values
1.0
Query 201: 0.0108 Total number of documents
Query 202: 0.0806 over all queries
Query 203: 0.0063 Retrieved: 34000
Query 207: 0.0000 Relevant: 123
Query 209: 1.0000 Rel_ret: 100 0.8
Query 210: 0.4410
Query 211: 1.0000 Interpolated Recall -
Query 212: 0.3934 Precision Averages:
Query 213: 0.3077 at 0.00 0.4554
Query 214: 0.1111 at 0.10 0.4517 0.6
Query 215: 1.0000 at 0.20 0.4237
Query 216: 0.0109 at 0.30 0.3835
Query 218: 0.2500 at 0.40 0.3457
Precision
Query 220: 0.0470 at 0.50 0.3342
Query 221: 0.3214 at 0.60 0.2751 0.4
Query 224: 0.1250 at 0.70 0.2256
Query 225: 0.4874 at 0.80 0.2148
Query 226: 0.5000 at 0.90 0.2082
Query 227: 0.0132 at 1.00 0.2059
Query 228: 0.0036 0.2
Query 230: 0.3277 Avg. prec. (non-interpolated)
Query 231: 1.0000 for all rel. documents
Query 232: 0.0533 0.3076
Query 233: 0.0969 Precision:
Query 234: 0.0019 At 5 docs: 0.1706 0.0
Query 235: 0.0244 At 10 docs: 0.1206 0.0 0.2 0.4 0.6 0.8 1.0
Query 237: 0.3750 At 15 docs: 0.0941
Query 238: 0.2000 At 20 docs: 0.0809 Recall
Query 239: 0.6466 At 30 docs: 0.0608
Query 241: 0.1568 At 100 docs: 0.0241
Query 242: 0.0400 At 200 docs: 0.0132 Run aplmorub
Query 244: 1.0000 At 500 docs: 0.0056
Query 245: 0.0939 At 1000 docs: 0.0029 Comparison to median by topic
Query 250: 0.3333 +1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.2683
+0.5
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
JHU/APL, Monolingual Russian, Auto, TD Run aplmoruc
Average precision Overall statistics
(individual queries): (for 34 queries):
Recall−Precision Values
1.0
Query 201: 0.0128 Total number of documents
Query 202: 0.0026 over all queries
Query 203: 0.0046 Retrieved: 34000
Query 207: 0.0000 Relevant: 123
Query 209: 1.0000 Rel_ret: 97 0.8
Query 210: 0.4635
Query 211: 1.0000 Interpolated Recall -
Query 212: 0.2988 Precision Averages:
Query 213: 0.2644 at 0.00 0.4031
Query 214: 0.1191 at 0.10 0.3998 0.6
Query 215: 1.0000 at 0.20 0.3753
Query 216: 0.0063 at 0.30 0.3211
Query 218: 0.2500 at 0.40 0.2896
Precision
Query 220: 0.0401 at 0.50 0.2842
Query 221: 0.3125 at 0.60 0.2196 0.4
Query 224: 0.1667 at 0.70 0.1839
Query 225: 0.4833 at 0.80 0.1726
Query 226: 0.0263 at 0.90 0.1671
Query 227: 0.0167 at 1.00 0.1665
Query 228: 0.0022 0.2
Query 230: 0.4022 Avg. prec. (non-interpolated)
Query 231: 0.5000 for all rel. documents
Query 232: 0.0287 0.2605
Query 233: 0.0648 Precision:
Query 234: 0.0016 At 5 docs: 0.1412 0.0
Query 235: 0.0131 At 10 docs: 0.1029 0.0 0.2 0.4 0.6 0.8 1.0
Query 237: 0.2812 At 15 docs: 0.0804
Query 238: 0.1250 At 20 docs: 0.0706 Recall
Query 239: 0.6917 At 30 docs: 0.0569
Query 241: 0.0936 At 100 docs: 0.0218
Query 242: 0.0417 At 200 docs: 0.0125 Run aplmoruc
Query 244: 1.0000 At 500 docs: 0.0054
Query 245: 0.1037 At 1000 docs: 0.0029 Comparison to median by topic
Query 250: 0.0400 +1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.2309
+0.5
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
UC Berkeley, Monolingual Russian, Auto, TD Run BKRUMLRR1
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 34 queries): 1.0
Query 201: 0.0260 Total number of documents
Query 202: 0.0232 over all queries
Query 203: 1.0000 Retrieved: 34000
Query 207: 0.0000 Relevant: 123 0.8
Query 209: 0.7500 Rel_ret: 105
Query 210: 0.4316
Query 211: 1.0000 Interpolated Recall -
Query 212: 0.8016 Precision Averages:
Query 213: 0.3570 at 0.00 0.5734
Query 214: 0.1144 at 0.10 0.5636 0.6
Query 215: 1.0000 at 0.20 0.5506
Query 216: 0.0455 at 0.30 0.4969
Query 218: 0.2500 at 0.40 0.4670
Precision
Query 220: 0.0032 at 0.50 0.4526
Query 221: 0.2917 at 0.60 0.3628 0.4
Query 224: 0.0874 at 0.70 0.2989
Query 225: 0.6389 at 0.80 0.2839
Query 226: 1.0000 at 0.90 0.2555
Query 227: 0.2500 at 1.00 0.2548
Query 228: 0.0029 0.2
Query 230: 0.3446 Avg. prec. (non-interpolated)
Query 231: 1.0000 for all rel. documents
Query 232: 0.0538 0.4024
Query 233: 0.2068 Precision:
Query 234: 0.0276 At 5 docs: 0.2000 0.0
Query 235: 0.0455 At 10 docs: 0.1353 0.0 0.2 0.4 0.6 0.8 1.0
Query 237: 0.3500 At 15 docs: 0.1137
Query 238: 1.0000 At 20 docs: 0.0912 Recall
Query 239: 0.5801 At 30 docs: 0.0647
Query 241: 0.1891 At 100 docs: 0.0235
Query 242: 0.0526 At 200 docs: 0.0129 Run BKRUMLRR1
Query 244: 1.0000 At 500 docs: 0.0059 Comparison to median by topic
Query 245: 0.6667 At 1000 docs: 0.0031
Query 250: 0.0909 +1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.4013
+0.5
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
UC Berkeley, Monolingual Russian, Auto, TDN Run BKRUMLRR2
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 34 queries): 1.0
Query 201: 0.0241 Total number of documents
Query 202: 0.0145 over all queries
Query 203: 0.0909 Retrieved: 34000
Query 207: 0.0000 Relevant: 123 0.8
Query 209: 1.0000 Rel_ret: 108
Query 210: 0.3685
Query 211: 1.0000 Interpolated Recall -
Query 212: 0.4122 Precision Averages:
Query 213: 0.3521 at 0.00 0.5856
Query 214: 0.1071 at 0.10 0.5688 0.6
Query 215: 1.0000 at 0.20 0.5394
Query 216: 0.5000 at 0.30 0.4871
Query 218: 0.2500 at 0.40 0.4465
Precision
Query 220: 0.0630 at 0.50 0.4459
Query 221: 0.8333 at 0.60 0.3619 0.4
Query 224: 0.0466 at 0.70 0.3175
Query 225: 0.5667 at 0.80 0.3061
Query 226: 1.0000 at 0.90 0.2573
Query 227: 0.2500 at 1.00 0.2555
Query 228: 0.0074 0.2
Query 230: 0.3081 Avg. prec. (non-interpolated)
Query 231: 1.0000 for all rel. documents
Query 232: 0.2611 0.4005
Query 233: 0.2637 Precision:
Query 234: 0.0513 At 5 docs: 0.2059 0.0
Query 235: 0.0789 At 10 docs: 0.1500 0.0 0.2 0.4 0.6 0.8 1.0
Query 237: 0.3056 At 15 docs: 0.1216
Query 238: 1.0000 At 20 docs: 0.1000 Recall
Query 239: 0.8213 At 30 docs: 0.0706
Query 241: 0.1888 At 100 docs: 0.0256
Query 242: 0.0625 At 200 docs: 0.0146 Run BKRUMLRR2
Query 244: 1.0000 At 500 docs: 0.0062 Comparison to median by topic
Query 245: 0.2778 At 1000 docs: 0.0032
Query 250: 0.1111 +1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.3794
+0.5
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
CLIPS, Monolingual Russian, Auto, TDN Run CLIPS04MNRU1
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 34 queries): 1.0
Query 201: 0.0329 Total number of documents
Query 202: 0.1320 over all queries
Query 203: 1.0000 Retrieved: 34000
Query 207: 0.0000 Relevant: 123
Query 209: 0.8333 Rel_ret: 103
0.8
Query 210: 0.3492
Query 211: 1.0000 Interpolated Recall -
Query 212: 0.4812 Precision Averages:
Query 213: 0.4316 at 0.00 0.5768
Query 214: 0.0053 at 0.10 0.5768 0.6
Query 215: 1.0000 at 0.20 0.5244
Query 216: 0.0033 at 0.30 0.4574
Query 218: 0.0625 at 0.40 0.4020
Precision
Query 220: 0.0363 at 0.50 0.3956
Query 221: 0.5526 at 0.60 0.3057 0.4
Query 224: 0.0008 at 0.70 0.2295
Query 225: 0.5694 at 0.80 0.2132
Query 226: 0.0714 at 0.90 0.2054
Query 227: 0.5000 at 1.00 0.2046
Query 228: 0.0152 0.2
Query 230: 0.4095 Avg. prec. (non-interpolated)
Query 231: 0.0256 for all rel. documents
Query 232: 0.1943 0.3550
Query 233: 0.2073 Precision:
Query 234: 0.3578 At 5 docs: 0.2000 0.0
Query 235: 0.4000 At 10 docs: 0.1382 0.0 0.2 0.4 0.6 0.8 1.0
Query 237: 0.3500 At 15 docs: 0.1000
Query 238: 1.0000 At 20 docs: 0.0853 Recall
Query 239: 0.3336 At 30 docs: 0.0588
Query 241: 0.1800 At 100 docs: 0.0250
Query 242: 0.0333 At 200 docs: 0.0143 Run CLIPS04MNRU1
Query 244: 1.0000 At 500 docs: 0.0058 Comparison to median by topic
Query 245: 0.0026 At 1000 docs: 0.0030
Query 250: 0.5000 +1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.3119
+0.5
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Dublin City University, Monolingual Russian, Auto, TD Run exerussmono04a
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 34 queries): 1.0
Query 201: 0.0226 Total number of documents
Query 202: 0.0708 over all queries
Query 203: 1.0000 Retrieved: 34000
Query 207: 0.0000 Relevant: 123 0.8
Query 209: 0.8333 Rel_ret: 101
Query 210: 0.4247
Query 211: 1.0000 Interpolated Recall -
Query 212: 0.5045 Precision Averages:
Query 213: 0.2776 at 0.00 0.5199
Query 214: 0.0238 at 0.10 0.5134 0.6
Query 215: 1.0000 at 0.20 0.5060
Query 216: 0.0227 at 0.30 0.4503
Query 218: 0.2500 at 0.40 0.3857
Precision
Query 220: 0.0086 at 0.50 0.3788
Query 221: 0.2675 at 0.60 0.2960 0.4
Query 224: 0.0594 at 0.70 0.2519
Query 225: 0.4515 at 0.80 0.2464
Query 226: 0.1667 at 0.90 0.2271
Query 227: 0.5000 at 1.00 0.2266
Query 228: 0.0050 0.2
Query 230: 0.3546 Avg. prec. (non-interpolated)
Query 231: 0.5000 for all rel. documents
Query 232: 0.0800 0.3495
Query 233: 0.2527 Precision:
Query 234: 0.0955 At 5 docs: 0.1765 0.0
Query 235: 0.0604 At 10 docs: 0.1324 0.0 0.2 0.4 0.6 0.8 1.0
Query 237: 0.2500 At 15 docs: 0.1020
Query 238: 1.0000 At 20 docs: 0.0853 Recall
Query 239: 0.3073 At 30 docs: 0.0647
Query 241: 0.1671 At 100 docs: 0.0247
Query 242: 0.0455 At 200 docs: 0.0138 Run exerussmono04a
Query 244: 1.0000 At 500 docs: 0.0058 Comparison to median by topic
Query 245: 0.3810 At 1000 docs: 0.0030
Query 250: 0.5000 +1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.3100
+0.5
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Dublin City University, Monolingual Russian, Auto, TD Run exerussmono04l
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 34 queries): 1.0
Query 201: 0.0222 Total number of documents
Query 202: 0.0307 over all queries
Query 203: 1.0000 Retrieved: 34000
Query 207: 0.0000 Relevant: 123
Query 209: 0.8333 Rel_ret: 101
0.8
Query 210: 0.3852
Query 211: 1.0000 Interpolated Recall -
Query 212: 0.7347 Precision Averages:
Query 213: 0.2875 at 0.00 0.5352
Query 214: 0.0123 at 0.10 0.5352 0.6
Query 215: 1.0000 at 0.20 0.5279
Query 216: 0.0096 at 0.30 0.4678
Query 218: 0.2500 at 0.40 0.4048
Precision
Query 220: 0.0102 at 0.50 0.3949
Query 221: 0.2685 at 0.60 0.3050 0.4
Query 224: 0.0596 at 0.70 0.2642
Query 225: 0.4505 at 0.80 0.2566
Query 226: 0.5000 at 0.90 0.2338
Query 227: 0.5000 at 1.00 0.2333
Query 228: 0.0056 0.2
Query 230: 0.3557 Avg. prec. (non-interpolated)
Query 231: 0.5000 for all rel. documents
Query 232: 0.0787 0.3628
Query 233: 0.2544 Precision:
Query 234: 0.0805 At 5 docs: 0.1765 0.0
Query 235: 0.0684 At 10 docs: 0.1353 0.0 0.2 0.4 0.6 0.8 1.0
Query 237: 0.2500 At 15 docs: 0.1039
Query 238: 1.0000 At 20 docs: 0.0838 Recall
Query 239: 0.2999 At 30 docs: 0.0627
Query 241: 0.1662 At 100 docs: 0.0250
Query 242: 0.0500 At 200 docs: 0.0137 Run exerussmono04l
Query 244: 1.0000 At 500 docs: 0.0058 Comparison to median by topic
Query 245: 0.3704 At 1000 docs: 0.0030
Query 250: 0.5000 +1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.3085
+0.5
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Dublin City University, Monolingual Russian, Auto, TD Run exerussmono04q
Average precision Overall statistics
(individual queries): (for 34 queries):
Recall−Precision Values
1.0
Query 201: 0.0237 Total number of documents
Query 202: 0.0321 over all queries
Query 203: 1.0000 Retrieved: 34000
Query 207: 0.0000 Relevant: 123
Query 209: 0.8333 Rel_ret: 101 0.8
Query 210: 0.4247
Query 211: 1.0000 Interpolated Recall -
Query 212: 0.7467 Precision Averages:
Query 213: 0.2782 at 0.00 0.5472
Query 214: 0.0303 at 0.10 0.5472 0.6
Query 215: 1.0000 at 0.20 0.5392
Query 216: 0.1667 at 0.30 0.4824
Query 218: 0.2500 at 0.40 0.4324
Precision
Query 220: 0.0091 at 0.50 0.4075
Query 221: 0.2616 at 0.60 0.3052 0.4
Query 224: 0.0524 at 0.70 0.2642
Query 225: 0.4514 at 0.80 0.2591
Query 226: 0.5000 at 0.90 0.2377
Query 227: 0.5000 at 1.00 0.2358
Query 228: 0.0055 0.2
Query 230: 0.3584 Avg. prec. (non-interpolated)
Query 231: 0.5000 for all rel. documents
Query 232: 0.0874 0.3717
Query 233: 0.2557 Precision:
Query 234: 0.1807 At 5 docs: 0.2000 0.0
Query 235: 0.0662 At 10 docs: 0.1382 0.0 0.2 0.4 0.6 0.8 1.0
Query 237: 0.2500 At 15 docs: 0.1059
Query 238: 1.0000 At 20 docs: 0.0868 Recall
Query 239: 0.4774 At 30 docs: 0.0637
Query 241: 0.1461 At 100 docs: 0.0247
Query 242: 0.0435 At 200 docs: 0.0140 Run exerussmono04q
Query 244: 1.0000 At 500 docs: 0.0058
Query 245: 0.2083 At 1000 docs: 0.0030 Comparison to median by topic
Query 250: 0.5000 +1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.3100
+0.5
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Dublin City University, Monolingual Russian, Auto, TD Run exerussmono04t1
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 34 queries): 1.0
Query 201: 0.0218 Total number of documents
Query 202: 0.0593 over all queries
Query 203: 1.0000 Retrieved: 34000
Query 207: 0.0000 Relevant: 123 0.8
Query 209: 0.8333 Rel_ret: 101
Query 210: 0.4247
Query 211: 1.0000 Interpolated Recall -
Query 212: 0.7315 Precision Averages:
Query 213: 0.2743 at 0.00 0.5694
Query 214: 0.0256 at 0.10 0.5682 0.6
Query 215: 1.0000 at 0.20 0.5682
Query 216: 0.0263 at 0.30 0.5027
Query 218: 0.2500 at 0.40 0.4121
Precision
Query 220: 0.0078 at 0.50 0.4018
Query 221: 0.2602 at 0.60 0.3048 0.4
Query 224: 0.0595 at 0.70 0.2689
Query 225: 0.4353 at 0.80 0.2631
Query 226: 0.2500 at 0.90 0.2419
Query 227: 0.5000 at 1.00 0.2409
Query 228: 0.0032 0.2
Query 230: 0.3886 Avg. prec. (non-interpolated)
Query 231: 1.0000 for all rel. documents
Query 232: 0.0910 0.3790
Query 233: 0.2529 Precision:
Query 234: 0.3947 At 5 docs: 0.2000 0.0
Query 235: 0.0621 At 10 docs: 0.1294 0.0 0.2 0.4 0.6 0.8 1.0
Query 237: 0.2500 At 15 docs: 0.1020
Query 238: 1.0000 At 20 docs: 0.0882 Recall
Query 239: 0.1990 At 30 docs: 0.0637
Query 241: 0.1682 At 100 docs: 0.0247
Query 242: 0.0476 At 200 docs: 0.0137 Run exerussmono04t1
Query 244: 1.0000 At 500 docs: 0.0059 Comparison to median by topic
Query 245: 0.3704 At 1000 docs: 0.0030
Query 250: 0.5000 +1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.3492
+0.5
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Hummingbird, Monolingual Russian, Auto, T Run humRU04t
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 34 queries): 1.0
Query 201: 0.0137 Total number of documents
Query 202: 0.2125 over all queries
Query 203: 1.0000 Retrieved: 20895
Query 207: 0.0000 Relevant: 123
Query 209: 0.7500 Rel_ret: 91
0.8
Query 210: 0.5923
Query 211: 1.0000 Interpolated Recall -
Query 212: 0.7483 Precision Averages:
Query 213: 0.1312 at 0.00 0.6457
Query 214: 0.0000 at 0.10 0.6425 0.6
Query 215: 1.0000 at 0.20 0.6425
Query 216: 0.5000 at 0.30 0.5922
Query 218: 0.2500 at 0.40 0.5259
Precision
Query 220: 0.0123 at 0.50 0.4813
Query 221: 0.2647 at 0.60 0.3464 0.4
Query 224: 0.1025 at 0.70 0.2677
Query 225: 0.4030 at 0.80 0.2514
Query 226: 1.0000 at 0.90 0.2510
Query 227: 0.5000 at 1.00 0.2502
Query 228: 0.0072 0.2
Query 230: 0.4205 Avg. prec. (non-interpolated)
Query 231: 1.0000 for all rel. documents
Query 232: 0.0696 0.4298
Query 233: 0.1928 Precision:
Query 234: 0.3333 At 5 docs: 0.2294 0.0
Query 235: 0.5000 At 10 docs: 0.1382 0.0 0.2 0.4 0.6 0.8 1.0
Query 237: 0.3500 At 15 docs: 0.1059
Query 238: 0.0000 At 20 docs: 0.0824 Recall
Query 239: 0.4737 At 30 docs: 0.0578
Query 241: 0.1175 At 100 docs: 0.0218
Query 242: 0.0000 At 200 docs: 0.0122 Run humRU04t
Query 244: 1.0000 At 500 docs: 0.0053 Comparison to median by topic
Query 245: 0.6667 At 1000 docs: 0.0027
Query 250: 1.0000 +1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.4134
+0.5
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Hummingbird, Monolingual Russian, Auto, TD Run humRU04td
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 34 queries): 1.0
Query 201: 0.0181 Total number of documents
Query 202: 0.9167 over all queries
Query 203: 1.0000 Retrieved: 34000
Query 207: 0.0000 Relevant: 123
Query 209: 0.8333 Rel_ret: 101
0.8
Query 210: 0.5814
Query 211: 1.0000 Interpolated Recall -
Query 212: 0.4768 Precision Averages:
Query 213: 0.3769 at 0.00 0.6159
Query 214: 0.0222 at 0.10 0.6159 0.6
Query 215: 1.0000 at 0.20 0.6065
Query 216: 0.5000 at 0.30 0.5652
Query 218: 0.2500 at 0.40 0.4886
Precision
Query 220: 0.0120 at 0.50 0.4680
Query 221: 0.5213 at 0.60 0.3196 0.4
Query 224: 0.1014 at 0.70 0.2689
Query 225: 0.4484 at 0.80 0.2517
Query 226: 0.5000 at 0.90 0.2356
Query 227: 0.5000 at 1.00 0.2349
Query 228: 0.0303 0.2
Query 230: 0.3441 Avg. prec. (non-interpolated)
Query 231: 1.0000 for all rel. documents
Query 232: 0.0474 0.4094
Query 233: 0.1793 Precision:
Query 234: 0.0358 At 5 docs: 0.2353 0.0
Query 235: 0.0476 At 10 docs: 0.1412 0.0 0.2 0.4 0.6 0.8 1.0
Query 237: 0.4167 At 15 docs: 0.1059
Query 238: 0.5000 At 20 docs: 0.0824 Recall
Query 239: 0.5079 At 30 docs: 0.0578
Query 241: 0.0939 At 100 docs: 0.0221
Query 242: 0.0156 At 200 docs: 0.0128 Run humRU04td
Query 244: 1.0000 At 500 docs: 0.0058 Comparison to median by topic
Query 245: 0.3939 At 1000 docs: 0.0030
Query 250: 0.2500 +1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.3435
+0.5
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Hummingbird, Monolingual Russian, Auto, TD Run humRU04tde
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 34 queries): 1.0
Query 201: 0.0161 Total number of documents
Query 202: 1.0000 over all queries
Query 203: 0.5000 Retrieved: 34000
Query 207: 0.0000 Relevant: 123
Query 209: 0.8333 Rel_ret: 101
0.8
Query 210: 0.6133
Query 211: 1.0000 Interpolated Recall -
Query 212: 0.8857 Precision Averages:
Query 213: 0.3893 at 0.00 0.6139
Query 214: 0.0222 at 0.10 0.6104 0.6
Query 215: 1.0000 at 0.20 0.6077
Query 216: 0.5000 at 0.30 0.5675
Query 218: 0.2500 at 0.40 0.5211
Precision
Query 220: 0.0186 at 0.50 0.5207
Query 221: 0.7500 at 0.60 0.3903 0.4
Query 224: 0.1262 at 0.70 0.3259
Query 225: 0.5806 at 0.80 0.3002
Query 226: 0.5000 at 0.90 0.2801
Query 227: 0.5000 at 1.00 0.2782
Query 228: 0.0526 0.2
Query 230: 0.3340 Avg. prec. (non-interpolated)
Query 231: 1.0000 for all rel. documents
Query 232: 0.0654 0.4431
Query 233: 0.2002 Precision:
Query 234: 0.0130 At 5 docs: 0.2529 0.0
Query 235: 0.0344 At 10 docs: 0.1529 0.0 0.2 0.4 0.6 0.8 1.0
Query 237: 0.4167 At 15 docs: 0.1176
Query 238: 1.0000 At 20 docs: 0.0941 Recall
Query 239: 0.6874 At 30 docs: 0.0637
Query 241: 0.1169 At 100 docs: 0.0235
Query 242: 0.0526 At 200 docs: 0.0138 Run humRU04tde
Query 244: 1.0000 At 500 docs: 0.0058 Comparison to median by topic
Query 245: 0.4074 At 1000 docs: 0.0030
Query 250: 0.2000 +1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.3908
+0.5
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Padua, Monolingual Russian, Auto, TD Run IMSMRUN
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 34 queries): 1.0
Query 201: 0.0079 Total number of documents
Query 202: 0.1222 over all queries
Query 203: 0.0000 Retrieved: 30862
Query 207: 0.0000 Relevant: 123 0.8
Query 209: 0.5833 Rel_ret: 82
Query 210: 0.1833
Query 211: 1.0000 Interpolated Recall -
Query 212: 0.0447 Precision Averages:
Query 213: 0.3101 at 0.00 0.4525
Query 214: 0.0025 at 0.10 0.4525 0.6
Query 215: 0.0068 at 0.20 0.4442
Query 216: 0.1667 at 0.30 0.3783
Query 218: 0.2500 at 0.40 0.3254
Precision
Query 220: 0.0298 at 0.50 0.3058
Query 221: 0.2770 at 0.60 0.2294 0.4
Query 224: 0.0250 at 0.70 0.1806
Query 225: 0.4193 at 0.80 0.1761
Query 226: 1.0000 at 0.90 0.1730
Query 227: 0.0333 at 1.00 0.1730
Query 228: 0.0074 0.2
Query 230: 0.2639 Avg. prec. (non-interpolated)
Query 231: 1.0000 for all rel. documents
Query 232: 0.0926 0.2840
Query 233: 0.2420 Precision:
Query 234: 0.0268 At 5 docs: 0.1647 0.0
Query 235: 0.0348 At 10 docs: 0.1029 0.0 0.2 0.4 0.6 0.8 1.0
Query 237: 0.5000 At 15 docs: 0.0784
Query 238: 0.1000 At 20 docs: 0.0706 Recall
Query 239: 0.3147 At 30 docs: 0.0471
Query 241: 0.0549 At 100 docs: 0.0179
Query 242: 0.0000 At 200 docs: 0.0103 Run IMSMRUN
Query 244: 1.0000 At 500 docs: 0.0046 Comparison to median by topic
Query 245: 0.5556 At 1000 docs: 0.0024
Query 250: 1.0000 +1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.2845
+0.5
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Padua, Monolingual Russian, Auto, TD Run IMSMRUUd65
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 34 queries): 1.0
Query 201: 0.0014 Total number of documents
Query 202: 0.0060 over all queries
Query 203: 0.0000 Retrieved: 32990
Query 207: 0.0000 Relevant: 123
Query 209: 0.8333 Rel_ret: 94
0.8
Query 210: 0.1494
Query 211: 1.0000 Interpolated Recall -
Query 212: 0.6327 Precision Averages:
Query 213: 0.3854 at 0.00 0.5635
Query 214: 0.0012 at 0.10 0.5390 0.6
Query 215: 0.0127 at 0.20 0.5298
Query 216: 0.5000 at 0.30 0.4712
Query 218: 0.2500 at 0.40 0.4338
Precision
Query 220: 0.0092 at 0.50 0.3950
Query 221: 0.5159 at 0.60 0.2569 0.4
Query 224: 0.1000 at 0.70 0.2051
Query 225: 0.4109 at 0.80 0.1972
Query 226: 0.3333 at 0.90 0.1669
Query 227: 0.5000 at 1.00 0.1668
Query 228: 0.0118 0.2
Query 230: 0.3292 Avg. prec. (non-interpolated)
Query 231: 1.0000 for all rel. documents
Query 232: 0.0837 0.3406
Query 233: 0.4099 Precision:
Query 234: 0.0219 At 5 docs: 0.1882 0.0
Query 235: 0.0308 At 10 docs: 0.1294 0.0 0.2 0.4 0.6 0.8 1.0
Query 237: 0.3750 At 15 docs: 0.0941
Query 238: 0.5000 At 20 docs: 0.0750 Recall
Query 239: 0.3690 At 30 docs: 0.0510
Query 241: 0.1238 At 100 docs: 0.0191
Query 242: 0.0175 At 200 docs: 0.0109 Run IMSMRUUd65
Query 244: 1.0000 At 500 docs: 0.0051 Comparison to median by topic
Query 245: 0.6667 At 1000 docs: 0.0028
Query 250: 1.0000 +1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.3056
+0.5
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Padua, Monolingual Russian, Auto, TD Run IMSMRUUd65qe
Average precision Overall statistics
(individual queries): (for 34 queries): Recall−Precision Values
1.0
Query 201: 0.0000 Total number of documents
Query 202: 0.0000 over all queries
Query 203: 0.5000 Retrieved: 34000
Query 207: 0.0000 Relevant: 123
Query 209: 0.6000 Rel_ret: 80 0.8
Query 210: 0.0716
Query 211: 0.3929 Interpolated Recall -
Query 212: 0.5351 Precision Averages:
Query 213: 0.1052 at 0.00 0.4799
Query 214: 0.0000 at 0.10 0.4510 0.6
Query 215: 0.0127 at 0.20 0.4167
Query 216: 0.5000 at 0.30 0.3362
Query 218: 0.0088 at 0.40 0.3040
Precision
Query 220: 0.0013 at 0.50 0.2758
Query 221: 0.5833 at 0.60 0.1820 0.4
Query 224: 0.0102 at 0.70 0.1402
Query 225: 0.8056 at 0.80 0.1388
Query 226: 0.0000 at 0.90 0.1373
Query 227: 0.5000 at 1.00 0.1373
Query 228: 0.0000 0.2
Query 230: 0.4055 Avg. prec. (non-interpolated)
Query 231: 1.0000 for all rel. documents
Query 232: 0.1546 0.2557
Query 233: 0.2021 Precision:
Query 234: 0.1677 At 5 docs: 0.1706 0.0
Query 235: 0.0051 At 10 docs: 0.0971 0.0 0.2 0.4 0.6 0.8 1.0
Query 237: 0.2543 At 15 docs: 0.0686
Query 238: 0.0110 At 20 docs: 0.0515 Recall
Query 239: 0.1058 At 30 docs: 0.0373
Query 241: 0.0598 At 100 docs: 0.0138
Query 242: 0.0167 At 200 docs: 0.0084 Run IMSMRUUd65qe
Query 244: 1.0000 At 500 docs: 0.0041
Query 245: 0.6667 At 1000 docs: 0.0024 Comparison to median by topic
Query 250: 0.0185 +1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.2376
+0.5
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Alicante, Monolingual Russian, Auto, TD Run IRn−MR−Dexp
Average precision Overall statistics
(individual queries): (for 34 queries):
Recall−Precision Values
1.0
Query 201: 0.0260 Total number of documents
Query 202: 0.0075 over all queries
Query 203: 1.0000 Retrieved: 34000
Query 207: 0.0000 Relevant: 123
Query 209: 0.8333 Rel_ret: 119 0.8
Query 210: 0.8542
Query 211: 0.8333 Interpolated Recall -
Query 212: 0.7787 Precision Averages:
Query 213: 0.3513 at 0.00 0.6324
Query 214: 0.0069 at 0.10 0.6324 0.6
Query 215: 1.0000 at 0.20 0.6322
Query 216: 0.7000 at 0.30 0.5765
Query 218: 0.5833 at 0.40 0.5302
Precision
Query 220: 0.0126 at 0.50 0.5269
Query 221: 0.7500 at 0.60 0.4408 0.4
Query 224: 0.1548 at 0.70 0.3977
Query 225: 0.5812 at 0.80 0.3817
Query 226: 0.5000 at 0.90 0.3715
Query 227: 0.3167 at 1.00 0.3662
Query 228: 0.0038 0.2
Query 230: 0.5417 Avg. prec. (non-interpolated)
Query 231: 1.0000 for all rel. documents
Query 232: 0.1067 0.4796
Query 233: 0.2461 Precision:
Query 234: 0.3472 At 5 docs: 0.2647 0.0
Query 235: 0.3221 At 10 docs: 0.1676 0.0 0.2 0.4 0.6 0.8 1.0
Query 237: 0.9500 At 15 docs: 0.1333
Query 238: 0.5000 At 20 docs: 0.1044 Recall
Query 239: 0.4451 At 30 docs: 0.0765
Query 241: 0.1715 At 100 docs: 0.0285
Query 242: 0.0455 At 200 docs: 0.0157 Run IRn−MR−Dexp
Query 244: 1.0000 At 500 docs: 0.0068
Query 245: 0.3373 At 1000 docs: 0.0035 Comparison to median by topic
Query 250: 1.0000 +1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.3859
+0.5
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Alicante, Monolingual Russian, Auto, TD Run IRn−MR−nexp
Average precision Overall statistics
(individual queries): (for 34 queries):
Recall−Precision Values
1.0
Query 201: 0.0230 Total number of documents
Query 202: 0.0051 over all queries
Query 203: 1.0000 Retrieved: 34000
Query 207: 0.0000 Relevant: 123
Query 209: 1.0000 Rel_ret: 115 0.8
Query 210: 0.5595
Query 211: 1.0000 Interpolated Recall -
Query 212: 0.3786 Precision Averages:
Query 213: 0.3037 at 0.00 0.6297
Query 214: 0.0072 at 0.10 0.6268 0.6
Query 215: 1.0000 at 0.20 0.6057
Query 216: 0.6250 at 0.30 0.5943
Query 218: 0.5833 at 0.40 0.5472
Precision
Query 220: 0.0109 at 0.50 0.5232
Query 221: 0.6000 at 0.60 0.4427 0.4
Query 224: 0.1944 at 0.70 0.3877
Query 225: 0.5010 at 0.80 0.3807
Query 226: 1.0000 at 0.90 0.3656
Query 227: 0.5833 at 1.00 0.3611
Query 228: 0.0040 0.2
Query 230: 0.4725 Avg. prec. (non-interpolated)
Query 231: 1.0000 for all rel. documents
Query 232: 0.0573 0.4809
Query 233: 0.2120 Precision:
Query 234: 0.3482 At 5 docs: 0.2353 0.0
Query 235: 0.1734 At 10 docs: 0.1676 0.0 0.2 0.4 0.6 0.8 1.0
Query 237: 1.0000 At 15 docs: 0.1216
Query 238: 0.2500 At 20 docs: 0.0971 Recall
Query 239: 0.4866 At 30 docs: 0.0706
Query 241: 0.1481 At 100 docs: 0.0276
Query 242: 0.0323 At 200 docs: 0.0150 Run IRn−MR−nexp
Query 244: 1.0000 At 500 docs: 0.0065
Query 245: 0.7917 At 1000 docs: 0.0034 Comparison to median by topic
Query 250: 1.0000 +1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.4502
+0.5
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Alicante, Monolingual Russian, Auto, TD Run IRn−MR−Pexp
Average precision Overall statistics
(individual queries): (for 34 queries):
Recall−Precision Values
1.0
Query 201: 0.0260 Total number of documents
Query 202: 0.0074 over all queries
Query 203: 1.0000 Retrieved: 34000
Query 207: 0.0000 Relevant: 123
Query 209: 0.8333 Rel_ret: 120 0.8
Query 210: 0.8542
Query 211: 0.8333 Interpolated Recall -
Query 212: 0.7787 Precision Averages:
Query 213: 0.3513 at 0.00 0.6339
Query 214: 0.0075 at 0.10 0.6339 0.6
Query 215: 1.0000 at 0.20 0.6337
Query 216: 0.7000 at 0.30 0.5781
Query 218: 0.5833 at 0.40 0.5320
Precision
Query 220: 0.0126 at 0.50 0.5286
Query 221: 0.7500 at 0.60 0.4276 0.4
Query 224: 0.1944 at 0.70 0.3844
Query 225: 0.5812 at 0.80 0.3684
Query 226: 0.5000 at 0.90 0.3582
Query 227: 0.5625 at 1.00 0.3529
Query 228: 0.0039 0.2
Query 230: 0.5417 Avg. prec. (non-interpolated)
Query 231: 1.0000 for all rel. documents
Query 232: 0.1067 0.4733
Query 233: 0.2461 Precision:
Query 234: 0.3472 At 5 docs: 0.2647 0.0
Query 235: 0.3221 At 10 docs: 0.1706 0.0 0.2 0.4 0.6 0.8 1.0
Query 237: 0.9500 At 15 docs: 0.1314
Query 238: 0.5000 At 20 docs: 0.1044 Recall
Query 239: 0.4451 At 30 docs: 0.0765
Query 241: 0.1715 At 100 docs: 0.0285
Query 242: 0.0455 At 200 docs: 0.0159 Run IRn−MR−Pexp
Query 244: 1.0000 At 500 docs: 0.0068
Query 245: 0.3373 At 1000 docs: 0.0035 Comparison to median by topic
Query 250: 0.5000 +1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.3565
+0.5
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Daedalus, Monolingual Russian, Auto, TD Run ruav7
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 34 queries): 1.0
Query 201: 0.0203 Total number of documents
Query 202: 0.0023 over all queries
Query 203: 1.0000 Retrieved: 34000
Query 207: 0.0000 Relevant: 123 0.8
Query 209: 0.8333 Rel_ret: 100
Query 210: 0.6042
Query 211: 1.0000 Interpolated Recall -
Query 212: 0.6678 Precision Averages:
Query 213: 0.3501 at 0.00 0.5638
Query 214: 0.0924 at 0.10 0.5638 0.6
Query 215: 0.5000 at 0.20 0.5638
Query 216: 0.0556 at 0.30 0.5211
Query 218: 0.2500 at 0.40 0.4193
Precision
Query 220: 0.0064 at 0.50 0.3951
Query 221: 0.5145 at 0.60 0.2973 0.4
Query 224: 0.1016 at 0.70 0.2453
Query 225: 0.4747 at 0.80 0.2293
Query 226: 0.0062 at 0.90 0.2126
Query 227: 0.1667 at 1.00 0.2100
Query 228: 0.0050 0.2
Query 230: 0.4194 Avg. prec. (non-interpolated)
Query 231: 1.0000 for all rel. documents
Query 232: 0.0640 0.3695
Query 233: 0.1800 Precision:
Query 234: 0.3745 At 5 docs: 0.2235 0.0
Query 235: 0.0843 At 10 docs: 0.1412 0.0 0.2 0.4 0.6 0.8 1.0
Query 237: 0.4167 At 15 docs: 0.1078
Query 238: 1.0000 At 20 docs: 0.0838 Recall
Query 239: 0.5387 At 30 docs: 0.0618
Query 241: 0.1602 At 100 docs: 0.0238
Query 242: 0.0357 At 200 docs: 0.0131 Run ruav7
Query 244: 1.0000 At 500 docs: 0.0056 Comparison to median by topic
Query 245: 0.3889 At 1000 docs: 0.0029
Query 250: 0.2500 +1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.3350
+0.5
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Daedalus, Monolingual Russian, Auto, TD Run ruav8
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 34 queries): 1.0
Query 201: 0.0200 Total number of documents
Query 202: 0.0021 over all queries
Query 203: 0.5000 Retrieved: 34000
Query 207: 0.0000 Relevant: 123 0.8
Query 209: 1.0000 Rel_ret: 99
Query 210: 0.5787
Query 211: 1.0000 Interpolated Recall -
Query 212: 0.5854 Precision Averages:
Query 213: 0.3790 at 0.00 0.5574
Query 214: 0.0910 at 0.10 0.5571 0.6
Query 215: 0.5000 at 0.20 0.5452
Query 216: 0.0833 at 0.30 0.5040
Query 218: 0.2500 at 0.40 0.4117
Precision
Query 220: 0.0086 at 0.50 0.3919
Query 221: 0.5175 at 0.60 0.2958 0.4
Query 224: 0.0848 at 0.70 0.2450
Query 225: 0.4751 at 0.80 0.2270
Query 226: 0.0127 at 0.90 0.2079
Query 227: 0.2500 at 1.00 0.2050
Query 228: 0.0061 0.2
Query 230: 0.3924 Avg. prec. (non-interpolated)
Query 231: 1.0000 for all rel. documents
Query 232: 0.0679 0.3641
Query 233: 0.2345 Precision:
Query 234: 0.3847 At 5 docs: 0.2235 0.0
Query 235: 0.0864 At 10 docs: 0.1412 0.0 0.2 0.4 0.6 0.8 1.0
Query 237: 0.4167 At 15 docs: 0.1059
Query 238: 1.0000 At 20 docs: 0.0824 Recall
Query 239: 0.5513 At 30 docs: 0.0608
Query 241: 0.1320 At 100 docs: 0.0226
Query 242: 0.0270 At 200 docs: 0.0138 Run ruav8
Query 244: 1.0000 At 500 docs: 0.0056 Comparison to median by topic
Query 245: 0.4074 At 1000 docs: 0.0029
Query 250: 0.3333 +1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.3345
+0.5
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Daedalus, Monolingual Russian, Auto, TD Run rucomb1s101
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 34 queries): 1.0
Query 201: 0.0273 Total number of documents
Query 202: 0.0021 over all queries
Query 203: 1.0000 Retrieved: 34000
Query 207: 0.0000 Relevant: 123
Query 209: 0.7500 Rel_ret: 99
0.8
Query 210: 0.6917
Query 211: 1.0000 Interpolated Recall -
Query 212: 0.6380 Precision Averages:
Query 213: 0.3764 at 0.00 0.5693
Query 214: 0.1674 at 0.10 0.5693 0.6
Query 215: 0.3333 at 0.20 0.5638
Query 216: 0.0833 at 0.30 0.5256
Query 218: 0.2500 at 0.40 0.4146
Precision
Query 220: 0.0072 at 0.50 0.3771
Query 221: 0.5135 at 0.60 0.2871 0.4
Query 224: 0.0884 at 0.70 0.2374
Query 225: 0.4716 at 0.80 0.2248
Query 226: 0.0053 at 0.90 0.2121
Query 227: 0.1250 at 1.00 0.2094
Query 228: 0.0064 0.2
Query 230: 0.4347 Avg. prec. (non-interpolated)
Query 231: 1.0000 for all rel. documents
Query 232: 0.0458 0.3648
Query 233: 0.1762 Precision:
Query 234: 0.3528 At 5 docs: 0.2353 0.0
Query 235: 0.1474 At 10 docs: 0.1441 0.0 0.2 0.4 0.6 0.8 1.0
Query 237: 0.3750 At 15 docs: 0.1137
Query 238: 1.0000 At 20 docs: 0.0868 Recall
Query 239: 0.4817 At 30 docs: 0.0598
Query 241: 0.1611 At 100 docs: 0.0229
Query 242: 0.0250 At 200 docs: 0.0131 Run rucomb1s101
Query 244: 1.0000 At 500 docs: 0.0056 Comparison to median by topic
Query 245: 0.4167 At 1000 docs: 0.0029
Query 250: 0.2500 +1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.3415
+0.5
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Daedalus, Monolingual Russian, Auto, TD Run ruR1FWnormal
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 34 queries): 1.0
Query 201: 0.0188 Total number of documents
Query 202: 0.0026 over all queries
Query 203: 1.0000 Retrieved: 34000
Query 207: 0.0000 Relevant: 123
Query 209: 0.8333 Rel_ret: 98
0.8
Query 210: 0.6442
Query 211: 1.0000 Interpolated Recall -
Query 212: 0.7089 Precision Averages:
Query 213: 0.3678 at 0.00 0.5553
Query 214: 0.0012 at 0.10 0.5488 0.6
Query 215: 0.3333 at 0.20 0.5488
Query 216: 0.0185 at 0.30 0.5086
Query 218: 0.2500 at 0.40 0.4256
Precision
Query 220: 0.0037 at 0.50 0.3912
Query 221: 0.5152 at 0.60 0.3014 0.4
Query 224: 0.0735 at 0.70 0.2586
Query 225: 0.4499 at 0.80 0.2344
Query 226: 0.0057 at 0.90 0.2113
Query 227: 0.2500 at 1.00 0.2092
Query 228: 0.0054 0.2
Query 230: 0.4086 Avg. prec. (non-interpolated)
Query 231: 1.0000 for all rel. documents
Query 232: 0.0652 0.3672
Query 233: 0.2012 Precision:
Query 234: 0.5909 At 5 docs: 0.2118 0.0
Query 235: 0.0399 At 10 docs: 0.1353 0.0 0.2 0.4 0.6 0.8 1.0
Query 237: 0.3750 At 15 docs: 0.1039
Query 238: 1.0000 At 20 docs: 0.0838 Recall
Query 239: 0.4739 At 30 docs: 0.0618
Query 241: 0.1607 At 100 docs: 0.0226
Query 242: 0.0217 At 200 docs: 0.0128 Run ruR1FWnormal
Query 244: 1.0000 At 500 docs: 0.0056 Comparison to median by topic
Query 245: 0.4167 At 1000 docs: 0.0029
Query 250: 0.2500 +1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.3526
+0.5
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Thomson Legal, Monolingual Russian, Auto, TD Run tlrru1
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 34 queries): 1.0
Query 201: 0.0164 Total number of documents
Query 202: 0.6681 over all queries
Query 203: 0.0079 Retrieved: 33814
Query 207: 0.0000 Relevant: 123
Query 209: 0.8333 Rel_ret: 102
0.8
Query 210: 0.6223
Query 211: 1.0000 Interpolated Recall -
Query 212: 0.5310 Precision Averages:
Query 213: 0.3802 at 0.00 0.5912
Query 214: 0.3356 at 0.10 0.5912 0.6
Query 215: 0.5000 at 0.20 0.5814
Query 216: 0.5000 at 0.30 0.5433
Query 218: 0.2500 at 0.40 0.4688
Precision
Query 220: 0.0057 at 0.50 0.4488
Query 221: 0.5333 at 0.60 0.2926 0.4
Query 224: 0.1278 at 0.70 0.2148
Query 225: 0.4348 at 0.80 0.1840
Query 226: 0.5000 at 0.90 0.1607
Query 227: 0.5000 at 1.00 0.1584
Query 228: 0.0071 0.2
Query 230: 0.3619 Avg. prec. (non-interpolated)
Query 231: 0.1111 for all rel. documents
Query 232: 0.0487 0.3702
Query 233: 0.1514 Precision:
Query 234: 0.0378 At 5 docs: 0.2118 0.0
Query 235: 0.0890 At 10 docs: 0.1382 0.0 0.2 0.4 0.6 0.8 1.0
Query 237: 0.3750 At 15 docs: 0.1020
Query 238: 1.0000 At 20 docs: 0.0809 Recall
Query 239: 0.6254 At 30 docs: 0.0588
Query 241: 0.1039 At 100 docs: 0.0232
Query 242: 0.0120 At 200 docs: 0.0132 Run tlrru1
Query 244: 1.0000 At 500 docs: 0.0059 Comparison to median by topic
Query 245: 0.6667 At 1000 docs: 0.0030
Query 250: 0.2500 +1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.3183
+0.5
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Thomson Legal, Monolingual Russian, Auto, TD Run tlrru2
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 34 queries): 1.0
Query 201: 0.0132 Total number of documents
Query 202: 0.4444 over all queries
Query 203: 0.0078 Retrieved: 34000
Query 207: 0.0000 Relevant: 123
Query 209: 1.0000 Rel_ret: 98
0.8
Query 210: 0.4873
Query 211: 1.0000 Interpolated Recall -
Query 212: 0.2575 Precision Averages:
Query 213: 0.2861 at 0.00 0.5146
Query 214: 0.0093 at 0.10 0.5146 0.6
Query 215: 1.0000 at 0.20 0.4872
Query 216: 0.5000 at 0.30 0.4324
Query 218: 0.2500 at 0.40 0.3773
Precision
Query 220: 0.0083 at 0.50 0.3665
Query 221: 0.5227 at 0.60 0.2529 0.4
Query 224: 0.1250 at 0.70 0.1927
Query 225: 0.4337 at 0.80 0.1749
Query 226: 0.3333 at 0.90 0.1560
Query 227: 0.1250 at 1.00 0.1546
Query 228: 0.0071 0.2
Query 230: 0.3193 Avg. prec. (non-interpolated)
Query 231: 0.1250 for all rel. documents
Query 232: 0.0405 0.3176
Query 233: 0.1095 Precision:
Query 234: 0.0026 At 5 docs: 0.1882 0.0
Query 235: 0.0093 At 10 docs: 0.1294 0.0 0.2 0.4 0.6 0.8 1.0
Query 237: 0.3750 At 15 docs: 0.0902
Query 238: 0.5000 At 20 docs: 0.0721 Recall
Query 239: 0.6600 At 30 docs: 0.0500
Query 241: 0.0899 At 100 docs: 0.0200
Query 242: 0.0048 At 200 docs: 0.0121 Run tlrru2
Query 244: 1.0000 At 500 docs: 0.0056 Comparison to median by topic
Query 245: 0.6667 At 1000 docs: 0.0029
Query 250: 0.0833 +1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.2783
+0.5
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Amsterdam, Monolingual Russian, Auto, TD Run UAmsC04RuRu4GiSb
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 34 queries): 1.0
Query 201: 0.0195 Total number of documents
Query 202: 0.0263 over all queries
Query 203: 0.0833 Retrieved: 34000
Query 207: 0.0000 Relevant: 123
Query 209: 0.8333 Rel_ret: 103
0.8
Query 210: 0.3371
Query 211: 1.0000 Interpolated Recall -
Query 212: 0.7327 Precision Averages:
Query 213: 0.3147 at 0.00 0.5983
Query 214: 0.9167 at 0.10 0.5975 0.6
Query 215: 1.0000 at 0.20 0.5970
Query 216: 0.0417 at 0.30 0.5384
Query 218: 0.2500 at 0.40 0.4840
Precision
Query 220: 0.0570 at 0.50 0.4787
Query 221: 0.5345 at 0.60 0.3659 0.4
Query 224: 0.0417 at 0.70 0.2977
Query 225: 0.7381 at 0.80 0.2873
Query 226: 1.0000 at 0.90 0.2715
Query 227: 0.5000 at 1.00 0.2693
Query 228: 0.0022 0.2
Query 230: 0.3432 Avg. prec. (non-interpolated)
Query 231: 1.0000 for all rel. documents
Query 232: 0.1101 0.4227
Query 233: 0.3000 Precision:
Query 234: 0.4316 At 5 docs: 0.2176 0.0
Query 235: 0.0740 At 10 docs: 0.1353 0.0 0.2 0.4 0.6 0.8 1.0
Query 237: 0.4167 At 15 docs: 0.1157
Query 238: 1.0000 At 20 docs: 0.0956 Recall
Query 239: 0.6667 At 30 docs: 0.0696
Query 241: 0.1554 At 100 docs: 0.0262
Query 242: 0.0833 At 200 docs: 0.0140 Run UAmsC04RuRu4GiSb
Query 244: 1.0000 At 500 docs: 0.0060 Comparison to median by topic
Query 245: 0.0275 At 1000 docs: 0.0030
Query 250: 0.3333 +1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.3776
+0.5
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Amsterdam, Monolingual Russian, Auto, TD Run UAmsC04RuRu4GiWd
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 34 queries): 1.0
Query 201: 0.0099 Total number of documents
Query 202: 0.4491 over all queries
Query 203: 0.2500 Retrieved: 34000
Query 207: 0.0000 Relevant: 123
Query 209: 0.5833 Rel_ret: 103
0.8
Query 210: 0.2344
Query 211: 1.0000 Interpolated Recall -
Query 212: 0.6422 Precision Averages:
Query 213: 0.3227 at 0.00 0.6260
Query 214: 0.4167 at 0.10 0.6057 0.6
Query 215: 0.5000 at 0.20 0.5959
Query 216: 0.1000 at 0.30 0.5442
Query 218: 0.2500 at 0.40 0.4832
Precision
Query 220: 0.0771 at 0.50 0.4560
Query 221: 0.5357 at 0.60 0.3320 0.4
Query 224: 0.1250 at 0.70 0.2762
Query 225: 0.6465 at 0.80 0.2645
Query 226: 1.0000 at 0.90 0.2477
Query 227: 0.5000 at 1.00 0.2454
Query 228: 0.0028 0.2
Query 230: 0.2409 Avg. prec. (non-interpolated)
Query 231: 1.0000 for all rel. documents
Query 232: 0.0981 0.4058
Query 233: 0.3129 Precision:
Query 234: 0.5598 At 5 docs: 0.2471 0.0
Query 235: 0.0809 At 10 docs: 0.1441 0.0 0.2 0.4 0.6 0.8 1.0
Query 237: 0.5012 At 15 docs: 0.1157
Query 238: 1.0000 At 20 docs: 0.0941 Recall
Query 239: 0.5572 At 30 docs: 0.0696
Query 241: 0.2177 At 100 docs: 0.0265
Query 242: 0.0400 At 200 docs: 0.0135 Run UAmsC04RuRu4GiWd
Query 244: 0.5000 At 500 docs: 0.0059 Comparison to median by topic
Query 245: 0.0417 At 1000 docs: 0.0030
Query 250: 1.0000 +1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.3644
+0.5
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Amsterdam, Monolingual Russian, Auto, TD Run UAmsC04RuRuAll
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 34 queries): 1.0
Query 201: 0.0177 Total number of documents
Query 202: 0.0895 over all queries
Query 203: 0.2500 Retrieved: 34000
Query 207: 0.0000 Relevant: 123
Query 209: 0.7500 Rel_ret: 103
0.8
Query 210: 0.3572
Query 211: 1.0000 Interpolated Recall -
Query 212: 0.6605 Precision Averages:
Query 213: 0.2985 at 0.00 0.6314
Query 214: 0.8333 at 0.10 0.6314 0.6
Query 215: 1.0000 at 0.20 0.6164
Query 216: 0.0556 at 0.30 0.5549
Query 218: 0.2500 at 0.40 0.5137
Precision
Query 220: 0.0656 at 0.50 0.5077
Query 221: 0.5370 at 0.60 0.3881 0.4
Query 224: 0.0714 at 0.70 0.3068
Query 225: 0.6111 at 0.80 0.2998
Query 226: 1.0000 at 0.90 0.2851
Query 227: 0.5000 at 1.00 0.2823
Query 228: 0.0029 0.2
Query 230: 0.3483 Avg. prec. (non-interpolated)
Query 231: 1.0000 for all rel. documents
Query 232: 0.0956 0.4412
Query 233: 0.2297 Precision:
Query 234: 0.5046 At 5 docs: 0.2353 0.0
Query 235: 0.0955 At 10 docs: 0.1471 0.0 0.2 0.4 0.6 0.8 1.0
Query 237: 0.4167 At 15 docs: 0.1078
Query 238: 1.0000 At 20 docs: 0.0956 Recall
Query 239: 0.6610 At 30 docs: 0.0716
Query 241: 0.1787 At 100 docs: 0.0271
Query 242: 0.0500 At 200 docs: 0.0144 Run UAmsC04RuRuAll
Query 244: 1.0000 At 500 docs: 0.0060 Comparison to median by topic
Query 245: 0.0694 At 1000 docs: 0.0030
Query 250: 1.0000 +1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.4129
+0.5
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
SUNY Buffalo, Monolingual Russian, Auto, TD Run UBmonoRU01
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 34 queries): 1.0
Query 201: 0.0108 Total number of documents
Query 202: 0.1333 over all queries
Query 203: 0.0000 Retrieved: 32515
Query 207: 0.0000 Relevant: 123 0.8
Query 209: 0.8333 Rel_ret: 78
Query 210: 0.1093
Query 211: 1.0000 Interpolated Recall -
Query 212: 0.0517 Precision Averages:
Query 213: 0.3560 at 0.00 0.4947
Query 214: 0.0051 at 0.10 0.4942 0.6
Query 215: 0.0270 at 0.20 0.4710
Query 216: 0.5000 at 0.30 0.4134
Query 218: 0.2500 at 0.40 0.3635
Precision
Query 220: 0.0198 at 0.50 0.3406
Query 221: 0.2333 at 0.60 0.2266 0.4
Query 224: 0.0417 at 0.70 0.1592
Query 225: 0.4587 at 0.80 0.1586
Query 226: 1.0000 at 0.90 0.1582
Query 227: 0.2500 at 1.00 0.1582
Query 228: 0.0147 0.2
Query 230: 0.2759 Avg. prec. (non-interpolated)
Query 231: 1.0000 for all rel. documents
Query 232: 0.0556 0.2978
Query 233: 0.2375 Precision:
Query 234: 0.2083 At 5 docs: 0.1765 0.0
Query 235: 0.1254 At 10 docs: 0.1059 0.0 0.2 0.4 0.6 0.8 1.0
Query 237: 0.5000 At 15 docs: 0.0843
Query 238: 0.1000 At 20 docs: 0.0676 Recall
Query 239: 0.3128 At 30 docs: 0.0490
Query 241: 0.0166 At 100 docs: 0.0182
Query 242: 0.0000 At 200 docs: 0.0097 Run UBmonoRU01
Query 244: 0.3333 At 500 docs: 0.0041 Comparison to median by topic
Query 245: 0.6667 At 1000 docs: 0.0023
Query 250: 1.0000 +1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.2807
+0.5
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Hildesheim, Monolingual Russian, Auto, TD Run UHIru1
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 34 queries): 1.0
Query 201: 0.0106 Total number of documents
Query 202: 0.0022 over all queries
Query 203: 1.0000 Retrieved: 34000
Query 207: 0.0000 Relevant: 123 0.8
Query 209: 0.5385 Rel_ret: 88
Query 210: 0.2735
Query 211: 0.0545 Interpolated Recall -
Query 212: 0.1502 Precision Averages:
Query 213: 0.0933 at 0.00 0.2748
Query 214: 0.0476 at 0.10 0.2536 0.6
Query 215: 1.0000 at 0.20 0.2459
Query 216: 0.0039 at 0.30 0.1967
Query 218: 0.0106 at 0.40 0.1610
Precision
Query 220: 0.0056 at 0.50 0.1591
Query 221: 0.0020 at 0.60 0.1092 0.4
Query 224: 0.0073 at 0.70 0.1012
Query 225: 0.2063 at 0.80 0.1004
Query 226: 0.0014 at 0.90 0.0994
Query 227: 0.1667 at 1.00 0.0988
Query 228: 0.0000 0.2
Query 230: 0.3603 Avg. prec. (non-interpolated)
Query 231: 0.0032 for all rel. documents
Query 232: 0.0008 0.1553
Query 233: 0.0065 Precision:
Query 234: 0.0472 At 5 docs: 0.0765 0.0
Query 235: 0.0053 At 10 docs: 0.0588 0.0 0.2 0.4 0.6 0.8 1.0
Query 237: 0.0017 At 15 docs: 0.0471
Query 238: 0.0093 At 20 docs: 0.0382 Recall
Query 239: 0.0252 At 30 docs: 0.0294
Query 241: 0.1330 At 100 docs: 0.0126
Query 242: 0.1111 At 200 docs: 0.0075 Run UHIru1
Query 244: 1.0000 At 500 docs: 0.0044 Comparison to median by topic
Query 245: 0.0039 At 1000 docs: 0.0026
Query 250: 0.0000 +1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.1471
+0.5
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Hildesheim, Monolingual Russian, Auto, TD Run UHIru2
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 34 queries): 1.0
Query 201: 0.0116 Total number of documents
Query 202: 0.0022 over all queries
Query 203: 1.0000 Retrieved: 34000
Query 207: 0.0000 Relevant: 123 0.8
Query 209: 0.5303 Rel_ret: 82
Query 210: 0.2773
Query 211: 0.0479 Interpolated Recall -
Query 212: 0.0908 Precision Averages:
Query 213: 0.1367 at 0.00 0.2652
Query 214: 0.0185 at 0.10 0.2623 0.6
Query 215: 0.5000 at 0.20 0.2401
Query 216: 0.0024 at 0.30 0.1825
Query 218: 0.0093 at 0.40 0.1547
Precision
Query 220: 0.0036 at 0.50 0.1541
Query 221: 0.0022 at 0.60 0.0854 0.4
Query 224: 0.0063 at 0.70 0.0817
Query 225: 0.1783 at 0.80 0.0801
Query 226: 0.0022 at 0.90 0.0799
Query 227: 0.5000 at 1.00 0.0799
Query 228: 0.0000 0.2
Query 230: 0.3119 Avg. prec. (non-interpolated)
Query 231: 0.0036 for all rel. documents
Query 232: 0.0008 0.1420
Query 233: 0.0057 Precision:
Query 234: 0.0404 At 5 docs: 0.0706 0.0
Query 235: 0.0053 At 10 docs: 0.0500 0.0 0.2 0.4 0.6 0.8 1.0
Query 237: 0.0033 At 15 docs: 0.0392
Query 238: 0.0031 At 20 docs: 0.0338 Recall
Query 239: 0.0232 At 30 docs: 0.0255
Query 241: 0.0555 At 100 docs: 0.0118
Query 242: 0.0500 At 200 docs: 0.0068 Run UHIru2
Query 244: 1.0000 At 500 docs: 0.0040 Comparison to median by topic
Query 245: 0.0044 At 1000 docs: 0.0024
Query 250: 0.0000 +1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.1294
+0.5
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Hildesheim, Monolingual Russian, Auto, TD Run UHIru3
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 34 queries): 1.0
Query 201: 0.0000 Total number of documents
Query 202: 0.0035 over all queries
Query 203: 0.0000 Retrieved: 33873
Query 207: 0.0000 Relevant: 123 0.8
Query 209: 0.2976 Rel_ret: 56
Query 210: 0.0080
Query 211: 0.1548 Interpolated Recall -
Query 212: 0.2389 Precision Averages:
Query 213: 0.0136 at 0.00 0.1160
Query 214: 0.0008 at 0.10 0.1150 0.6
Query 215: 0.0196 at 0.20 0.0911
Query 216: 0.0021 at 0.30 0.0792
Query 218: 0.0125 at 0.40 0.0616
Precision
Query 220: 0.0370 at 0.50 0.0602
Query 221: 0.0019 at 0.60 0.0144 0.4
Query 224: 0.0000 at 0.70 0.0132
Query 225: 0.1750 at 0.80 0.0128
Query 226: 0.0294 at 0.90 0.0128
Query 227: 0.2500 at 1.00 0.0128
Query 228: 0.0000 0.2
Query 230: 0.1351 Avg. prec. (non-interpolated)
Query 231: 0.0069 for all rel. documents
Query 232: 0.0010 0.0459
Query 233: 0.0021 Precision:
Query 234: 0.0000 At 5 docs: 0.0412 0.0
Query 235: 0.0103 At 10 docs: 0.0353 0.0 0.2 0.4 0.6 0.8 1.0
Query 237: 0.0199 At 15 docs: 0.0294
Query 238: 0.0000 At 20 docs: 0.0221 Recall
Query 239: 0.0003 At 30 docs: 0.0176
Query 241: 0.0246 At 100 docs: 0.0071
Query 242: 0.0000 At 200 docs: 0.0049 Run UHIru3
Query 244: 0.1111 At 500 docs: 0.0029 Comparison to median by topic
Query 245: 0.0045 At 1000 docs: 0.0016
Query 250: 0.0000 +1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.0627
+0.5
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Université de Neuchâtel, Monolingual Russian, Auto, TD Run UniNEru1
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 34 queries): 1.0
Query 201: 0.0263 Total number of documents
Query 202: 0.0309 over all queries
Query 203: 1.0000 Retrieved: 32933
Query 207: 0.0000 Relevant: 123 0.8
Query 209: 0.5833 Rel_ret: 101
Query 210: 0.4159
Query 211: 1.0000 Interpolated Recall -
Query 212: 0.4056 Precision Averages:
Query 213: 0.1899 at 0.00 0.5329
Query 214: 0.0386 at 0.10 0.5090 0.6
Query 215: 1.0000 at 0.20 0.4990
Query 216: 0.5000 at 0.30 0.4534
Query 218: 0.2500 at 0.40 0.3965
Precision
Query 220: 0.0255 at 0.50 0.3894
Query 221: 0.5227 at 0.60 0.3051 0.4
Query 224: 0.0705 at 0.70 0.2589
Query 225: 0.5050 at 0.80 0.2567
Query 226: 1.0000 at 0.90 0.2364
Query 227: 0.0500 at 1.00 0.2353
Query 228: 0.0054 0.2
Query 230: 0.3485 Avg. prec. (non-interpolated)
Query 231: 0.5000 for all rel. documents
Query 232: 0.0506 0.3546
Query 233: 0.2053 Precision:
Query 234: 0.4135 At 5 docs: 0.1824 0.0
Query 235: 0.1289 At 10 docs: 0.1324 0.0 0.2 0.4 0.6 0.8 1.0
Query 237: 0.2500 At 15 docs: 0.1039
Query 238: 0.5000 At 20 docs: 0.0824 Recall
Query 239: 0.2453 At 30 docs: 0.0637
Query 241: 0.1412 At 100 docs: 0.0229
Query 242: 0.0476 At 200 docs: 0.0132 Run UniNEru1
Query 244: 1.0000 At 500 docs: 0.0058 Comparison to median by topic
Query 245: 0.1068 At 1000 docs: 0.0030
Query 250: 0.5000 +1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.3003
+0.5
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Université de Neuchâtel, Monolingual Russian, Auto, TD Run UniNEru2
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 34 queries): 1.0
Query 201: 0.0259 Total number of documents
Query 202: 0.0375 over all queries
Query 203: 1.0000 Retrieved: 32926
Query 207: 0.0000 Relevant: 123 0.8
Query 209: 0.5833 Rel_ret: 101
Query 210: 0.3513
Query 211: 1.0000 Interpolated Recall -
Query 212: 0.3968 Precision Averages:
Query 213: 0.1584 at 0.00 0.5452
Query 214: 0.0574 at 0.10 0.5203 0.6
Query 215: 1.0000 at 0.20 0.5125
Query 216: 0.5000 at 0.30 0.4636
Query 218: 0.2500 at 0.40 0.3926
Precision
Query 220: 0.0260 at 0.50 0.3833
Query 221: 0.5172 at 0.60 0.3000 0.4
Query 224: 0.0710 at 0.70 0.2483
Query 225: 0.4724 at 0.80 0.2459
Query 226: 1.0000 at 0.90 0.2338
Query 227: 0.0625 at 1.00 0.2325
Query 228: 0.0063 0.2
Query 230: 0.3602 Avg. prec. (non-interpolated)
Query 231: 0.5000 for all rel. documents
Query 232: 0.0423 0.3545
Query 233: 0.1975 Precision:
Query 234: 0.3873 At 5 docs: 0.1765 0.0
Query 235: 0.1724 At 10 docs: 0.1324 0.0 0.2 0.4 0.6 0.8 1.0
Query 237: 0.2500 At 15 docs: 0.0961
Query 238: 0.5000 At 20 docs: 0.0794 Recall
Query 239: 0.2169 At 30 docs: 0.0618
Query 241: 0.1443 At 100 docs: 0.0232
Query 242: 0.0385 At 200 docs: 0.0135 Run UniNEru2
Query 244: 1.0000 At 500 docs: 0.0058 Comparison to median by topic
Query 245: 0.2273 At 1000 docs: 0.0030
Query 250: 0.5000 +1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.3062
+0.5
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
Université de Neuchâtel, Monolingual Russian, Auto, TDN Run UniNEru3
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 34 queries): 1.0
Query 201: 0.0188 Total number of documents
Query 202: 0.0386 over all queries
Query 203: 1.0000 Retrieved: 34000
Query 207: 0.0000 Relevant: 123 0.8
Query 209: 0.8333 Rel_ret: 108
Query 210: 0.1916
Query 211: 1.0000 Interpolated Recall -
Query 212: 0.1094 Precision Averages:
Query 213: 0.2245 at 0.00 0.5605
Query 214: 0.0917 at 0.10 0.5523 0.6
Query 215: 1.0000 at 0.20 0.5523
Query 216: 0.2500 at 0.30 0.5003
Query 218: 0.2500 at 0.40 0.4651
Precision
Query 220: 0.0316 at 0.50 0.4539
Query 221: 0.5667 at 0.60 0.3505 0.4
Query 224: 0.0470 at 0.70 0.3024
Query 225: 0.7917 at 0.80 0.2975
Query 226: 1.0000 at 0.90 0.2902
Query 227: 0.5000 at 1.00 0.2892
Query 228: 0.0047 0.2
Query 230: 0.3340 Avg. prec. (non-interpolated)
Query 231: 1.0000 for all rel. documents
Query 232: 0.2498 0.4070
Query 233: 0.2429 Precision:
Query 234: 0.8056 At 5 docs: 0.2000 0.0
Query 235: 0.2090 At 10 docs: 0.1353 0.0 0.2 0.4 0.6 0.8 1.0
Query 237: 0.2560 At 15 docs: 0.1020
Query 238: 0.3333 At 20 docs: 0.0853 Recall
Query 239: 0.2108 At 30 docs: 0.0637
Query 241: 0.1530 At 100 docs: 0.0271
Query 242: 0.0417 At 200 docs: 0.0149 Run UniNEru3
Query 244: 1.0000 At 500 docs: 0.0062 Comparison to median by topic
Query 245: 0.0519 At 1000 docs: 0.0032
Query 250: 1.0000 +1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.3902
+0.5
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
U Oviedo, Monolingual Russian, Auto, TD Run uoviRU
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 34 queries): 1.0
Query 201: 0.0004 Total number of documents
Query 202: 0.0692 over all queries
Query 203: 0.0000 Retrieved: 33999
Query 207: 0.0000 Relevant: 123
Query 209: 0.7500 Rel_ret: 72
0.8
Query 210: 0.4028
Query 211: 1.0000 Interpolated Recall -
Query 212: 0.0006 Precision Averages:
Query 213: 0.0209 at 0.00 0.2203
Query 214: 0.0410 at 0.10 0.2203 0.6
Query 215: 0.0032 at 0.20 0.2199
Query 216: 0.0054 at 0.30 0.1998
Query 218: 0.5000 at 0.40 0.1815
Precision
Query 220: 0.0243 at 0.50 0.1664
Query 221: 0.2167 at 0.60 0.0928 0.4
Query 224: 0.1667 at 0.70 0.0902
Query 225: 0.1758 at 0.80 0.0864
Query 226: 0.0016 at 0.90 0.0857
Query 227: 0.0000 at 1.00 0.0857
Query 228: 0.0000 0.2
Query 230: 0.2267 Avg. prec. (non-interpolated)
Query 231: 0.0250 for all rel. documents
Query 232: 0.0006 0.1433
Query 233: 0.0104 Precision:
Query 234: 0.0013 At 5 docs: 0.0882 0.0
Query 235: 0.0010 At 10 docs: 0.0529 0.0 0.2 0.4 0.6 0.8 1.0
Query 237: 0.0150 At 15 docs: 0.0392
Query 238: 0.1000 At 20 docs: 0.0309 Recall
Query 239: 0.0846 At 30 docs: 0.0294
Query 241: 0.0242 At 100 docs: 0.0121
Query 242: 0.0000 At 200 docs: 0.0068 Run uoviRU
Query 244: 1.0000 At 500 docs: 0.0034 Comparison to median by topic
Query 245: 0.0054 At 1000 docs: 0.0021
Query 250: 0.0000 +1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.1245
+0.5
0.0
Difference (average precision)
−0.5
−1.0
201 210 220 230 240 250
Topic number
UC Berkeley, GIRT English to German, Auto, TD Run BKGRBLEG1
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 25 queries): 1.0
Query 101: 0.0122 Total number of documents
Query 102: 0.7329 over all queries
Query 103: 0.0666 Retrieved: 25000
Query 104: 0.3916 Relevant: 1663
Query 105: 0.5594 Rel_ret: 1426
0.8
Query 106: 0.9963
Query 107: 0.3945 Interpolated Recall -
Query 108: 0.6033 Precision Averages:
Query 109: 0.1271 at 0.00 0.7751
Query 110: 0.4295 at 0.10 0.6637 0.6
Query 111: 0.1765 at 0.20 0.5711
Query 112: 0.2056 at 0.30 0.5137
Query 113: 0.4274 at 0.40 0.4597
Precision
Query 114: 0.4847 at 0.50 0.4100
Query 115: 0.8966 at 0.60 0.3404 0.4
Query 116: 0.1002 at 0.70 0.2693
Query 117: 0.1300 at 0.80 0.1962
Query 118: 0.3991 at 0.90 0.1296
Query 119: 0.0805 at 1.00 0.0482
Query 120: 0.3758 0.2
Query 121: 0.3257 Avg. prec. (non-interpolated)
Query 122: 0.3074 for all rel. documents
Query 123: 0.0009 0.3868
Query 124: 0.8176 Precision:
Query 125: 0.6293 At 5 docs: 0.6400 0.0
At 10 docs: 0.5960 0.0 0.2 0.4 0.6 0.8 1.0
At 15 docs: 0.5627
At 20 docs: 0.5220 Recall
At 30 docs: 0.4880
At 100 docs: 0.3188
At 200 docs: 0.2070 Run BKGRBLEG1
At 500 docs: 0.1033 Comparison to median by topic
At 1000 docs: 0.0570
+1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.4021
+0.5
0.0
Difference (average precision)
−0.5
−1.0
101 105 110 115 120 125
Topic number
UC Berkeley, GIRT English to German, Auto, TD Run BKGRBLEG2
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 25 queries): 1.0
Query 101: 0.3374 Total number of documents
Query 102: 0.2569 over all queries
Query 103: 0.0382 Retrieved: 25000
Query 104: 0.3251 Relevant: 1663
Query 105: 0.6136 Rel_ret: 1348
0.8
Query 106: 0.3200
Query 107: 0.4175 Interpolated Recall -
Query 108: 0.5598 Precision Averages:
Query 109: 0.0366 at 0.00 0.7021
Query 110: 0.4264 at 0.10 0.5792 0.6
Query 111: 0.1217 at 0.20 0.5259
Query 112: 0.2085 at 0.30 0.4606
Query 113: 0.4094 at 0.40 0.3593
Precision
Query 114: 0.0131 at 0.50 0.2995
Query 115: 0.8880 at 0.60 0.2516 0.4
Query 116: 0.0092 at 0.70 0.2010
Query 117: 0.2475 at 0.80 0.1352
Query 118: 0.2411 at 0.90 0.0775
Query 119: 0.0788 at 1.00 0.0218
Query 120: 0.3717 0.2
Query 121: 0.0832 Avg. prec. (non-interpolated)
Query 122: 0.4263 for all rel. documents
Query 123: 0.0041 0.3176
Query 124: 0.8412 Precision:
Query 125: 0.6660 At 5 docs: 0.5520 0.0
At 10 docs: 0.5000 0.0 0.2 0.4 0.6 0.8 1.0
At 15 docs: 0.4773
At 20 docs: 0.4420 Recall
At 30 docs: 0.3987
At 100 docs: 0.2808
At 200 docs: 0.1892 Run BKGRBLEG2
At 500 docs: 0.0970 Comparison to median by topic
At 1000 docs: 0.0539
+1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.3448
+0.5
0.0
Difference (average precision)
−0.5
−1.0
101 105 110 115 120 125
Topic number
UC Berkeley, GIRT English to German, Auto, TD Run BKGRBLEG3
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 25 queries): 1.0
Query 101: 0.1692 Total number of documents
Query 102: 0.3479 over all queries
Query 103: 0.0295 Retrieved: 25000
Query 104: 0.3676 Relevant: 1663
Query 105: 0.5718 Rel_ret: 1411
0.8
Query 106: 0.8743
Query 107: 0.4231 Interpolated Recall -
Query 108: 0.6746 Precision Averages:
Query 109: 0.0627 at 0.00 0.7912
Query 110: 0.3963 at 0.10 0.6590 0.6
Query 111: 0.1735 at 0.20 0.5735
Query 112: 0.2697 at 0.30 0.5126
Query 113: 0.4252 at 0.40 0.4028
Precision
Query 114: 0.1155 at 0.50 0.3601
Query 115: 0.8766 at 0.60 0.2998 0.4
Query 116: 0.1492 at 0.70 0.2430
Query 117: 0.2602 at 0.80 0.1757
Query 118: 0.3065 at 0.90 0.1138
Query 119: 0.1045 at 1.00 0.0307
Query 120: 0.5222 0.2
Query 121: 0.2739 Avg. prec. (non-interpolated)
Query 122: 0.3597 for all rel. documents
Query 123: 0.0022 0.3641
Query 124: 0.8274 Precision:
Query 125: 0.5184 At 5 docs: 0.5760 0.0
At 10 docs: 0.5520 0.0 0.2 0.4 0.6 0.8 1.0
At 15 docs: 0.5200
At 20 docs: 0.5020 Recall
At 30 docs: 0.4573
At 100 docs: 0.3076
At 200 docs: 0.2008 Run BKGRBLEG3
At 500 docs: 0.1022 Comparison to median by topic
At 1000 docs: 0.0564
+1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.3889
+0.5
0.0
Difference (average precision)
−0.5
−1.0
101 105 110 115 120 125
Topic number
UC Berkeley, GIRT English to German, Auto, TD Run BKGRBLEG4
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 25 queries): 1.0
Query 101: 0.3425 Total number of documents
Query 102: 0.2007 over all queries
Query 103: 0.0022 Retrieved: 25000
Query 104: 0.2687 Relevant: 1663
Query 105: 0.6345 Rel_ret: 1318
0.8
Query 106: 0.7209
Query 107: 0.1087 Interpolated Recall -
Query 108: 0.6866 Precision Averages:
Query 109: 0.0010 at 0.00 0.7012
Query 110: 0.3378 at 0.10 0.5362 0.6
Query 111: 0.1257 at 0.20 0.4752
Query 112: 0.0000 at 0.30 0.4178
Query 113: 0.3043 at 0.40 0.3141
Precision
Query 114: 0.0113 at 0.50 0.2869
Query 115: 0.8902 at 0.60 0.2372 0.4
Query 116: 0.0800 at 0.70 0.1945
Query 117: 0.1657 at 0.80 0.1484
Query 118: 0.2411 at 0.90 0.0833
Query 119: 0.0650 at 1.00 0.0167
Query 120: 0.4340 0.2
Query 121: 0.2312 Avg. prec. (non-interpolated)
Query 122: 0.4286 for all rel. documents
Query 123: 0.0000 0.2964
Query 124: 0.8653 Precision:
Query 125: 0.2636 At 5 docs: 0.5120 0.0
At 10 docs: 0.4760 0.0 0.2 0.4 0.6 0.8 1.0
At 15 docs: 0.4213
At 20 docs: 0.3920 Recall
At 30 docs: 0.3693
At 100 docs: 0.2572
At 200 docs: 0.1726 Run BKGRBLEG4
At 500 docs: 0.0924 Comparison to median by topic
At 1000 docs: 0.0527
+1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.3145
+0.5
0.0
Difference (average precision)
−0.5
−1.0
101 105 110 115 120 125
Topic number
UC Berkeley, GIRT English to German, Auto, TD Run BKGRBLEG5
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 25 queries): 1.0
Query 101: 0.0315 Total number of documents
Query 102: 0.4657 over all queries
Query 103: 0.0381 Retrieved: 25000
Query 104: 0.3420 Relevant: 1663
Query 105: 0.5859 Rel_ret: 1402
0.8
Query 106: 0.6546
Query 107: 0.3868 Interpolated Recall -
Query 108: 0.4257 Precision Averages:
Query 109: 0.0550 at 0.00 0.6956
Query 110: 0.3545 at 0.10 0.5552 0.6
Query 111: 0.0814 at 0.20 0.5033
Query 112: 0.1196 at 0.30 0.4612
Query 113: 0.5240 at 0.40 0.3961
Precision
Query 114: 0.0939 at 0.50 0.3435
Query 115: 0.8598 at 0.60 0.2635 0.4
Query 116: 0.0097 at 0.70 0.2055
Query 117: 0.1933 at 0.80 0.1541
Query 118: 0.3209 at 0.90 0.0719
Query 119: 0.0997 at 1.00 0.0219
Query 120: 0.5643 0.2
Query 121: 0.1059 Avg. prec. (non-interpolated)
Query 122: 0.3791 for all rel. documents
Query 123: 0.0001 0.3224
Query 124: 0.7321 Precision:
Query 125: 0.6369 At 5 docs: 0.5600 0.0
At 10 docs: 0.5080 0.0 0.2 0.4 0.6 0.8 1.0
At 15 docs: 0.4613
At 20 docs: 0.4380 Recall
At 30 docs: 0.4147
At 100 docs: 0.2952
At 200 docs: 0.1948 Run BKGRBLEG5
At 500 docs: 0.1018 Comparison to median by topic
At 1000 docs: 0.0561
+1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.3412
+0.5
0.0
Difference (average precision)
−0.5
−1.0
101 105 110 115 120 125
Topic number
UC Berkeley, GIRT German to German, Auto, TD Run BKGRMLGG0
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 25 queries): 1.0
Query 101: 0.3450 Total number of documents
Query 102: 0.7535 over all queries
Query 103: 0.0657 Retrieved: 25000
Query 104: 0.1310 Relevant: 1663
Query 105: 0.4282 Rel_ret: 1299
0.8
Query 106: 0.9778
Query 107: 0.0613 Interpolated Recall -
Query 108: 0.3507 Precision Averages:
Query 109: 0.0875 at 0.00 0.7878
Query 110: 0.3774 at 0.10 0.6154 0.6
Query 111: 0.1802 at 0.20 0.5695
Query 112: 0.1350 at 0.30 0.5124
Query 113: 0.2906 at 0.40 0.4070
Precision
Query 114: 0.0992 at 0.50 0.3631
Query 115: 0.8355 at 0.60 0.3049 0.4
Query 116: 0.1975 at 0.70 0.2554
Query 117: 0.1819 at 0.80 0.2003
Query 118: 0.4225 at 0.90 0.1450
Query 119: 0.9520 at 1.00 0.0424
Query 120: 0.2962 0.2
Query 121: 0.3418 Avg. prec. (non-interpolated)
Query 122: 0.2879 for all rel. documents
Query 123: 0.0000 0.3706
Query 124: 0.5862 Precision:
Query 125: 0.8795 At 5 docs: 0.5840 0.0
At 10 docs: 0.5320 0.0 0.2 0.4 0.6 0.8 1.0
At 15 docs: 0.5147
At 20 docs: 0.4840 Recall
At 30 docs: 0.4573
At 100 docs: 0.2980
At 200 docs: 0.1956 Run BKGRMLGG0
At 500 docs: 0.0949 Comparison to median by topic
At 1000 docs: 0.0520
+1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.3933
+0.5
0.0
Difference (average precision)
−0.5
−1.0
101 105 110 115 120 125
Topic number
UC Berkeley, GIRT German to German, Auto, TD Run BKGRMLGG1
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 25 queries): 1.0
Query 101: 0.0260 Total number of documents
Query 102: 0.7174 over all queries
Query 103: 0.1522 Retrieved: 25000
Query 104: 0.3598 Relevant: 1663
Query 105: 0.5248 Rel_ret: 1471
0.8
Query 106: 0.8055
Query 107: 0.0914 Interpolated Recall -
Query 108: 0.4672 Precision Averages:
Query 109: 0.1671 at 0.00 0.7290
Query 110: 0.4232 at 0.10 0.6666 0.6
Query 111: 0.1908 at 0.20 0.6101
Query 112: 0.1011 at 0.30 0.5631
Query 113: 0.3953 at 0.40 0.5038
Precision
Query 114: 0.5857 at 0.50 0.4206
Query 115: 0.8725 at 0.60 0.3728 0.4
Query 116: 0.3103 at 0.70 0.2958
Query 117: 0.2514 at 0.80 0.2324
Query 118: 0.3590 at 0.90 0.1579
Query 119: 0.9883 at 1.00 0.0604
Query 120: 0.4743 0.2
Query 121: 0.2212 Avg. prec. (non-interpolated)
Query 122: 0.2569 for all rel. documents
Query 123: 0.0000 0.4102
Query 124: 0.6872 Precision:
Query 125: 0.8252 At 5 docs: 0.5920 0.0
At 10 docs: 0.6120 0.0 0.2 0.4 0.6 0.8 1.0
At 15 docs: 0.5520
At 20 docs: 0.5380 Recall
At 30 docs: 0.5080
At 100 docs: 0.3264
At 200 docs: 0.2080 Run BKGRMLGG1
At 500 docs: 0.1062 Comparison to median by topic
At 1000 docs: 0.0588
+1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.4354
+0.5
0.0
Difference (average precision)
−0.5
−1.0
101 105 110 115 120 125
Topic number
UC Berkeley, GIRT German to German, Auto, TD Run BKGRMLGG2
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 25 queries): 1.0
Query 101: 0.3392 Total number of documents
Query 102: 0.7472 over all queries
Query 103: 0.0804 Retrieved: 25000
Query 104: 0.2155 Relevant: 1663
Query 105: 0.5545 Rel_ret: 1472
0.8
Query 106: 0.8368
Query 107: 0.1565 Interpolated Recall -
Query 108: 0.4684 Precision Averages:
Query 109: 0.1690 at 0.00 0.7843
Query 110: 0.3233 at 0.10 0.6725 0.6
Query 111: 0.1571 at 0.20 0.6268
Query 112: 0.3335 at 0.30 0.5703
Query 113: 0.4505 at 0.40 0.4921
Precision
Query 114: 0.5920 at 0.50 0.4505
Query 115: 0.9001 at 0.60 0.3835 0.4
Query 116: 0.0065 at 0.70 0.2960
Query 117: 0.2163 at 0.80 0.2287
Query 118: 0.3699 at 0.90 0.1614
Query 119: 0.9903 at 1.00 0.0678
Query 120: 0.5201 0.2
Query 121: 0.2453 Avg. prec. (non-interpolated)
Query 122: 0.2767 for all rel. documents
Query 123: 0.0000 0.4177
Query 124: 0.6969 Precision:
Query 125: 0.7961 At 5 docs: 0.5920 0.0
At 10 docs: 0.5600 0.0 0.2 0.4 0.6 0.8 1.0
At 15 docs: 0.5280
At 20 docs: 0.5080 Recall
At 30 docs: 0.4853
At 100 docs: 0.3300
At 200 docs: 0.2166 Run BKGRMLGG2
At 500 docs: 0.1062 Comparison to median by topic
At 1000 docs: 0.0589
+1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.4334
+0.5
0.0
Difference (average precision)
−0.5
−1.0
101 105 110 115 120 125
Topic number
FU Hagen, GIRT German to German, Auto, TD Run FUHdm
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 25 queries): 1.0
Query 101: 0.0000 Total number of documents
Query 102: 0.0000 over all queries
Query 103: 0.0360 Retrieved: 1309
Query 104: 0.0000 Relevant: 1663
Query 105: 0.0117 Rel_ret: 167 0.8
Query 106: 0.8708
Query 107: 0.0222 Interpolated Recall -
Query 108: 0.0000 Precision Averages:
Query 109: 0.0192 at 0.00 0.3509
Query 110: 0.0000 at 0.10 0.2045 0.6
Query 111: 0.0000 at 0.20 0.1395
Query 112: 0.0173 at 0.30 0.1357
Query 113: 0.0250 at 0.40 0.1114
Precision
Query 114: 0.0000 at 0.50 0.1078
Query 115: 0.0000 at 0.60 0.1078 0.4
Query 116: 0.8179 at 0.70 0.1061
Query 117: 0.0000 at 0.80 0.1058
Query 118: 0.0913 at 0.90 0.0000
Query 119: 0.0000 at 1.00 0.0000
Query 120: 0.0000 0.2
Query 121: 0.2200 Avg. prec. (non-interpolated)
Query 122: 0.0000 for all rel. documents
Query 123: 0.0000 0.1126
Query 124: 0.0539 Precision:
Query 125: 0.6300 At 5 docs: 0.2480 0.0
At 10 docs: 0.1960 0.0 0.2 0.4 0.6 0.8 1.0
At 15 docs: 0.1947
At 20 docs: 0.1780 Recall
At 30 docs: 0.1547
At 100 docs: 0.0664
At 200 docs: 0.0332 Run FUHdm
At 500 docs: 0.0134 Comparison to median by topic
At 1000 docs: 0.0067
+1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.1393
+0.5
0.0
Difference (average precision)
−0.5
−1.0
101 105 110 115 120 125
Topic number
FU Hagen, GIRT German to German, Auto, TD Run FUHdrw
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 25 queries): 1.0
Query 101: 0.0088 Total number of documents
Query 102: 0.1507 over all queries
Query 103: 0.0702 Retrieved: 25000
Query 104: 0.0209 Relevant: 1663
Query 105: 0.0252 Rel_ret: 672 0.8
Query 106: 0.2858
Query 107: 0.0004 Interpolated Recall -
Query 108: 0.1818 Precision Averages:
Query 109: 0.0138 at 0.00 0.3685
Query 110: 0.0025 at 0.10 0.2865 0.6
Query 111: 0.0131 at 0.20 0.2114
Query 112: 0.0487 at 0.30 0.1768
Query 113: 0.1158 at 0.40 0.1062
Precision
Query 114: 0.0234 at 0.50 0.0934
Query 115: 0.1487 at 0.60 0.0784 0.4
Query 116: 0.7857 at 0.70 0.0694
Query 117: 0.0079 at 0.80 0.0544
Query 118: 0.0347 at 0.90 0.0120
Query 119: 0.0035 at 1.00 0.0015
Query 120: 0.0626 0.2
Query 121: 0.1873 Avg. prec. (non-interpolated)
Query 122: 0.0106 for all rel. documents
Query 123: 0.0015 0.1162
Query 124: 0.0550 Precision:
Query 125: 0.6458 At 5 docs: 0.2320 0.0
At 10 docs: 0.2120 0.0 0.2 0.4 0.6 0.8 1.0
At 15 docs: 0.2133
At 20 docs: 0.2140 Recall
At 30 docs: 0.1867
At 100 docs: 0.0976
At 200 docs: 0.0684 Run FUHdrw
At 500 docs: 0.0394 Comparison to median by topic
At 1000 docs: 0.0269
+1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.1632
+0.5
0.0
Difference (average precision)
−0.5
−1.0
101 105 110 115 120 125
Topic number
FU Hagen, GIRT German to German, Auto, TD Run FUHds1
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 25 queries): 1.0
Query 101: 0.0370 Total number of documents
Query 102: 0.4567 over all queries
Query 103: 0.0762 Retrieved: 25000
Query 104: 0.1733 Relevant: 1663
Query 105: 0.4815 Rel_ret: 1148 0.8
Query 106: 0.7269
Query 107: 0.1623 Interpolated Recall -
Query 108: 0.3043 Precision Averages:
Query 109: 0.1042 at 0.00 0.8119
Query 110: 0.2217 at 0.10 0.5467 0.6
Query 111: 0.0643 at 0.20 0.4134
Query 112: 0.0030 at 0.30 0.3611
Query 113: 0.2042 at 0.40 0.2825
Precision
Query 114: 0.0929 at 0.50 0.2190
Query 115: 0.4745 at 0.60 0.1543 0.4
Query 116: 0.1462 at 0.70 0.0837
Query 117: 0.2373 at 0.80 0.0459
Query 118: 0.3153 at 0.90 0.0161
Query 119: 0.3892 at 1.00 0.0022
Query 120: 0.2075 0.2
Query 121: 0.1494 Avg. prec. (non-interpolated)
Query 122: 0.0525 for all rel. documents
Query 123: 0.1383 0.2446
Query 124: 0.4336 Precision:
Query 125: 0.4636 At 5 docs: 0.5680 0.0
At 10 docs: 0.5000 0.0 0.2 0.4 0.6 0.8 1.0
At 15 docs: 0.4347
At 20 docs: 0.4080 Recall
At 30 docs: 0.3760
At 100 docs: 0.2224
At 200 docs: 0.1506 Run FUHds1
At 500 docs: 0.0794 Comparison to median by topic
At 1000 docs: 0.0459
+1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.2815
+0.5
0.0
Difference (average precision)
−0.5
−1.0
101 105 110 115 120 125
Topic number
FU Hagen, GIRT German to German, Auto, TD Run FUHdw1
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 25 queries): 1.0
Query 101: 0.3342 Total number of documents
Query 102: 0.3393 over all queries
Query 103: 0.0670 Retrieved: 25000
Query 104: 0.0940 Relevant: 1663
Query 105: 0.3916 Rel_ret: 1009 0.8
Query 106: 0.3032
Query 107: 0.0053 Interpolated Recall -
Query 108: 0.2160 Precision Averages:
Query 109: 0.0089 at 0.00 0.6620
Query 110: 0.5343 at 0.10 0.5377 0.6
Query 111: 0.2493 at 0.20 0.4653
Query 112: 0.0471 at 0.30 0.4012
Query 113: 0.1437 at 0.40 0.2761
Precision
Query 114: 0.0456 at 0.50 0.2335
Query 115: 0.2426 at 0.60 0.1612 0.4
Query 116: 0.8755 at 0.70 0.1240
Query 117: 0.0885 at 0.80 0.0937
Query 118: 0.3256 at 0.90 0.0580
Query 119: 0.4180 at 1.00 0.0131
Query 120: 0.1161 0.2
Query 121: 0.0383 Avg. prec. (non-interpolated)
Query 122: 0.0443 for all rel. documents
Query 123: 0.0622 0.2482
Query 124: 0.6641 Precision:
Query 125: 0.5493 At 5 docs: 0.4240 0.0
At 10 docs: 0.4160 0.0 0.2 0.4 0.6 0.8 1.0
At 15 docs: 0.3973
At 20 docs: 0.3720 Recall
At 30 docs: 0.3413
At 100 docs: 0.2104
At 200 docs: 0.1362 Run FUHdw1
At 500 docs: 0.0695 Comparison to median by topic
At 1000 docs: 0.0404
+1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.2799
+0.5
0.0
Difference (average precision)
−0.5
−1.0
101 105 110 115 120 125
Topic number
FU Hagen, GIRT German to German, Auto, TD Run FUHdw2
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 25 queries): 1.0
Query 101: 0.3344 Total number of documents
Query 102: 0.3479 over all queries
Query 103: 0.0874 Retrieved: 25000
Query 104: 0.0789 Relevant: 1663
Query 105: 0.3734 Rel_ret: 938 0.8
Query 106: 0.2818
Query 107: 0.0015 Interpolated Recall -
Query 108: 0.1246 Precision Averages:
Query 109: 0.0018 at 0.00 0.6919
Query 110: 0.5663 at 0.10 0.5545 0.6
Query 111: 0.2523 at 0.20 0.4355
Query 112: 0.0218 at 0.30 0.3816
Query 113: 0.2195 at 0.40 0.2726
Precision
Query 114: 0.0723 at 0.50 0.1762
Query 115: 0.0998 at 0.60 0.1177 0.4
Query 116: 0.6701 at 0.70 0.0720
Query 117: 0.0940 at 0.80 0.0614
Query 118: 0.3264 at 0.90 0.0393
Query 119: 0.4054 at 1.00 0.0074
Query 120: 0.1369 0.2
Query 121: 0.0444 Avg. prec. (non-interpolated)
Query 122: 0.1018 for all rel. documents
Query 123: 0.0327 0.2276
Query 124: 0.6217 Precision:
Query 125: 0.3926 At 5 docs: 0.4400 0.0
At 10 docs: 0.4280 0.0 0.2 0.4 0.6 0.8 1.0
At 15 docs: 0.4053
At 20 docs: 0.3800 Recall
At 30 docs: 0.3507
At 100 docs: 0.1944
At 200 docs: 0.1228 Run FUHdw2
At 500 docs: 0.0638 Comparison to median by topic
At 1000 docs: 0.0375
+1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.2457
+0.5
0.0
Difference (average precision)
−0.5
−1.0
101 105 110 115 120 125
Topic number
Ricoh, GIRT German to German, Auto, TD Run rdedetde04
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 25 queries): 1.0
Query 101: 0.0701 Total number of documents
Query 102: 0.1415 over all queries
Query 103: 0.1920 Retrieved: 25000
Query 104: 0.1509 Relevant: 1663
Query 105: 0.2466 Rel_ret: 922
0.8
Query 106: 1.0000
Query 107: 0.0122 Interpolated Recall -
Query 108: 0.2007 Precision Averages:
Query 109: 0.0832 at 0.00 0.6007
Query 110: 0.1528 at 0.10 0.4474 0.6
Query 111: 0.2563 at 0.20 0.3752
Query 112: 0.2138 at 0.30 0.3252
Query 113: 0.2265 at 0.40 0.2629
Precision
Query 114: 0.5418 at 0.50 0.2144
Query 115: 0.6158 at 0.60 0.1678 0.4
Query 116: 0.0001 at 0.70 0.1349
Query 117: 0.0738 at 0.80 0.1050
Query 118: 0.1494 at 0.90 0.0958
Query 119: 0.9564 at 1.00 0.0421
Query 120: 0.0006 0.2
Query 121: 0.3352 Avg. prec. (non-interpolated)
Query 122: 0.0362 for all rel. documents
Query 123: 0.0012 0.2381
Query 124: 0.2665 Precision:
Query 125: 0.0286 At 5 docs: 0.4080 0.0
At 10 docs: 0.4160 0.0 0.2 0.4 0.6 0.8 1.0
At 15 docs: 0.3893
At 20 docs: 0.3600 Recall
At 30 docs: 0.3187
At 100 docs: 0.2064
At 200 docs: 0.1306 Run rdedetde04
At 500 docs: 0.0642 Comparison to median by topic
At 1000 docs: 0.0369
+1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.2759
+0.5
0.0
Difference (average precision)
−0.5
−1.0
101 105 110 115 120 125
Topic number
Ricoh, GIRT English to German, Auto, TD Run rendetde04
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 25 queries): 1.0
Query 101: 0.0282 Total number of documents
Query 102: 0.2096 over all queries
Query 103: 0.0087 Retrieved: 25000
Query 104: 0.1969 Relevant: 1663
Query 105: 0.2578 Rel_ret: 684
0.8
Query 106: 0.7468
Query 107: 0.0938 Interpolated Recall -
Query 108: 0.1732 Precision Averages:
Query 109: 0.0009 at 0.00 0.5697
Query 110: 0.0818 at 0.10 0.3478 0.6
Query 111: 0.0284 at 0.20 0.2338
Query 112: 0.0000 at 0.30 0.1708
Query 113: 0.0654 at 0.40 0.1177
Precision
Query 114: 0.1029 at 0.50 0.0886
Query 115: 0.1334 at 0.60 0.0471 0.4
Query 116: 0.0000 at 0.70 0.0268
Query 117: 0.0212 at 0.80 0.0252
Query 118: 0.1923 at 0.90 0.0016
Query 119: 0.0300 at 1.00 0.0016
Query 120: 0.0002 0.2
Query 121: 0.0534 Avg. prec. (non-interpolated)
Query 122: 0.0380 for all rel. documents
Query 123: 0.0019 0.1261
Query 124: 0.2486 Precision:
Query 125: 0.4396 At 5 docs: 0.3920 0.0
At 10 docs: 0.3280 0.0 0.2 0.4 0.6 0.8 1.0
At 15 docs: 0.3040
At 20 docs: 0.2640 Recall
At 30 docs: 0.2387
At 100 docs: 0.1252
At 200 docs: 0.0858 Run rendetde04
At 500 docs: 0.0448 Comparison to median by topic
At 1000 docs: 0.0274
+1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.1678
+0.5
0.0
Difference (average precision)
−0.5
−1.0
101 105 110 115 120 125
Topic number
UC Berkeley, GIRT German to English, Auto, TD Run BKGRBLGE1
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 24 queries): 1.0
Query 101: 0.0139 Total number of documents
Query 102: 0.6606 over all queries
Query 103: 0.1848 Retrieved: 24000
Query 104: 0.3119 Relevant: 1235
Query 105: 0.4166 Rel_ret: 1100
0.8
Query 106: 0.9178
Query 107: 0.0516 Interpolated Recall -
Query 108: 0.6331 Precision Averages:
Query 109: 0.1544 at 0.00 0.7434
Query 110: 0.4638 at 0.10 0.6626 0.6
Query 111: 0.1097 at 0.20 0.5636
Query 113: 0.3669 at 0.30 0.5173
Query 114: 0.6507 at 0.40 0.4845
Precision
Query 115: 0.8458 at 0.50 0.4106
Query 116: 0.2237 at 0.60 0.3675 0.4
Query 117: 0.0857 at 0.70 0.3074
Query 118: 0.2415 at 0.80 0.2421
Query 119: 0.7454 at 0.90 0.1835
Query 120: 0.5478 at 1.00 0.0762
Query 121: 0.0253 0.2
Query 122: 0.3786 Avg. prec. (non-interpolated)
Query 123: 0.0000 for all rel. documents
Query 124: 0.7888 0.4053
Query 125: 0.9094 Precision:
At 5 docs: 0.5833 0.0
At 10 docs: 0.5750 0.0 0.2 0.4 0.6 0.8 1.0
At 15 docs: 0.5472
At 20 docs: 0.5083 Recall
At 30 docs: 0.4569
At 100 docs: 0.2829
At 200 docs: 0.1752 Run BKGRBLGE1
At 500 docs: 0.0828 Comparison to median by topic
At 1000 docs: 0.0458
+1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.3963
+0.5
0.0
Difference (average precision)
−0.5
−1.0
101 105 110 115 120 125
Topic number
UC Berkeley, GIRT German to English, Auto, TD Run BKGRBLGE2
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 24 queries): 1.0
Query 101: 0.0059 Total number of documents
Query 102: 0.6596 over all queries
Query 103: 0.1827 Retrieved: 24000
Query 104: 0.2688 Relevant: 1235
Query 105: 0.4514 Rel_ret: 1032
0.8
Query 106: 0.7495
Query 107: 0.4430 Interpolated Recall -
Query 108: 0.7310 Precision Averages:
Query 109: 0.0758 at 0.00 0.6386
Query 110: 0.3429 at 0.10 0.5398 0.6
Query 111: 0.1150 at 0.20 0.4737
Query 113: 0.0279 at 0.30 0.4260
Query 114: 0.1608 at 0.40 0.3748
Precision
Query 115: 0.5717 at 0.50 0.3218
Query 116: 0.0021 at 0.60 0.2733 0.4
Query 117: 0.0295 at 0.70 0.2156
Query 118: 0.4087 at 0.80 0.1280
Query 119: 0.0756 at 0.90 0.0818
Query 120: 0.4653 at 1.00 0.0203
Query 121: 0.0006 0.2
Query 122: 0.1997 Avg. prec. (non-interpolated)
Query 123: 0.0007 for all rel. documents
Query 124: 0.8504 0.3054
Query 125: 0.5110 Precision:
At 5 docs: 0.5083 0.0
At 10 docs: 0.4750 0.0 0.2 0.4 0.6 0.8 1.0
At 15 docs: 0.4444
At 20 docs: 0.4083 Recall
At 30 docs: 0.3806
At 100 docs: 0.2387
At 200 docs: 0.1538 Run BKGRBLGE2
At 500 docs: 0.0781 Comparison to median by topic
At 1000 docs: 0.0430
+1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.3177
+0.5
0.0
Difference (average precision)
−0.5
−1.0
101 105 110 115 120 125
Topic number
UC Berkeley, GIRT German to English, Auto, TD Run BKGRBLGE3
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 24 queries): 1.0
Query 101: 0.0046 Total number of documents
Query 102: 0.7079 over all queries
Query 103: 0.1844 Retrieved: 24000
Query 104: 0.2775 Relevant: 1235
Query 105: 0.3794 Rel_ret: 1058
0.8
Query 106: 0.8810
Query 107: 0.4211 Interpolated Recall -
Query 108: 0.6825 Precision Averages:
Query 109: 0.0850 at 0.00 0.7184
Query 110: 0.4300 at 0.10 0.5957 0.6
Query 111: 0.1303 at 0.20 0.5407
Query 113: 0.1694 at 0.30 0.4875
Query 114: 0.5389 at 0.40 0.4454
Precision
Query 115: 0.8168 at 0.50 0.3903
Query 116: 0.0048 at 0.60 0.3200 0.4
Query 117: 0.0669 at 0.70 0.2618
Query 118: 0.1518 at 0.80 0.2178
Query 119: 0.2013 at 0.90 0.1499
Query 120: 0.5654 at 1.00 0.0446
Query 121: 0.0004 0.2
Query 122: 0.3742 Avg. prec. (non-interpolated)
Query 123: 0.0007 for all rel. documents
Query 124: 0.8256 0.3668
Query 125: 0.9031 Precision:
At 5 docs: 0.5250 0.0
At 10 docs: 0.5292 0.0 0.2 0.4 0.6 0.8 1.0
At 15 docs: 0.5056
At 20 docs: 0.4729 Recall
At 30 docs: 0.4278
At 100 docs: 0.2650
At 200 docs: 0.1694 Run BKGRBLGE3
At 500 docs: 0.0806 Comparison to median by topic
At 1000 docs: 0.0441
+1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.3596
+0.5
0.0
Difference (average precision)
−0.5
−1.0
101 105 110 115 120 125
Topic number
UC Berkeley, GIRT German to English, Auto, TD Run BKGRBLGE4
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 24 queries): 1.0
Query 101: 0.0056 Total number of documents
Query 102: 0.7967 over all queries
Query 103: 0.1951 Retrieved: 24000
Query 104: 0.0645 Relevant: 1235
Query 105: 0.4514 Rel_ret: 1010
0.8
Query 106: 0.7337
Query 107: 0.3726 Interpolated Recall -
Query 108: 0.6805 Precision Averages:
Query 109: 0.1462 at 0.00 0.6348
Query 110: 0.0639 at 0.10 0.5394 0.6
Query 111: 0.1259 at 0.20 0.4894
Query 113: 0.0279 at 0.30 0.4300
Query 114: 0.6052 at 0.40 0.3948
Precision
Query 115: 0.7850 at 0.50 0.3609
Query 116: 0.0010 at 0.60 0.3172 0.4
Query 117: 0.0347 at 0.70 0.2471
Query 118: 0.3010 at 0.80 0.1868
Query 119: 0.0092 at 0.90 0.1083
Query 120: 0.5912 at 1.00 0.0280
Query 121: 0.0001 0.2
Query 122: 0.4640 Avg. prec. (non-interpolated)
Query 123: 0.0000 for all rel. documents
Query 124: 0.6670 0.3340
Query 125: 0.8926 Precision:
At 5 docs: 0.5083 0.0
At 10 docs: 0.4917 0.0 0.2 0.4 0.6 0.8 1.0
At 15 docs: 0.4417
At 20 docs: 0.4333 Recall
At 30 docs: 0.4125
At 100 docs: 0.2612
At 200 docs: 0.1575 Run BKGRBLGE4
At 500 docs: 0.0766 Comparison to median by topic
At 1000 docs: 0.0421
+1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.3383
+0.5
0.0
Difference (average precision)
−0.5
−1.0
101 105 110 115 120 125
Topic number
UC Berkeley, GIRT German to English, Auto, TD Run BKGRBLGE5
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 24 queries): 1.0
Query 101: 0.0051 Total number of documents
Query 102: 0.7645 over all queries
Query 103: 0.1753 Retrieved: 24000
Query 104: 0.4721 Relevant: 1235
Query 105: 0.3531 Rel_ret: 968
0.8
Query 106: 0.7516
Query 107: 0.1194 Interpolated Recall -
Query 108: 0.6713 Precision Averages:
Query 109: 0.0930 at 0.00 0.6312
Query 110: 0.2925 at 0.10 0.5184 0.6
Query 111: 0.0827 at 0.20 0.4916
Query 113: 0.3015 at 0.30 0.4567
Query 114: 0.0237 at 0.40 0.4035
Precision
Query 115: 0.7739 at 0.50 0.3691
Query 116: 0.0011 at 0.60 0.3095 0.4
Query 117: 0.0451 at 0.70 0.2533
Query 118: 0.4116 at 0.80 0.1959
Query 119: 0.8369 at 0.90 0.1468
Query 120: 0.0134 at 1.00 0.0442
Query 121: 0.0004 0.2
Query 122: 0.2404 Avg. prec. (non-interpolated)
Query 123: 0.0238 for all rel. documents
Query 124: 0.7597 0.3370
Query 125: 0.8764 Precision:
At 5 docs: 0.5000 0.0
At 10 docs: 0.4792 0.0 0.2 0.4 0.6 0.8 1.0
At 15 docs: 0.4472
At 20 docs: 0.4167 Recall
At 30 docs: 0.4042
At 100 docs: 0.2458
At 200 docs: 0.1560 Run BKGRBLGE5
At 500 docs: 0.0747 Comparison to median by topic
At 1000 docs: 0.0403
+1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.3279
+0.5
0.0
Difference (average precision)
−0.5
−1.0
101 105 110 115 120 125
Topic number
UC Berkeley, GIRT English to English, Auto, TD Run BKGRMLEE1
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 24 queries): 1.0
Query 101: 0.0064 Total number of documents
Query 102: 0.7936 over all queries
Query 103: 0.0891 Retrieved: 24000
Query 104: 0.1997 Relevant: 1235
Query 105: 0.6470 Rel_ret: 1162
0.8
Query 106: 0.5990
Query 107: 0.1470 Interpolated Recall -
Query 108: 0.6666 Precision Averages:
Query 109: 0.0908 at 0.00 0.7644
Query 110: 0.1749 at 0.10 0.6066 0.6
Query 111: 0.0977 at 0.20 0.5131
Query 113: 0.3077 at 0.30 0.4577
Query 114: 0.7757 at 0.40 0.4205
Precision
Query 115: 0.8503 at 0.50 0.3830
Query 116: 0.1707 at 0.60 0.3415 0.4
Query 117: 0.0234 at 0.70 0.2752
Query 118: 0.3991 at 0.80 0.2173
Query 119: 0.1834 at 0.90 0.1619
Query 120: 0.6136 at 1.00 0.0495
Query 121: 0.1608 0.2
Query 122: 0.1921 Avg. prec. (non-interpolated)
Query 123: 0.0260 for all rel. documents
Query 124: 0.9187 0.3732
Query 125: 0.8241 Precision:
At 5 docs: 0.5917 0.0
At 10 docs: 0.5333 0.0 0.2 0.4 0.6 0.8 1.0
At 15 docs: 0.4972
At 20 docs: 0.4729 Recall
At 30 docs: 0.4458
At 100 docs: 0.2696
At 200 docs: 0.1769 Run BKGRMLEE1
At 500 docs: 0.0891 Comparison to median by topic
At 1000 docs: 0.0484
+1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.3589
+0.5
0.0
Difference (average precision)
−0.5
−1.0
101 105 110 115 120 125
Topic number
UC Berkeley, GIRT English to English, Auto, TD Run BKGRMLEE2
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 24 queries): 1.0
Query 101: 0.0069 Total number of documents
Query 102: 0.6686 over all queries
Query 103: 0.1297 Retrieved: 24000
Query 104: 0.2222 Relevant: 1235
Query 105: 0.6652 Rel_ret: 1170
0.8
Query 106: 0.4064
Query 107: 0.2286 Interpolated Recall -
Query 108: 0.7099 Precision Averages:
Query 109: 0.1202 at 0.00 0.7767
Query 110: 0.1511 at 0.10 0.6488 0.6
Query 111: 0.0725 at 0.20 0.5271
Query 113: 0.4353 at 0.30 0.4882
Query 114: 0.7089 at 0.40 0.4516
Precision
Query 115: 0.9229 at 0.50 0.3936
Query 116: 0.1672 at 0.60 0.3486 0.4
Query 117: 0.0240 at 0.70 0.2933
Query 118: 0.4753 at 0.80 0.2275
Query 119: 0.3203 at 0.90 0.1592
Query 120: 0.5674 at 1.00 0.0593
Query 121: 0.3453 0.2
Query 122: 0.2580 Avg. prec. (non-interpolated)
Query 123: 0.0431 for all rel. documents
Query 124: 0.9095 0.3908
Query 125: 0.8205 Precision:
At 5 docs: 0.5917 0.0
At 10 docs: 0.5375 0.0 0.2 0.4 0.6 0.8 1.0
At 15 docs: 0.5194
At 20 docs: 0.5000 Recall
At 30 docs: 0.4583
At 100 docs: 0.2983
At 200 docs: 0.1940 Run BKGRMLEE2
At 500 docs: 0.0907 Comparison to median by topic
At 1000 docs: 0.0488
+1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.3766
+0.5
0.0
Difference (average precision)
−0.5
−1.0
101 105 110 115 120 125
Topic number
FU Hagen, GIRT German to English, Auto, TD Run FUHe1
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 24 queries): 1.0
Query 101: 0.0000 Total number of documents
Query 102: 0.0753 over all queries
Query 103: 0.0000 Retrieved: 18006
Query 104: 0.0973 Relevant: 1235 0.8
Query 105: 0.0073 Rel_ret: 164
Query 106: 0.2444
Query 107: 0.0133 Interpolated Recall -
Query 108: 0.1504 Precision Averages:
Query 109: 0.0028 at 0.00 0.3208
Query 110: 0.0071 at 0.10 0.1361 0.6
Query 111: 0.0072 at 0.20 0.0628
Query 113: 0.0007 at 0.30 0.0135
Query 114: 0.0003 at 0.40 0.0054
Precision
Query 115: 0.0086 at 0.50 0.0000
Query 116: 0.0088 at 0.60 0.0000 0.4
Query 117: 0.0043 at 0.70 0.0000
Query 118: 0.0323 at 0.80 0.0000
Query 119: 0.1224 at 0.90 0.0000
Query 120: 0.0012 at 1.00 0.0000
Query 121: 0.0003 0.2
Query 122: 0.0007 Avg. prec. (non-interpolated)
Query 123: 0.0000 for all rel. documents
Query 124: 0.0570 0.0351
Query 125: 0.0000 Precision:
At 5 docs: 0.1750 0.0
At 10 docs: 0.1583 0.0 0.2 0.4 0.6 0.8 1.0
At 15 docs: 0.1222
At 20 docs: 0.0979 Recall
At 30 docs: 0.0819
At 100 docs: 0.0346
At 200 docs: 0.0246 Run FUHe1
At 500 docs: 0.0115 Comparison to median by topic
At 1000 docs: 0.0068
+1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.0528
+0.5
0.0
Difference (average precision)
−0.5
−1.0
101 105 110 115 120 125
Topic number
FU Hagen, GIRT German to English, Auto, TD Run FUHe2
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 24 queries): 1.0
Query 101: 0.0000 Total number of documents
Query 102: 0.0633 over all queries
Query 103: 0.0000 Retrieved: 18252
Query 104: 0.1192 Relevant: 1235 0.8
Query 105: 0.0068 Rel_ret: 164
Query 106: 0.2667
Query 107: 0.0129 Interpolated Recall -
Query 108: 0.1607 Precision Averages:
Query 109: 0.0028 at 0.00 0.3169
Query 110: 0.0071 at 0.10 0.1405 0.6
Query 111: 0.0067 at 0.20 0.0638
Query 113: 0.0007 at 0.30 0.0131
Query 114: 0.0003 at 0.40 0.0058
Precision
Query 115: 0.0090 at 0.50 0.0000
Query 116: 0.0087 at 0.60 0.0000 0.4
Query 117: 0.0006 at 0.70 0.0000
Query 118: 0.0336 at 0.80 0.0000
Query 119: 0.1258 at 0.90 0.0000
Query 120: 0.0036 at 1.00 0.0000
Query 121: 0.0005 0.2
Query 122: 0.0012 Avg. prec. (non-interpolated)
Query 123: 0.0000 for all rel. documents
Query 124: 0.0549 0.0369
Query 125: 0.0000 Precision:
At 5 docs: 0.2083 0.0
At 10 docs: 0.1667 0.0 0.2 0.4 0.6 0.8 1.0
At 15 docs: 0.1306
At 20 docs: 0.1062 Recall
At 30 docs: 0.0778
At 100 docs: 0.0367
At 200 docs: 0.0242 Run FUHe2
At 500 docs: 0.0117 Comparison to median by topic
At 1000 docs: 0.0068
+1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.0553
+0.5
0.0
Difference (average precision)
−0.5
−1.0
101 105 110 115 120 125
Topic number
FU Hagen, GIRT German to English, Auto, TD Run FUHe3
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 24 queries): 1.0
Query 101: 0.0000 Total number of documents
Query 102: 0.0633 over all queries
Query 103: 0.0000 Retrieved: 18911
Query 104: 0.1128 Relevant: 1235 0.8
Query 105: 0.0068 Rel_ret: 165
Query 106: 0.2667
Query 107: 0.0129 Interpolated Recall -
Query 108: 0.1607 Precision Averages:
Query 109: 0.0028 at 0.00 0.3146
Query 110: 0.0071 at 0.10 0.1395 0.6
Query 111: 0.0071 at 0.20 0.0652
Query 113: 0.0007 at 0.30 0.0132
Query 114: 0.0003 at 0.40 0.0057
Precision
Query 115: 0.0082 at 0.50 0.0000
Query 116: 0.0103 at 0.60 0.0000 0.4
Query 117: 0.0006 at 0.70 0.0000
Query 118: 0.0336 at 0.80 0.0000
Query 119: 0.1258 at 0.90 0.0000
Query 120: 0.0027 at 1.00 0.0000
Query 121: 0.0003 0.2
Query 122: 0.0007 Avg. prec. (non-interpolated)
Query 123: 0.0000 for all rel. documents
Query 124: 0.0534 0.0365
Query 125: 0.0000 Precision:
At 5 docs: 0.2083 0.0
At 10 docs: 0.1625 0.0 0.2 0.4 0.6 0.8 1.0
At 15 docs: 0.1278
At 20 docs: 0.1042 Recall
At 30 docs: 0.0792
At 100 docs: 0.0358
At 200 docs: 0.0244 Run FUHe3
At 500 docs: 0.0118 Comparison to median by topic
At 1000 docs: 0.0069
+1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.0548
+0.5
0.0
Difference (average precision)
−0.5
−1.0
101 105 110 115 120 125
Topic number
FU Hagen, GIRT German to English, Auto, TD Run FUHe4
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 24 queries): 1.0
Query 101: 0.0000 Total number of documents
Query 102: 0.0633 over all queries
Query 103: 0.0000 Retrieved: 18735
Query 104: 0.1128 Relevant: 1235 0.8
Query 105: 0.0068 Rel_ret: 165
Query 106: 0.2667
Query 107: 0.0129 Interpolated Recall -
Query 108: 0.1607 Precision Averages:
Query 109: 0.0028 at 0.00 0.3174
Query 110: 0.0071 at 0.10 0.1395 0.6
Query 111: 0.0071 at 0.20 0.0652
Query 113: 0.0007 at 0.30 0.0132
Query 114: 0.0003 at 0.40 0.0057
Precision
Query 115: 0.0090 at 0.50 0.0000
Query 116: 0.0103 at 0.60 0.0000 0.4
Query 117: 0.0006 at 0.70 0.0000
Query 118: 0.0336 at 0.80 0.0000
Query 119: 0.1258 at 0.90 0.0000
Query 120: 0.0036 at 1.00 0.0000
Query 121: 0.0005 0.2
Query 122: 0.0012 Avg. prec. (non-interpolated)
Query 123: 0.0000 for all rel. documents
Query 124: 0.0534 0.0366
Query 125: 0.0000 Precision:
At 5 docs: 0.2083 0.0
At 10 docs: 0.1667 0.0 0.2 0.4 0.6 0.8 1.0
At 15 docs: 0.1306
At 20 docs: 0.1062 Recall
At 30 docs: 0.0792
At 100 docs: 0.0367
At 200 docs: 0.0246 Run FUHe4
At 500 docs: 0.0118 Comparison to median by topic
At 1000 docs: 0.0069
+1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.0553
+0.5
0.0
Difference (average precision)
−0.5
−1.0
101 105 110 115 120 125
Topic number
FU Hagen, GIRT German to English, Auto, TD Run FUHe5
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 24 queries): 1.0
Query 101: 0.0000 Total number of documents
Query 102: 0.1269 over all queries
Query 103: 0.0000 Retrieved: 12766
Query 104: 0.0991 Relevant: 1235
Query 105: 0.0592 Rel_ret: 156
0.8
Query 106: 0.0020
Query 107: 0.0024 Interpolated Recall -
Query 108: 0.1397 Precision Averages:
Query 109: 0.0012 at 0.00 0.3192
Query 110: 0.0005 at 0.10 0.0950 0.6
Query 111: 0.0027 at 0.20 0.0325
Query 113: 0.0007 at 0.30 0.0116
Query 114: 0.0102 at 0.40 0.0078
Precision
Query 115: 0.0104 at 0.50 0.0000
Query 116: 0.0010 at 0.60 0.0000 0.4
Query 117: 0.0034 at 0.70 0.0000
Query 118: 0.0132 at 0.80 0.0000
Query 119: 0.0497 at 0.90 0.0000
Query 120: 0.0016 at 1.00 0.0000
Query 121: 0.0002 0.2
Query 122: 0.0013 Avg. prec. (non-interpolated)
Query 123: 0.0000 for all rel. documents
Query 124: 0.0249 0.0229
Query 125: 0.0002 Precision:
At 5 docs: 0.1167 0.0
At 10 docs: 0.1167 0.0 0.2 0.4 0.6 0.8 1.0
At 15 docs: 0.1083
At 20 docs: 0.1021 Recall
At 30 docs: 0.0764
At 100 docs: 0.0387
At 200 docs: 0.0258 Run FUHe5
At 500 docs: 0.0129 Comparison to median by topic
At 1000 docs: 0.0065
+1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.0477
+0.5
0.0
Difference (average precision)
−0.5
−1.0
101 105 110 115 120 125
Topic number
IRIT, GIRT English to English, Auto, T Run run1T
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 24 queries): 1.0
Query 101: 0.0238 Total number of documents
Query 102: 0.4941 over all queries
Query 103: 0.0122 Retrieved: 21681
Query 104: 0.3279 Relevant: 1235 0.8
Query 105: 0.4775 Rel_ret: 1013
Query 106: 1.0000
Query 107: 0.0214 Interpolated Recall -
Query 108: 0.5247 Precision Averages:
Query 109: 0.3295 at 0.00 0.7741
Query 110: 0.2722 at 0.10 0.6067 0.6
Query 111: 0.2782 at 0.20 0.5644
Query 113: 0.6721 at 0.30 0.5073
Query 114: 0.7412 at 0.40 0.4438
Precision
Query 115: 0.7088 at 0.50 0.4024
Query 116: 0.0289 at 0.60 0.3264 0.4
Query 117: 0.0563 at 0.70 0.2513
Query 118: 0.2732 at 0.80 0.1973
Query 119: 0.1239 at 0.90 0.1223
Query 120: 0.1619 at 1.00 0.0616
Query 121: 0.3744 0.2
Query 122: 0.1419 Avg. prec. (non-interpolated)
Query 123: 0.2955 for all rel. documents
Query 124: 0.9233 0.3740
Query 125: 0.7140 Precision:
At 5 docs: 0.6000 0.0
At 10 docs: 0.5625 0.0 0.2 0.4 0.6 0.8 1.0
At 15 docs: 0.5250
At 20 docs: 0.4917 Recall
At 30 docs: 0.4444
At 100 docs: 0.2475
At 200 docs: 0.1448 Run run1T
At 500 docs: 0.0743 Comparison to median by topic
At 1000 docs: 0.0422
+1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.3974
+0.5
0.0
Difference (average precision)
−0.5
−1.0
101 105 110 115 120 125
Topic number
IRIT, GIRT English to English, Auto, TD Run run2TD
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 24 queries): 1.0
Query 101: 0.0130 Total number of documents
Query 102: 0.4803 over all queries
Query 103: 0.0096 Retrieved: 24000
Query 104: 0.4040 Relevant: 1235 0.8
Query 105: 0.5007 Rel_ret: 1097
Query 106: 1.0000
Query 107: 0.0969 Interpolated Recall -
Query 108: 0.5278 Precision Averages:
Query 109: 0.2183 at 0.00 0.7612
Query 110: 0.3102 at 0.10 0.6161 0.6
Query 111: 0.2218 at 0.20 0.5437
Query 113: 0.5887 at 0.30 0.5162
Query 114: 0.7484 at 0.40 0.4580
Precision
Query 115: 0.7893 at 0.50 0.4127
Query 116: 0.1422 at 0.60 0.3671 0.4
Query 117: 0.1079 at 0.70 0.3029
Query 118: 0.4848 at 0.80 0.2176
Query 119: 0.0815 at 0.90 0.1253
Query 120: 0.4658 at 1.00 0.0564
Query 121: 0.0568 0.2
Query 122: 0.2820 Avg. prec. (non-interpolated)
Query 123: 0.0421 for all rel. documents
Query 124: 0.9266 0.3855
Query 125: 0.7524 Precision:
At 5 docs: 0.5750 0.0
At 10 docs: 0.5375 0.0 0.2 0.4 0.6 0.8 1.0
At 15 docs: 0.5306
At 20 docs: 0.5125 Recall
At 30 docs: 0.4556
At 100 docs: 0.2650
At 200 docs: 0.1650 Run run2TD
At 500 docs: 0.0831 Comparison to median by topic
At 1000 docs: 0.0457
+1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.3836
+0.5
0.0
Difference (average precision)
−0.5
−1.0
101 105 110 115 120 125
Topic number
IRIT, GIRT English to English, Auto, TD Run run3TDfc
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 24 queries): 1.0
Query 101: 0.0130 Total number of documents
Query 102: 0.3019 over all queries
Query 103: 0.0110 Retrieved: 24000
Query 104: 0.4222 Relevant: 1235 0.8
Query 105: 0.4990 Rel_ret: 1080
Query 106: 1.0000
Query 107: 0.0948 Interpolated Recall -
Query 108: 0.5278 Precision Averages:
Query 109: 0.2183 at 0.00 0.7592
Query 110: 0.3102 at 0.10 0.6135 0.6
Query 111: 0.2218 at 0.20 0.5372
Query 113: 0.5887 at 0.30 0.4717
Query 114: 0.7142 at 0.40 0.4275
Precision
Query 115: 0.7893 at 0.50 0.3967
Query 116: 0.1422 at 0.60 0.3473 0.4
Query 117: 0.0908 at 0.70 0.2907
Query 118: 0.4848 at 0.80 0.2306
Query 119: 0.0831 at 0.90 0.1361
Query 120: 0.3233 at 1.00 0.0682
Query 121: 0.0568 0.2
Query 122: 0.2820 Avg. prec. (non-interpolated)
Query 123: 0.0421 for all rel. documents
Query 124: 0.9260 0.3764
Query 125: 0.8915 Precision:
At 5 docs: 0.5750 0.0
At 10 docs: 0.5292 0.0 0.2 0.4 0.6 0.8 1.0
At 15 docs: 0.5111
At 20 docs: 0.4938 Recall
At 30 docs: 0.4389
At 100 docs: 0.2621
At 200 docs: 0.1648 Run run3TDfc
At 500 docs: 0.0825 Comparison to median by topic
At 1000 docs: 0.0450
+1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.3817
+0.5
0.0
Difference (average precision)
−0.5
−1.0
101 105 110 115 120 125
Topic number
IRIT, GIRT English to English, Auto, TD Run run4TDWN
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 24 queries): 1.0
Query 101: 0.0101 Total number of documents
Query 102: 0.4819 over all queries
Query 103: 0.0280 Retrieved: 24000
Query 104: 0.2655 Relevant: 1235 0.8
Query 105: 0.6110 Rel_ret: 1106
Query 106: 1.0000
Query 107: 0.1405 Interpolated Recall -
Query 108: 0.4354 Precision Averages:
Query 109: 0.2183 at 0.00 0.7817
Query 110: 0.3315 at 0.10 0.6164 0.6
Query 111: 0.2123 at 0.20 0.5030
Query 113: 0.1767 at 0.30 0.4806
Query 114: 0.7483 at 0.40 0.4101
Precision
Query 115: 0.7859 at 0.50 0.3753
Query 116: 0.1040 at 0.60 0.3389 0.4
Query 117: 0.1136 at 0.70 0.2723
Query 118: 0.4532 at 0.80 0.1946
Query 119: 0.0830 at 0.90 0.1096
Query 120: 0.4722 at 1.00 0.0588
Query 121: 0.0916 0.2
Query 122: 0.2820 Avg. prec. (non-interpolated)
Query 123: 0.0380 for all rel. documents
Query 124: 0.8995 0.3640
Query 125: 0.7524 Precision:
At 5 docs: 0.5917 0.0
At 10 docs: 0.5333 0.0 0.2 0.4 0.6 0.8 1.0
At 15 docs: 0.5083
At 20 docs: 0.4833 Recall
At 30 docs: 0.4333
At 100 docs: 0.2587
At 200 docs: 0.1633 Run run4TDWN
At 500 docs: 0.0839 Comparison to median by topic
At 1000 docs: 0.0461
+1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.3663
+0.5
0.0
Difference (average precision)
−0.5
−1.0
101 105 110 115 120 125
Topic number
IRIT, GIRT English to English, Auto, T Run run4TWN
Average precision Overall statistics Recall−Precision Values
(individual queries): (for 24 queries): 1.0
Query 101: 0.0238 Total number of documents
Query 102: 0.4941 over all queries
Query 103: 0.0106 Retrieved: 21907
Query 104: 0.3279 Relevant: 1235 0.8
Query 105: 0.4775 Rel_ret: 1014
Query 106: 1.0000
Query 107: 0.0170 Interpolated Recall -
Query 108: 0.5247 Precision Averages:
Query 109: 0.3592 at 0.00 0.7665
Query 110: 0.3012 at 0.10 0.6145 0.6
Query 111: 0.2782 at 0.20 0.5691
Query 113: 0.6794 at 0.30 0.5073
Query 114: 0.7412 at 0.40 0.4493
Precision
Query 115: 0.7110 at 0.50 0.3981
Query 116: 0.0289 at 0.60 0.3256 0.4
Query 117: 0.0563 at 0.70 0.2525
Query 118: 0.2716 at 0.80 0.1970
Query 119: 0.1236 at 0.90 0.1207
Query 120: 0.1658 at 1.00 0.0603
Query 121: 0.3788 0.2
Query 122: 0.1418 Avg. prec. (non-interpolated)
Query 123: 0.2803 for all rel. documents
Query 124: 0.9233 0.3764
Query 125: 0.7172 Precision:
At 5 docs: 0.6083 0.0
At 10 docs: 0.5667 0.0 0.2 0.4 0.6 0.8 1.0
At 15 docs: 0.5250
At 20 docs: 0.4917 Recall
At 30 docs: 0.4444
At 100 docs: 0.2467
At 200 docs: 0.1446 Run run4TWN
At 500 docs: 0.0745 Comparison to median by topic
At 1000 docs: 0.0422
+1.0
R-Precision (prec. after R
(=num_rel) docs. retrieved):
Exact: 0.3961
+0.5
0.0
Difference (average precision)
−0.5
−1.0
101 105 110 115 120 125
Topic number