Results for CLEF 2005 GeoCLEF Tracks List of Submitted Runs
B.7 alicante alicante alicante alicante alicante alicante alicante alicante alicante alicante alicante alicante alicante alicante alicante alicante alicante alicante alicante alicante alicante alicante alicante alicante alicante alicante alicante alicante alicante alicante alicante alicante alicante alicante berkeley berkeley berkeley berkeley berkeley berkeley berkeley berkeley berkeley berkeley berkeley-2 berkeley-2 berkeley-2 berkeley-2 berkeley-2 berkeley-2 berkeley-2 berkeley-2 berkeley-2 berkeley-2 berkeley-2 berkeley-2 automatic automatic automatic automatic automatic automatic automatic automatic automatic automatic automatic automatic automatic automatic automatic automatic automatic automatic automatic automatic automatic automatic automatic automatic automatic automatic automatic automatic automatic automatic automatic automatic automatic automatic automatic automatic automatic automatic automatic automatic automatic automatic automatic automatic automatic automatic automatic manual automatic automatic automatic automatic automatic manual automatic automatic yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes automatic automatic automatic automatic automatic automatic automatic automatic automatic manual manual manual manual automatic manual manual manual manual manual manual manual automatic automatic automatic automatic automatic automatic automatic automatic automatic automatic automatic automatic automatic automatic automatic automatic automatic automatic automatic automatic automatic automatic automatic automatic automatic automatic manual manual manual manual automatic automatic manual manual manual yes yes yes yes yes yes yes yes yes no no no no no no no no no no no no no no no no yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes GC-Bilingual-X2DE 40% 30% 20% 10% 0%
5 0% 0% 10% 20% 30%
30 100 200 Retrieved Documents (logarithmic scale) 500 1000 CLEF 2005 − Top 3 participants of GeoCLEF Bilingual X2DE − Comparison to median by topic (topics 14 to 25) 1 14 15 16 17 18 GC-Bilingual-X2DE 40% 30% 20% 10% 0%
5 0% 0% 10% 20% 30%
30 100 200 Retrieved Documents (logarithmic scale) 500 1000 40% 30% 20% 10% 0%
5 0% 0% 10% 20% 30%
30 100 200 Retrieved Documents (logarithmic scale) 500 1000 GC-Bilingual-X2EN metacarta 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 GC−Monolingual−EN − Retrieved documents vs Precision 10 15 20 30 100 200
Retrieved Documents (logarithmic scale) 500 1000
CLEF 2005 GC−Monolingual−EN − Comparison to median by topic (topics 1 to 13) −1 1 6
7 Topic Number
8 2 3 4 5 9 10 11 12 13
CLEF 2005 GC−Monolingual−EN − Comparison to median by topic (topics 14 to 25) 14 15 16 17 18 21 22 23 24
25
0%0% 0%5 0 10 20 30 40 50 60 70 80 90 100 GC-Monolingual-EN 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 GC−Monolingual−EN − Retrieved documents vs Precision 10 15 20 30 100 200
Retrieved Documents (logarithmic scale) 500 1000
CLEF 2005 GC−Monolingual−EN − Comparison to median by topic (topics 1 to 13) 1 2 3 4 5 9 10 11 12
13 6
7 Topic Number
8
CLEF 2005 GC−Monolingual−EN − Comparison to median by topic (topics 14 to 25) 14 15 16 17 18 21 22 23 24
25 19 20 Topic Number R-Precision (precision after R document retrieved, where R = Relevant retrieved) Precision averages (%) for individual queries Topic 001 Topic 002 Topic 003 Topic 004 Topic 005 Topic 006 Topic 007 Topic 008 Topic 009 Topic 010 Topic 011 Topic 012 Topic 013 25.19 14.86 2.38 15.83 39.77 17.20 1.60 4.55 9.16 0.71 0.87 1.14 14.66
Topic 014 Topic 015 Topic 016 Topic 017 Topic 018 Topic 019 Topic 020 Topic 021 Topic 022 Topic 023 Topic 024 Topic 025 0%5 0 10 20 30 40 50 60 70 80 90 100 GC-Monolingual-EN 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 GC−Monolingual−EN − Retrieved documents vs Precision 10 15 20 30 100 200
Retrieved Documents (logarithmic scale) 500 1000
CLEF 2005 GC−Monolingual−EN − Comparison to median by topic (topics 1 to 13) 1 2 3 4 5 9 10 11 12
13 6
7 Topic Number
8
CLEF 2005 GC−Monolingual−EN − Comparison to median by topic (topics 14 to 25) 14 15 16 17 18 21 22 23 24
25 19 20 Topic Number R-Precision (precision after R document retrieved, where R = Relevant retrieved) Precision averages (%) for individual queries Topic 001 Topic 002 Topic 003 Topic 004 Topic 005 Topic 006 Topic 007 Topic 008 Topic 009 Topic 010 Topic 011 Topic 012 Topic 013
0%0% 0%5 0 10 20 30 40 50 60 70 80 90 100 GC-Monolingual-EN 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 GC−Monolingual−EN − Retrieved documents vs Precision 10 15 20 30 100 200
Retrieved Documents (logarithmic scale) 500 1000
CLEF 2005 GC−Monolingual−EN − Comparison to median by topic (topics 1 to 13) 1 2 3 4 5 9 10 11 12
13 6
7 Topic Number
8
CLEF 2005 GC−Monolingual−EN − Comparison to median by topic (topics 14 to 25) 14 15 16 17 18 21 22 23 24
25 19 20 Topic Number R-Precision (precision after R document retrieved, where R = Relevant retrieved) Precision averages (%) for individual queries Topic 001 Topic 002 Topic 003 Topic 004 Topic 005 Topic 006 Topic 007 Topic 008 Topic 009 Topic 010 Topic 011 Topic 012 Topic 013
0%0% 0%5 0 10 20 30 40 50 60 70 80 90 100 GC-Monolingual-EN 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 GC−Monolingual−EN − Retrieved documents vs Precision 10 15 20 30 100 200
Retrieved Documents (logarithmic scale) 500 1000
CLEF 2005 GC−Monolingual−EN − Comparison to median by topic (topics 1 to 13) 1 2 3 4 5 9 10 11 12
13 6
7 Topic Number
8
CLEF 2005 GC−Monolingual−EN − Comparison to median by topic (topics 14 to 25) 14 15 16 17 18 21 22 23 24
25 19 20 Topic Number R-Precision (precision after R document retrieved, where R = Relevant retrieved) Precision averages (%) for individual queries Topic 001 Topic 002 Topic 003 Topic 004 Topic 005 Topic 006 Topic 007 Topic 008 Topic 009 Topic 010 Topic 011 Topic 012 Topic 013
0%0% 0%5 0 10 20 30 40 50 60 70 80 90 100 GC-Monolingual-EN 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 GC−Monolingual−EN − Retrieved documents vs Precision 10 15 20 30 100 200
Retrieved Documents (logarithmic scale) 500 1000
CLEF 2005 GC−Monolingual−EN − Comparison to median by topic (topics 1 to 13) 6
7 Topic Number
8 2 3 4 5 9 10 11 12 13
CLEF 2005 GC−Monolingual−EN − Comparison to median by topic (topics 14 to 25) 14 15 16 17 18 21 22 23 24
25 19 20 Topic Number R-Precision (precision after R document retrieved, where R = Relevant retrieved) Precision averages (%) for individual queries Topic 001 Topic 002 Topic 003 Topic 004 Topic 005 Topic 006 Topic 007 Topic 008 Topic 009 Topic 010 Topic 011 Topic 012 Topic 013
0%0% 100% 90% 80% 70% 0%5 0 10 20 30 40 50 60 70 80 90 100 ) n isco 0.5 i e r p e g rvea 0 a ( e c n ree−0.5 iff D −1 Average precision (non-interpolated) for all relevant documents (averaged over queries) LGCenNCS LGCenNCS
LGCenNCS LGCenNCS nicta i2d2Run1 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 GC−Monolingual−EN − Retrieved documents vs Precision 10 15 20 30 100 200
Retrieved Documents (logarithmic scale) 500 1000
CLEF 2005 GC−Monolingual−EN − Comparison to median by topic (topics 1 to 13) 6
7 Topic Number
8 2 3 4 5 9 10 11 12 13
CLEF 2005 GC−Monolingual−EN − Comparison to median by topic (topics 14 to 25) 14 15 16 17 18 21 22 23 24
25 19 20 Topic Number R-Precision (precision after R document retrieved, where R = Relevant retrieved) Precision averages (%) for individual queries Topic 001 Topic 002 Topic 003 Topic 004 Topic 005 Topic 006 Topic 007 Topic 008 Topic 009 Topic 010 Topic 011 Topic 012 Topic 013
0%0% 100% 90% 80% 70% 0%5 0 10 20 30 40 50 60 70 80 90 100 ) n isco 0.5 i e r p e g rvea 0 a ( e c n ree−0.5 iff D −1 Average precision (non-interpolated) for all relevant documents (averaged over queries) i2d2Run1 i2d2Run1 i2d2Run1 i2d2Run1 nicta i2d2Run2 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
CLEF 2005 GC−Monolingual−EN − Retrieved documents vs Precision 10 15 20 30 100 200
Retrieved Documents (logarithmic scale) 500 1000
CLEF 2005 GC−Monolingual−EN − Comparison to median by topic (topics 1 to 13) 6
7 Topic Number
8 2 3 4 5 9 10 11 12 13
CLEF 2005 GC−Monolingual−EN − Comparison to median by topic (topics 14 to 25) 14 15 16 17 18 21 22 23 24
25 19 20 Topic Number R-Precision (precision after R document retrieved, where R = Relevant retrieved) Precision averages (%) for individual queries Topic 001 Topic 002 Topic 003 Topic 004 Topic 005 Topic 006 Topic 007 Topic 008 Topic 009 Topic 010 Topic 011 Topic 012 Topic 013 0%5 0 10 20 30 40 50 60 70 80 90 100 ) n isco 0.5 i e r p e g rvea 0 a ( e c n ree−0.5 iff D −1 Average precision (non-interpolated) for all relevant documents (averaged over queries) i2d2Run2 i2d2Run2 i2d2Run2 i2d2Run2 nicta i2d2Run3 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
Precision at DCL (%)
CLEF 2005 GC−Monolingual−EN − Retrieved documents vs Precision 10 15 20 30 100 200
Retrieved Documents (logarithmic scale) 500 1000
CLEF 2005 GC−Monolingual−EN − Comparison to median by topic (topics 1 to 13) 6
7 Topic Number
8 2 3 4 5 9 10 11 12 13
CLEF 2005 GC−Monolingual−EN − Comparison to median by topic (topics 14 to 25) 14 15 16 17 18 21 22 23 24
25 19 20 Topic Number R-Precision (precision after R document retrieved, where R = Relevant retrieved) Precision averages (%) for individual queries Topic 001 Topic 002 Topic 003 Topic 004 Topic 005 Topic 006 Topic 007 Topic 008 Topic 009 Topic 010 Topic 011 Topic 012 Topic 013 0%5 0 10 20 30 40 50 60 70 80 90 100 ) n isco 0.5 i e r p e g rvea 0 a ( e c n ree−0.5 iff D −1 Average precision (non-interpolated) for all relevant documents (averaged over queries) i2d2Run3 i2d2Run3 i2d2Run3 i2d2Run3 nicta i2d2Run4 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
Precision at DCL (%)
CLEF 2005 GC−Monolingual−EN − Retrieved documents vs Precision 10 15 20 30 100 200
Retrieved Documents (logarithmic scale) 500 1000
CLEF 2005 GC−Monolingual−EN − Comparison to median by topic (topics 1 to 13) 6
7 Topic Number
8 2 3 4 5 9 10 11 12 13
CLEF 2005 GC−Monolingual−EN − Comparison to median by topic (topics 14 to 25) 14 15 16 17 18 21 22 23 24
25 19 20 Topic Number R-Precision (precision after R document retrieved, where R = Relevant retrieved) Precision averages (%) for individual queries Topic 001 Topic 002 Topic 003 Topic 004 Topic 005 Topic 006 Topic 007 Topic 008 Topic 009 Topic 010 Topic 011 Topic 012 Topic 013 0%5 0 10 20 30 40 50 60 70 80 90 100 ) n isco 0.5 i e r p e g rvea 0 a ( e c n ree−0.5 iff D −1 Average precision (non-interpolated) for all relevant documents (averaged over queries) i2d2Run4 i2d2Run4 i2d2Run4 i2d2Run4 talp 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
Precision at DCL (%)
CLEF 2005 GC−Monolingual−EN − Retrieved documents vs Precision 10 15 20 30 100 200
Retrieved Documents (logarithmic scale) 500 1000
CLEF 2005 GC−Monolingual−EN − Comparison to median by topic (topics 1 to 13) 1 2 3 4 5 9 10 11 12
13 6
7 Topic Number
8
CLEF 2005 GC−Monolingual−EN − Comparison to median by topic (topics 14 to 25) 14 15 16 17 18 21 22 23 24
25 19 20 Topic Number R-Precision (precision after R document retrieved, where R = Relevant retrieved) Precision averages (%) for individual queries Topic 001 Topic 002 Topic 003 Topic 004 Topic 005 Topic 006 Topic 007 Topic 008 Topic 009 Topic 010 Topic 011 Topic 012 Topic 013 0%5 0 10 20 30 40 50 60 70 80 90 100 −1 1 ) n isco 0.5 i e r p e g rvea 0 a ( e c n ree−0.5 iff D −1 Average precision (non-interpolated) for all relevant documents (averaged over queries) geotalpIR1 geotalpIR1 geotalpIR1 geotalpIR1 talp 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
Precision at DCL (%)
CLEF 2005 GC−Monolingual−EN − Retrieved documents vs Precision 10 15 20 30 100 200
Retrieved Documents (logarithmic scale) 500 1000
CLEF 2005 GC−Monolingual−EN − Comparison to median by topic (topics 1 to 13) 1 2 3 4 5 9 10 11 12
13 6
7 Topic Number
8
CLEF 2005 GC−Monolingual−EN − Comparison to median by topic (topics 14 to 25) 14 15 16 17 18 21 22 23 24
25 19 20 Topic Number R-Precision (precision after R document retrieved, where R = Relevant retrieved) Precision averages (%) for individual queries Topic 001 Topic 002 Topic 003 Topic 004 Topic 005 Topic 006 Topic 007 Topic 008 Topic 009 Topic 010 Topic 011 Topic 012 Topic 013 0%5 0 10 20 30 40 50 60 70 80 90 100 −1 1 ) n isco 0.5 i e r p e g rvea 0 a ( e c n ree−0.5 iff D −1 Average precision (non-interpolated) for all relevant documents (averaged over queries) geotalpIR2 geotalpIR2 geotalpIR2 geotalpIR2 talp 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
Precision at DCL (%)
CLEF 2005 GC−Monolingual−EN − Retrieved documents vs Precision 10 15 20 30 100 200
Retrieved Documents (logarithmic scale) 500 1000
CLEF 2005 GC−Monolingual−EN − Comparison to median by topic (topics 1 to 13) 1 2 3 4 5 9 10 11 12
13 6
7 Topic Number
8
CLEF 2005 GC−Monolingual−EN − Comparison to median by topic (topics 14 to 25) 14 15 16 17 18 21 22 23 24
25 19 20 Topic Number R-Precision (precision after R document retrieved, where R = Relevant retrieved) Precision averages (%) for individual queries Topic 001 Topic 002 Topic 003 Topic 004 Topic 005 Topic 006 Topic 007 Topic 008 Topic 009 Topic 010 Topic 011 Topic 012 Topic 013 10% 0%5 0 10 20 30 40 50 60 70 80 90 100 −1 1 ) n isco 0.5 i e r p e g rvea 0 a ( e c n ree−0.5 iff D −1 Average precision (non-interpolated) for all relevant documents (averaged over queries) geotalpIR3 geotalpIR3 geotalpIR3 geotalpIR3 talp 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
Precision at DCL (%)
CLEF 2005 GC−Monolingual−EN − Retrieved documents vs Precision 10 15 20 30 100 200
Retrieved Documents (logarithmic scale) 500 1000
CLEF 2005 GC−Monolingual−EN − Comparison to median by topic (topics 1 to 13) 1 2 3 4 5 9 10 11 12
13 6
7 Topic Number
8
CLEF 2005 GC−Monolingual−EN − Comparison to median by topic (topics 14 to 25) 14 15 16 17 18 21 22 23 24
25 19 20 Topic Number R-Precision (precision after R document retrieved, where R = Relevant retrieved) Precision averages (%) for individual queries Topic 001 Topic 002 Topic 003 Topic 004 Topic 005 Topic 006 Topic 007 Topic 008 Topic 009 Topic 010 Topic 011 Topic 012 Topic 013 35.66 13.25 0.10 7.21 40.84 2.34 25.61 15.62 33.23 71.49 11.42 0.00 17.96
Topic 014 Topic 015 Topic 016 Topic 017 Topic 018 Topic 019 Topic 020 Topic 021 Topic 022 Topic 023 Topic 024 Topic 025 30% 20% 10% 100% 90% 80% 70% 60% 40% 30% 20% 10% 0%5 0 10 20 30 40 50 60 70 80 90 100 −1 1 ) n isco 0.5 i e r p e g rvea 0 a ( e c n ree−0.5 iff D −1 Average precision (non-interpolated) for all relevant documents (averaged over queries) geotalpIR4 geotalpIR4 geotalpIR4 geotalpIR4 GC-Monolingual-EN 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
Precision at DCL (%)
CLEF 2005 GC−Monolingual−EN − Retrieved documents vs Precision 10 15 20 30 100 200
Retrieved Documents (logarithmic scale) 500 1000
CLEF 2005 GC−Monolingual−EN − Comparison to median by topic (topics 1 to 13) 6
7 Topic Number
8 2 3 4 5 9 10 11 12 13
CLEF 2005 GC−Monolingual−EN − Comparison to median by topic (topics 14 to 25) 14 15 16 17 18 21 22 23 24
25 19 20 Topic Number R-Precision (precision after R document retrieved, where R = Relevant retrieved) Precision averages (%) for individual queries Topic 001 Topic 002 Topic 003 Topic 004 Topic 005 Topic 006 Topic 007 Topic 008 Topic 009 Topic 010 Topic 011 Topic 012 Topic 013 30% 20% 10% 100% 90% 80% 70% 60% 40% 30% 20% 10% 0%5 0 10 20 30 40 50 60 70 80 90 100 ) n isco 0.5 i e r p e g rvea 0 a ( e c n ree−0.5 iff D −1 Average precision (non-interpolated) for all relevant documents (averaged over queries) dsicgc051 dsicgc051 dsicgc051 dsicgc051 GC-Monolingual-EN 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
Precision at DCL (%)
CLEF 2005 GC−Monolingual−EN − Retrieved documents vs Precision 10 15 20 30 100 200
Retrieved Documents (logarithmic scale) 500 1000
CLEF 2005 GC−Monolingual−EN − Comparison to median by topic (topics 1 to 13) 6
7 Topic Number
8 2 3 4 5 9 10 11 12 13
CLEF 2005 GC−Monolingual−EN − Comparison to median by topic (topics 14 to 25) 14 15 16 17 18 21 22 23 24
25 19 20 Topic Number R-Precision (precision after R document retrieved, where R = Relevant retrieved) Precision averages (%) for individual queries Topic 001 Topic 002 Topic 003 Topic 004 Topic 005 Topic 006 Topic 007 Topic 008 Topic 009 Topic 010 Topic 011 Topic 012 Topic 013 34.61 5.38 4.11 0.04 12.47 2.10 19.82 0.27 32.42 10.52 0.01 3.81 21.85
Topic 014 Topic 015 Topic 016 Topic 017 Topic 018 Topic 019 Topic 020 Topic 021 Topic 022 Topic 023 Topic 024 Topic 025 30% 20% 10% 100% 90% 80% 70% 60% 40% 30% 20% 10% 0%5 0 10 20 30 40 50 60 70 80 90 100
1 ) n isco 0.5 i e r p e g rvea 0 a ( e c n ree−0.5 iff D −1 Average precision (non-interpolated) for all relevant documents (averaged over queries) dsicgc052 dsicgc052 dsicgc052 dsicgc052 Average precision (non-interpolated) for all relevant documents (averaged over queries) 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
Precision at DCL (%) CLEF 2005 GC−Monolingual−EN − Retrieved documents vs Precision 0 10 20 30 40 50 60 70 80 90 100 −1 1 ) n isco 0.5 i e r p e g rvea 0 a ( e c n ree−0.5 iff D −1 R-Precision (precision after R document retrieved, where R = Relevant retrieved) Precision averages (%) for individual queries Topic 001 Topic 002 Topic 003 Topic 004 Topic 005 Topic 006 Topic 007 Topic 008 Topic 009 Topic 010 Topic 011 Topic 012 Topic 013 0.00 7.58 0.00 0.00 53.43 0.00 7.04 5.83 20.00 36.73 6.67 17.76 14.29
Topic 014 Topic 015 Topic 016 Topic 017 Topic 018 Topic 019 Topic 020 Topic 021 Topic 022 Topic 023 Topic 024 Topic 025 0.00 5.32 0.00 31.99 11.15 12.57 18.52 39.54 0.00 7.39 0.00 0.00 xldb XLDBENAutMandTD 30% 20% 10% 100% 90% 80% 70% 60% 40% 30% 20% 10% 0%5 XLDBENAutMandTD XLDBENAutMandTD
XLDBENAutMandTD
XLDBENAutMandTD 10 15 20 30 100 200
Retrieved Documents (logarithmic scale) 500 1000
CLEF 2005 GC−Monolingual−EN − Comparison to median by topic (topics 1 to 13) 1 2 3 4 5 9 10 11 12
13 6
7 Topic Number
8
CLEF 2005 GC−Monolingual−EN − Comparison to median by topic (topics 14 to 25) 14 15 16 17 18 21 22 23 24
25 19 20 Topic Number xldb XLDBENAutMandTDL Average precision (non-interpolated) for all relevant documents (averaged over queries) 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
Precision at DCL (%)
CLEF 2005 GC−Monolingual−EN − Retrieved documents vs Precision ) n isco 0.5 i e r p e g rvea 0 a ( e c n ree−0.5 iff D
1 ) n isco 0.5 i e r p e g rvea 0 a ( e c n ree−0.5 iff D
0%0% 100% 90% 80% 70% 30% 20% 10% 100% 90% 80% 70% 60% 40% 30% 20% 10% 0%5 0 10 20 30 40 50 60 70 80 90 100 XLDBENAutMandTDL R-Precision (precision after R document retrieved, where R = Relevant retrieved) Precision averages (%) for individual queries Topic 001 Topic 002 Topic 003 Topic 004 Topic 005 Topic 006 Topic 007 Topic 008 Topic 009 Topic 010 Topic 011 Topic 012 Topic 013 50.00 7.58 3.33 0.00 54.23 0.00 8.57 5.00 20.00 63.46 0.91 17.59 14.29
Topic 014 Topic 015 Topic 016 Topic 017 Topic 018 Topic 019 Topic 020 Topic 021 Topic 022 Topic 023 Topic 024 Topic 025 0.00 45.50 0.00 48.03 9.14 12.76 18.52 37.31 27.37 2.31 0.48 0.00 10 15 20 30 100 200
Retrieved Documents (logarithmic scale) 500 1000
CLEF 2005 GC−Monolingual−EN − Comparison to median by topic (topics 1 to 13) 2 3 4 5 6
7 Topic Number 8 9 10 11 12 13 CLEF 2005 GC−Monolingual−EN − Comparison to median by topic (topics 14 to 25) 19 20
Topic Number 15 16 17 18 21 22 23 24 25 XLDBENManTD CLEF 2005 GC−Monolingual−EN − Interpolated Recall vs Average Precision Average precision (non-interpolated) for all relevant documents (averaged over queries) 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
Precision at DCL (%)
CLEF 2005 GC−Monolingual−EN − Retrieved documents vs Precision ) n isco 0.5 i e r p e g rvea 0 a ( e c n ree−0.5 iff D
1 ) n isco 0.5 i e r p e g rvea 0 a ( e c n ree−0.5 iff D
0%0% 100% 90% 80% 70% 30% 20% 10% 100% 90% 80% 70% 60% 40% 30% 20% 10% 0%5 0 10 20 30 40 50 60 70 80 90 100 XLDBENManTD
XLDBENManTD XLDBENManTD R-Precision (precision after R document retrieved, where R = Relevant retrieved) Precision averages (%) for individual queries Topic 001 Topic 002 Topic 003 Topic 004 Topic 005 Topic 006 Topic 007 Topic 008 Topic 009 Topic 010 Topic 011 Topic 012 Topic 013 66.23 2.91 20.36 4.65 41.27 7.69 20.68 3.36 4.15 1.46 3.05 14.19 0.61
Topic 014 Topic 015 Topic 016 Topic 017 Topic 018 Topic 019 Topic 020 Topic 021 Topic 022 Topic 023 Topic 024 Topic 025 0.47 3.60 6.67 6.96 1.90 0.57 7.61 9.24 13.98 0.55 0.24 0.08 10 15 20 30 100 200
Retrieved Documents (logarithmic scale) 500 1000
CLEF 2005 GC−Monolingual−EN − Comparison to median by topic (topics 1 to 13) 2 3 4 5 6
7 Topic Number 8 9 10 11 12 13 CLEF 2005 GC−Monolingual−EN − Comparison to median by topic (topics 14 to 25) 19 20
Topic Number 15 16 17 18 21 22 23 24 25 GC-Monolingual-EN CLEF 2005 GC−Monolingual−EN − Interpolated Recall vs Average Precision Average precision (non-interpolated) for all relevant documents (averaged over queries) 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
Precision at DCL (%)
CLEF 2005 GC−Monolingual−EN − Retrieved documents vs Precision ) n isco 0.5 i e r p e g rvea 0 a ( e c n ree−0.5 iff D
1 ) n isco 0.5 i e r p e g rvea 0 a ( e c n ree−0.5 iff D
0%0% 100% 90% 80% 70% 30% 20% 10% 100% 90% 80% 70% 60% n o ii s rce 50% P − R 40% 30% 20% 10% 0%5 0 10 20 30 40 50 60 70 80 90 100 R-Precision (precision after R document retrieved, where R = Relevant retrieved) Precision averages (%) for individual queries Topic 001 Topic 002 Topic 003 Topic 004 Topic 005 Topic 006 Topic 007 Topic 008 Topic 009 Topic 010 Topic 011 Topic 012 Topic 013 22.27 4.63 21.06 4.65 72.74 2.56 13.43 3.80 30.78 9.14 9.49 18.53 29.14
Topic 014 Topic 015 Topic 016 Topic 017 Topic 018 Topic 019 Topic 020 Topic 021 Topic 022 Topic 023 Topic 024 Topic 025 4.22 5.79 6.67 9.85 12.48 1.84 7.61 30.86 22.52 0.32 0.24 0.08 10 15 20 30 100 200
Retrieved Documents (logarithmic scale) 500 1000
CLEF 2005 GC−Monolingual−EN − Comparison to median by topic (topics 1 to 13) 2 3 4 5 6
7 Topic Number 8 9 10 11 12 13 CLEF 2005 GC−Monolingual−EN − Comparison to median by topic (topics 14 to 25) 19 20
Topic Number 15 16 17 18 21 22 23 24 25 GC-Monolingual-EN CLEF 2005 GC−Monolingual−EN − Interpolated Recall vs Average Precision Average precision (non-interpolated) for all relevant documents (averaged over queries) 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
Precision at DCL (%)
CLEF 2005 GC−Monolingual−EN − Retrieved documents vs Precision ) n isco 0.5 i e r p e g rvea 0 a ( e c n ree−0.5 iff D
1 ) n isco 0.5 i e r p e g rvea 0 a ( e c n ree−0.5 iff D
0%0% 100% 90% 80% 70% 30% 20% 10% 100% 90% 80% 70% 60% n o ii s rce 50% P − R 40% 30% 20% 10% 0%5 0 10 20 30 40 50 60 70 80 90 100 R-Precision (precision after R document retrieved, where R = Relevant retrieved) Precision averages (%) for individual queries Topic 001 Topic 002 Topic 003 Topic 004 Topic 005 Topic 006 Topic 007 Topic 008 Topic 009 Topic 010 Topic 011 Topic 012 Topic 013 47.03 2.16 44.55 4.65 35.47 1.92 10.12 7.28 4.45 1.44 14.59 15.00 21.75
Topic 014 Topic 015 Topic 016 Topic 017 Topic 018 Topic 019 Topic 020 Topic 021 Topic 022 Topic 023 Topic 024 Topic 025 2.82 3.59 6.67 5.99 3.90 2.58 7.61 20.63 12.71 0.55 0.24 0.08 10 15 20 30 100 200
Retrieved Documents (logarithmic scale) 500 1000
CLEF 2005 GC−Monolingual−EN − Comparison to median by topic (topics 1 to 13) 2 3 4 5 6
7 Topic Number 8 9 10 11 12 13 CLEF 2005 GC−Monolingual−EN − Comparison to median by topic (topics 14 to 25) 19 20
Topic Number 15 16 17 18 21 22 23 24 25 XLDBENManTDL General info: Track= GeoCLEF Monolingual English RunType= manual QueryType= TD + location tags Pooled= true Average precision (non-interpolated) for all relevant documents (averaged over queries) 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Interpolated Recall
Precision at DCL (%)
CLEF 2005 GC−Monolingual−EN − Retrieved documents vs Precision 1 80% 70% 0 10 20 30 40 50 60 70 80 90 100 5 docs 10 docs 15 docs 20 docs 30 docs 100 docs 200 docs 500 docs 1000 docs XLDBENManTDL XLDBENManTDL XLDBENManTDL XLDBENManTDL R-Precision (precision after R document retrieved, where R = Relevant retrieved) Precision averages (%) for individual queries Topic 001 Topic 002 Topic 003 Topic 004 Topic 005 Topic 006 Topic 007 Topic 008 Topic 009 Topic 010 Topic 011 Topic 012 Topic 013 CLEF 2005 GC−Monolingual−EN − Comparison to median by topic (topics 1 to 13)
8 15