The following table depicts the results for the concept-based retrieval task in alphabetical order. Runs were evaluated with the non-interpolated Average Precision, Precision@10, Precision@20, Prceision@100 and R-Precision in a topic-based evaluation using the trec_eval 8.1 software.
Detailed results for all topics and all runs can be found at the ftp.
| Run | MAP | P@10 | P@20 | P@100 | R-Prec | Manual | Automated | Textual | Visual | Mixed | |
|---|---|---|---|---|---|---|---|---|---|---|---|
| ISIS_1308685265788__runcbr-UvA-auto10.txt | 0.0181 | 0.0875 | 0.0688 | 0.0530 | 0.0448 | X | X | ||||
| ISIS_1308685310238__runcbr-UvA-auto33.txt | 0.0366 | 0.1400 | 0.1350 | 0.1020 | 0.0790 | X | X | ||||
| ISIS_1308685350568__runcbr-UvA-auto100.txt | 0.0430 | 0.1675 | 0.1550 | 0.1270 | 0.0974 | X | X | ||||
| ISIS_1308685443537__runcbr-UvA-conceptmap.txt | 0.0534 | 0.1775 | 0.1938 | 0.1675 | 0.1159 | X | X | ||||
| ISIS_1308685497624__runcbr-UvA-multiconceptmul.txt | 0.0888 | 0.2600 | 0.2738 | 0.2213 | 0.1652 | X | X | ||||
| ISIS_1308685542216__runcbr-UvA-multiconceptsum.txt | 0.0803 | 0.2425 | 0.2600 | 0.2015 | 0.1500 | X | X | ||||
| ISIS_1308685631678__runcbr-UvA-enhanced.txt | 0.0867 | 0.2550 | 0.2725 | 0.2227 | 0.1597 | X | X | ||||
| ISIS_1308685680597__runcbr-UvA-enhancedplus100.txt | 0.0940 | 0.2950 | 0.2800 | 0.2335 | 0.1664 | X | X | ||||
| ISIS_1308685828076__runcbr-UvA-enhancedfast.txt | 0.0916 | 0.2700 | 0.2875 | 0.2277 | 0.1635 | X | X | ||||
| ISIS_1308685876873__runcbr-UvA-enhancedplus100fast.txt | 0.0997 | 0.3125 | 0.3050 | 0.2428 | 0.1712 | X | X | ||||
| MEIJI_1307986549452__meijiVn.txt | 0.0017 | 0.0150 | 0.0150 | 0.0197 | 0.0151 | X | X | ||||
| MEIJI_1308443537669__meijiTn.txt | 0.0213 | 0.0675 | 0.0862 | 0.0865 | 0.0648 | X | X | ||||
| MEIJI_1308443999150__meijiVr.txt | 0.0013 | 0.0125 | 0.0125 | 0.0185 | 0.0122 | X | X | ||||
| MEIJI_1308444441206__meijiTr.txt | 0.0227 | 0.0900 | 0.0962 | 0.0865 | 0.0628 | X | X | ||||
| MEIJI_1308444633885__meijiVCTn.txt | 0.0444 | 0.1625 | 0.1650 | 0.1465 | 0.1053 | X | X | ||||
| MEIJI_1308444822371__meijiVCTr.txt | 0.0333 | 0.1300 | 0.1200 | 0.1130 | 0.0824 | X | X | ||||
| MEIJI_1308495839773__meijiVTn.txt | 0.0408 | 0.1750 | 0.1513 | 0.1432 | 0.1053 | X | X | ||||
| MEIJI_1308495988189__meijiVTr.txt | 0.0325 | 0.1425 | 0.1250 | 0.1140 | 0.0867 | X | X | ||||
| MEIJI_1308496071960__meijiVTVn.txt | 0.0420 | 0.1725 | 0.1437 | 0.1417 | 0.1061 | X | X | ||||
| MEIJI_1308496150191__meijiVTVr.txt | 0.0327 | 0.1275 | 0.1138 | 0.1135 | 0.0847 | X | X | ||||
| MLKD_1307691968544__Sub1_Visual_1000.txt | 0.0361 | 0.1525 | 0.1375 | 0.1080 | 0.0883 | X | X | ||||
| MLKD_1307692048001__Sub2_Tags_QueryByExample_1000.txt | 0.0849 | 0.3000 | 0.2800 | 0.2188 | 0.1530 | X | X | ||||
| MLKD_1307692102536__Sub3_Tags_1000.txt | 0.1546 | 0.4100 | 0.3838 | 0.3102 | 0.2366 | X | X | ||||
| MLKD_1307692157334__Sub4_Multi1_1000.txt | 0.1640 | 0.3900 | 0.3700 | 0.3180 | 0.2467 | X | X | ||||
| MLKD_1307692201394__Sub5_Multi2_1000.txt | 0.1533 | 0.4175 | 0.3725 | 0.2980 | 0.2332 | X | X | ||||
| MLKD_1308226593230__Sub6_Visual_250.txt | 0.0295 | 0.1525 | 0.1375 | 0.1080 | 0.0863 | X | X | ||||
| MLKD_1308226793805__Sub7_Tags_QueryByExample_250.txt | 0.0708 | 0.3000 | 0.2800 | 0.2188 | 0.1486 | X | X | ||||
| MLKD_1308226864554__Sub8_Tags_250.txt | 0.1328 | 0.4100 | 0.3838 | 0.3102 | 0.2298 | X | X | ||||
| MLKD_1308226941036__Sub9_Multi1_250.txt | 0.1346 | 0.3900 | 0.3700 | 0.3180 | 0.2397 | X | X | ||||
| MLKD_1308227066531__Sub10_Multi2_250.txt | 0.1312 | 0.4175 | 0.3725 | 0.2980 | 0.2260 | X | X | ||||
| REGIMVID_1308548603241__REGIMVIDT1FRT.txt | 0.0042 | 0.0650 | 0.0550 | 0.0352 | 0.0200 | X | X |