You are here

Visual Concept Detection and Annotation Task 2010: Results for the Example-based Evaluation

In the table below you can find the average annotation performance over all photos of the testset for each run in alphabetical order. The columns show the run identifier, the results evaluated with the example-based F-measure, the results for the evaluation with the Ontology Score incorporating the Flickr Context Similarity costs and the configuration of the submission.

Summary of Runs evaluated with example-based F-measure

Run Average F-ex OS with FCS Visual Textual Multi-modal
BPACAD__1277129525816__bp_acad_hoggmm.txt_binary.txt 0.427661 0.43938282 X
CEALIST__1277046611397__cealist_fastSB_6600.submission.txt_binary.txt 0.450934 0.45837045 X
CNRS__1276255601686__MeanScoreMat_50.txt_binary.txt 0.351428 0.39116532 X
CNRS__1276255656504__MeanScoreMat_55.txt_binary.txt 0.314940 0.42115742 X
CNRS__1276255704184__MedianScoreMat_50.txt_binary.txt 0.323907 0.3845431 X
CNRS__1276255753526__MedianScoreMat_55.txt_binary.txt 0.283958 0.40696973 X
CNRS__1276255792746__MedianScoreMat_60.txt_binary.txt 0.239243 0.39390567 X
DCU__1277149866992__test_annotation.txt_binary.txt 0.177909 0.30428395 X
HHI__1277375160276__ic_10_test_s_space.txt_binary.txt 0.628258 0.6317997 X
HHI__1277376108118__ic_10_test_s_eiq_space.txt_binary.txt 0.634064 0.64006597 X
HHI__1277376336769__ic_10_test_sq_space.txt_binary.txt 0.627539 0.63621926 X
HHI__1277376653258__ic_10_test_s_iq_space.txt_binary.txt 0.627824 0.6363635 X
HHI__1277377123081__ic_10_test_s_i_space.txt_binary.txt 0.628540 0.6319418 X
IJS__1277145320629__final_ijs_feit_run1.txt_binary.txt 0.596141 0.5951191 X
IJS__1277145366034__final_ijs_feit_run2.txt_binary.txt 0.573614 0.5701095 X
IJS__1277149450375__final_ijs_feit_run3.txt_binary.txt 0.555992 0.5408328 X
IJS__1277149805985__final_ijs_feit_run4.txt_binary.txt 0.545136 0.542624 X
INSUNHIT__1276959149913__finalresult25.txt_binary.txt 0.202817 0.3712009 X
INSUNHIT__1277043120621__finalresult15.txt_binary.txt 0.184070 0.35961485 X
INSUNHIT__1277043196971__finalresult20.txt_binary.txt 0.184432 0.3580132 X
INSUNHIT__1277043267771__finalresult50.txt_binary.txt 0.208564 0.36025387 X
INSUNHIT__1277130622002__finalresult15_3.txt_binary.txt 0.180902 0.37165248 X
ISIS__1276866454435__uva-isis-both2-4sift.txt_binary.txt 0.675398 0.5952838 X
ISIS__1276866522657__uva-isis-bothdenseallharris-4sift.txt_binary.txt 0.678536 0.600498 X
ISIS__1276866615686__uva-isis-mkl-soft-both2-4sift.txt_binary.txt 0.651157 0.5222023 X
ISIS__1276866712976__uva-isis-mkl-bothdenseallharris-4sift-plus.txt_binary.txt 0.678159 0.58573127 X
ISIS__1276866836402__uva-isis-mkl-mixed-mixed.txt_binary.txt 0.680070 0.5907772 X
LEAR__1277147818075__lear_TP_Visual_CVF_0_D6.txt_binary.txt 0.581652 0.38709614 X
LEAR__1277147857284__lear_TP_Visual_CVF_1_D2.txt_binary.txt 0.579848 0.38488033 X
LEAR__1277147893487__lear_TP_VisualAndText_CVF_0_D7.txt_binary.txt 0.602019 0.411328 X
LEAR__1277147924352__lear_TP_Visual_CVF_1_D2.txt_binary.txt 0.579848 0.38488033 X
LEAR__1277147998165__lear_TP_VisualAndText_CVF_1_D3.txt_binary.txt 0.601413 0.4112506 X
LIG__1277153756343__clefResults.txt_binary.txt 0.476983 0.5297189 X
LSIS__1277226301541__DYNI_LSIS_RUN1_COPIE.txt_binary.txt 0.528211 0.5361645 X
LSIS__1277226430977__DYNI_LSIS_RUN2_COPIE.txt_binary.txt 0.530317 0.51492816 X
MEIJI__1276044391982__AUTO_VisualOnly_BagOfVisualWords_of_meiji.txt_binary.txt 0.558674 0.36342376 X
MEIJI__1276044610969__AUTO_VisualOnly_CFS_of_meiji.txt_binary.txt 0.548895 0.35631117 X
MEIJI__1277125061791__AUTO_Mixed_ CFS_and _Tags _of_meiji.txt_binary.txt 0.510309 0.42763937 X
MEIJI__1277128268438__AUTO_Mixed_Text_Based_CFS _of_meiji.txt_binary.txt 0.565717 0.36028287 X
MEIJI__1277134313572__AUTO_Mixed_Text_Based_ BagOfVisualWords _of_meiji.txt_binary.txt 0.572446 0.36633143 X
MLKD__1277147338880__Tags2.txt_binary.txt 0.260056 0.36806777 X
MLKD__1277149221968__Visual2.txt_binary.txt 0.224987 0.35902208 X
MLKD__1277149595179__Hybrid2.txt_binary.txt 0.256545 0.37891623 X
Romania__1276599820329__ANNOT_rgb.txt_binary.txt 0.413677 0.52035636 X
Romania__1276777251742__run_CR+lapl2.txt_binary.txt 0.528846 0.5616632 X
Romania__1276777329876__run_CR+lapl2inv.txt_binary.txt 0.530841 0.5620412 X
Romania__1276849994940__ANNOT_w_lapl2.txt_binary.txt 0.365692 0.48729146 X
Romania__1276850166687__ANNOT_w_lapl2inv.txt_binary.txt 0.408029 0.5129359 X
UPMC__1277138946856__output_siftFINAL.txt_binary.txt 0.126521 0.32823962 X
UPMC__1277139769194__output_multiviewFINAL.txt_binary.txt 0.174392 0.34790796 X
UPMC__1277139987860__output_FusionFINAL.txt_binary.txt 0.173217 0.34842956 X
UPMC__1277141075065__output_fusionTAGSFINAL.txt_binary.txt 0.184227 0.3511734 X
UPMC__1277144009026__output_multiviewTAGSFINAL.txt_binary.txt 0.185586 0.35069603 X
WROCLAW__1277751362442__wyniki_poprawione_r1.txt_binary.txt 0.409732 0.26369458 X
WROCLAW__1277753521284__imageClef2010-grid20x20-xy_hsv_dev_hes.quick_matrix.review.txt_binary.txt 0.459363 0.24799739 X
WROCLAW__1277754391699__imageClef2010-grid20x20-xy_rgb_dev_hes.quick_matrix.reviewed.txt_binary.txt 0.482390 0.27529722 X
WROCLAW__1277755148925__imageClef2010-testset-CEDD.reviewed.txt_binary.txt 0.329837 0.37908506 X
WROCLAW__1277755892861__imageClef2010-testset-JpegCoefficientHistogram.reviewed.txt_binary.txt 0.329204 0.3641973 X
XRCE__1277144688601__xrce_SGL_LF_Visual.txt_binary.txt 0.600218 0.5819938 X
XRCE__1277144824504__xrce_SVM_LF_Visual.txt_binary.txt 0.627110 0.6381664 X
XRCE__1277144880578__xrce_SVM_EF_Visual.txt_binary.txt 0.639441 0.6448968 X
XRCE__1277144919294__xrce_SVM_LF_VisualAndText.txt_binary.txt 0.624374 0.6371545 X
XRCE__1277144953420__xrce_SVM_EF_VisualAndText.txt_binary.txt 0.654676 0.6564951 X