You are here

Home

Visual Concept Detection and Annotation Task@ICPR: Results EER

Primary tabs

In the first table the average EER and AUC are presented for each run in alphabetical order. The results of the best run for each group are listed below with EER and AUC for each concept.
You can find a pdf with detailed results and diagrams for all runs per group at the ftp. We decided to split the ROC curves into three diagrams per run to ensure readability.
For evaluation we used the matlab script provided by Thomas last year.
________________________________________________________________________________________________________

Summary of Runs evaluated with EER, AUC

Run Average EER Average AUC
SubmissionName EER AUC
AVEIR_1262856077602__sorted_run1_AVEIR_sim_rank_seuil05.txt 0.337724 0.715915
AVEIR_1262856132951__sorted_run2_AVEIR_sim_rank_seuil05.txt 0.313457 0.747556
AVEIR_1262856175981__sorted_run3_AVEIR_sim_rank_seuil05.txt 0.284810 0.784753
AVEIR_1262856207702__sorted_run4_AVEIR_sim_rank_seuil05.txt 0.285775 0.779882
CNRS_1262433353127__TotalCombineSiftPCAScore060.txt 0.274765 0.792718
CNRS_1262433442878__TotalCombineSiftPCAScore063.txt 0.275128 0.792808
CNRS_1262433562325__TotalCombineSiftPCAScore065.txt 0.274857 0.792639
CNRS_1262433641320__TotalCombineSiftPCAScore067.txt 0.275175 0.792300
CNRS_1262434028322__TotalCombineSiftPCAScore070.txt 0.275836 0.791498
CVSSPRet_1262719488645__run2_format.txt 0.221613 0.854733
CVSSPRet_1262719758659__run1_format.txt 0.213606 0.859999
CVSSPRet_1262727440131__fei_run_2.txt 0.220563 0.853385
CVSSPRet_1262777799929__fei_run_1.txt 0.213820 0.858837
CVSSPRet_1262781593747__fei_run_3.txt 0.216166 0.857233
IJS_1262100955676__ijs_feit_run2_1.txt 0.242450 0.832110
IJS_1262101154419__ijs_feit_run2.txt 0.242450 0.832110
IJS_1262101315087__ijs_feit_run1_1.txt 0.250389 0.821353
IJS_1262101509972__ijs_feit_run1.txt 0.250389 0.821353
ISIS_1262376995364__uva-isis-both2-4sift.txt 0.221423 0.853816
ISIS_1262377180771__uva-isis-bothdenseallharris-4sift.txt 0.218152 0.856780
ITI_1262190868772__icprlocalhisto.txt 0.365577 0.591667
ITI_1262191191579__scoresall.txt 0.506575 0.495286
ITI_1262191384462__scoresconcatlhf.txt 0.484654 0.518387
ITI_1262191518097__scoreslh.txt 0.478936 0.526933
ITI_1262191649206__scoreslhretrain.txt 0.480635 0.524581
LSIS_1262858899140__sorted_run3_lsis_sim_rank_seuil05.txt 0.310602 0.748961
LSIS_1262858975795__sorted_run4_lsis_sim_rank_seuil05.txt 0.310602 0.748961
LSIS_1262859069185__sorted_run1_lsis_sim_rank_seuil05.txt 0.496401 0.504156
LSIS_1262859144313__sorted_run2_lsis_sim_rank_seuil05.txt 0.310602 0.748961
MMIS_1261257618173__test_NPDE_baseline2010.txt 0.304932 0.756612
MMIS_1261257806321__test_NPDE_GOOGLE_2010.txt 0.304932 0.756612
MMIS_1261258062082__test_MRF_baseline2010.txt 0.328121 0.719908
MMIS_1261258281151__test_MRF_GOOGLE_2010.txt 0.328121 0.719908
MMIS_1261427169687__test_MRF2_nor2_2010.txt 0.499842 0.000032
MRIM_1262676461569__res_ICPR_LIG3.txt 0.383137 0.639309
MRIM_1262698052599__LIG2_ICPR_sum1.txt 0.410838 0.620874
MRIM_1262698323023__LIG3_ICPR_sumsr.txt 0.408219 0.626175
TRS2008_1261716477070__testingSetAnnotationsICPR.txt 0.415198 0.619983
UAIC_1262539903396__run1.txt 0.476203 0.140751
UPMCLIP6_1262281196445__run1_result_pca5000_10000_score01_unbalanced_lossfunction10.txt 0.337724 0.715913
UPMCLIP6_1262425276587__run2_result_pca5000_10000_score01_unbalanced_svmonly.txt 0.415854 0.613720
UPMCLIP6_1262426941383__run4_sift5000_unbalanced_lossfunc10_test10000_output_file_01.txt 0.433138 0.593265
UPMCLIP6_1262462158758__run3_result_hierImplications.txt 0.337724 0.715915
UPMCLIP6_1262467131292__run5_Fusion_sift_pca_Implication.txt 0.433138 0.593262

____________________________________________________________________________________________________________

Detailed results for the best runs of each group

AVEIR_1262856175981__sorted_run3_AVEIR_sim_rank_seuil05.txt

class EER AUC
1 Partylife 0.296683 0.779977
2 Familiy-Friends 0.294618 0.767938
3 Beach-Holidays 0.269900 0.825447
4 Building-Sights 0.275401 0.805661
5 Snow 0.256738 0.809011
6 Citylife 0.304901 0.762747
7 Landscape-Nature 0.198825 0.884948
8 Sports 0.417837 0.608881
9 Desert 0.242500 0.846524
10 Spring 0.310758 0.795497
11 Summer 0.312581 0.759157
12 Autumn 0.296101 0.779345
13 Winter 0.310092 0.758397
14 No-Visual-Season 0.323353 0.741710
15 Indoor 0.326444 0.740767
16 Outdoor 0.262201 0.814240
17 No-Visual-Place 0.330907 0.739877
18 Plants 0.274310 0.799767
19 Flowers 0.269903 0.811803
20 Trees 0.248113 0.828782
21 Sky 0.180624 0.897394
22 Clouds 0.167017 0.906463
23 Water 0.274901 0.796066
24 Lake 0.238317 0.843929
25 River 0.212701 0.855324
26 Sea 0.254011 0.828865
27 Mountains 0.182300 0.888184
28 Day 0.286070 0.784411
29 Night 0.197703 0.884773
30 No-Visual-Time 0.302421 0.771170
31 Sunny 0.332150 0.729645
32 Sunset-Sunrise 0.163389 0.916962
33 Canvas 0.295403 0.765715
34 Still-Life 0.327102 0.741307
35 Macro 0.321693 0.745230
36 Portrait 0.267117 0.805723
37 Overexposed 0.250813 0.825048
38 Underexposed 0.190202 0.889010
39 Neutral-Illumination 0.268412 0.801461
40 Motion-Blur 0.375801 0.670495
41 Out-of-focus 0.250102 0.828330
42 Partly-Blurred 0.279098 0.795561
43 No-Blur 0.275088 0.798353
44 Single-Person 0.320805 0.743167
45 Small-Group 0.342339 0.712363
46 Big-Group 0.281573 0.790720
47 No-Persons 0.304505 0.759948
48 Animals 0.303209 0.761399
49 Food 0.234787 0.837542
50 Vehicle 0.331601 0.737674
51 Aesthetic-Impression 0.400536 0.634083
52 Overall-Quality 0.415403 0.616554
53 Fancy 0.445556 0.568575
Average 0.284810 0.784753

____________________________________________________________________________________________________________

CNRS_1262433353127__TotalCombineSiftPCAScore060.txt

class EER AUC
1 Partylife 0.292301 0.780493
2 Familiy-Friends 0.287890 0.772581
3 Beach-Holidays 0.197096 0.877608
4 Building-Sights 0.269788 0.808410
5 Snow 0.263323 0.809011
6 Citylife 0.283488 0.780739
7 Landscape-Nature 0.187912 0.889677
8 Sports 0.396412 0.644430
9 Desert 0.219926 0.857308
10 Spring 0.270504 0.797430
11 Summer 0.322001 0.750958
12 Autumn 0.276401 0.785600
13 Winter 0.326402 0.758541
14 No-Visual-Season 0.317365 0.743660
15 Indoor 0.319157 0.750087
16 Outdoor 0.265060 0.817784
17 No-Visual-Place 0.325215 0.745915
18 Plants 0.285326 0.792781
19 Flowers 0.258604 0.813400
20 Trees 0.247885 0.830911
21 Sky 0.179119 0.899301
22 Clouds 0.152204 0.915525
23 Water 0.245911 0.830136
24 Lake 0.190978 0.872071
25 River 0.201201 0.875735
26 Sea 0.165200 0.901410
27 Mountains 0.182300 0.890553
28 Day 0.290222 0.786004
29 Night 0.194483 0.883380
30 No-Visual-Time 0.295431 0.778972
31 Sunny 0.342211 0.717072
32 Sunset-Sunrise 0.152510 0.926644
33 Canvas 0.265203 0.782000
34 Still-Life 0.335738 0.721581
35 Macro 0.308407 0.761681
36 Portrait 0.257403 0.814531
37 Overexposed 0.244002 0.830759
38 Underexposed 0.193761 0.883724
39 Neutral-Illumination 0.265139 0.797759
40 Motion-Blur 0.360910 0.683817
41 Out-of-focus 0.243501 0.842955
42 Partly-Blurred 0.276518 0.798863
43 No-Blur 0.278615 0.796686
44 Single-Person 0.310681 0.751898
45 Small-Group 0.340802 0.717834
46 Big-Group 0.257246 0.817159
47 No-Persons 0.294294 0.767254
48 Animals 0.308230 0.756030
49 Food 0.237902 0.839725
50 Vehicle 0.305294 0.757818
51 Aesthetic-Impression 0.409910 0.624441
52 Overall-Quality 0.419953 0.614018
53 Fancy 0.445211 0.569387
Average 0.274765 0.792718

____________________________________________________________________________________________________________

CVSSPRet_1262719758659__run1_format.txt

class EER AUC
1 Partylife 0.222303 0.858656
2 Familiy-Friends 0.216714 0.857197
3 Beach-Holidays 0.128102 0.928781
4 Building-Sights 0.179409 0.902751
5 Snow 0.190983 0.892474
6 Citylife 0.226505 0.849466
7 Landscape-Nature 0.121717 0.951670
8 Sports 0.298001 0.777736
9 Desert 0.182302 0.875234
10 Spring 0.238100 0.825675
11 Summer 0.233001 0.833235
12 Autumn 0.190800 0.875114
13 Winter 0.210601 0.874889
14 No-Visual-Season 0.248931 0.822067
15 Indoor 0.241918 0.841200
16 Outdoor 0.185624 0.901811
17 No-Visual-Place 0.272005 0.810760
18 Plants 0.181423 0.902770
19 Flowers 0.186944 0.888937
20 Trees 0.159044 0.915676
21 Sky 0.104817 0.958243
22 Clouds 0.106485 0.958634
23 Water 0.160406 0.913627
24 Lake 0.177800 0.899114
25 River 0.149603 0.920987
26 Sea 0.119863 0.947124
27 Mountains 0.122400 0.941441
28 Day 0.222338 0.865998
29 Night 0.178706 0.907093
30 No-Visual-Time 0.232356 0.855942
31 Sunny 0.267164 0.811767
32 Sunset-Sunrise 0.088703 0.961684
33 Canvas 0.222325 0.852158
34 Still-Life 0.215808 0.858405
35 Macro 0.238448 0.839470
36 Portrait 0.175314 0.905036
37 Overexposed 0.268300 0.816516
38 Underexposed 0.197111 0.868218
39 Neutral-Illumination 0.266776 0.797419
40 Motion-Blur 0.296794 0.784172
41 Out-of-focus 0.238830 0.832324
42 Partly-Blurred 0.209833 0.867367
43 No-Blur 0.226034 0.857846
44 Single-Person 0.263225 0.818382
45 Small-Group 0.251620 0.827320
46 Big-Group 0.167702 0.911332
47 No-Persons 0.215916 0.871760
48 Animals 0.208906 0.872151
49 Food 0.172378 0.915589
50 Vehicle 0.225506 0.854795
51 Aesthetic-Impression 0.380205 0.661986
52 Overall-Quality 0.393349 0.651818
53 Fancy 0.441647 0.588131
Average 0.213606 0.859999

____________________________________________________________________________________________________________

IJS_1262100955676__ijs_feit_run2_1.txt

class EER AUC
1 Partylife 0.257146 0.827343
2 Familiy-Friends 0.273017 0.798865
3 Beach-Holidays 0.166100 0.903541
4 Building-Sights 0.238801 0.843980
5 Snow 0.246201 0.834969
6 Citylife 0.266238 0.810624
7 Landscape-Nature 0.156254 0.923237
8 Sports 0.322501 0.742217
9 Desert 0.193639 0.886665
10 Spring 0.200765 0.861973
11 Summer 0.259203 0.813846
12 Autumn 0.260357 0.826227
13 Winter 0.289501 0.804576
14 No-Visual-Season 0.287425 0.788416
15 Indoor 0.265103 0.817324
16 Outdoor 0.199306 0.885971
17 No-Visual-Place 0.286830 0.790200
18 Plants 0.229430 0.856599
19 Flowers 0.214039 0.859798
20 Trees 0.223988 0.855159
21 Sky 0.146415 0.933015
22 Clouds 0.121530 0.945641
23 Water 0.200113 0.877471
24 Lake 0.170400 0.900428
25 River 0.188887 0.890724
26 Sea 0.131663 0.938792
27 Mountains 0.156302 0.918744
28 Day 0.232302 0.853362
29 Night 0.155200 0.922894
30 No-Visual-Time 0.243948 0.840416
31 Sunny 0.275805 0.798778
32 Sunset-Sunrise 0.113703 0.950939
33 Canvas 0.241703 0.825457
34 Still-Life 0.264677 0.817157
35 Macro 0.259612 0.815805
36 Portrait 0.229211 0.848628
37 Overexposed 0.274400 0.812368
38 Underexposed 0.192400 0.875606
39 Neutral-Illumination 0.260229 0.810692
40 Motion-Blur 0.276939 0.779088
41 Out-of-focus 0.259037 0.803145
42 Partly-Blurred 0.235230 0.848078
43 No-Blur 0.254569 0.828953
44 Single-Person 0.306125 0.760841
45 Small-Group 0.316749 0.751946
46 Big-Group 0.267702 0.811424
47 No-Persons 0.278378 0.793808
48 Animals 0.272430 0.802955
49 Food 0.208204 0.890379
50 Vehicle 0.284616 0.791468
51 Aesthetic-Impression 0.385318 0.661187
52 Overall-Quality 0.389615 0.657008
53 Fancy 0.420605 0.613118
Average 0.242450 0.832110

____________________________________________________________________________________________________________

ISIS_1262377180771__uva-isis-bothdenseallharris-4sift.txt

class EER AUC
1 Partylife 0.227728 0.850999
2 Familiy-Friends 0.231114 0.845559
3 Beach-Holidays 0.151478 0.917241
4 Building-Sights 0.183002 0.894584
5 Snow 0.223202 0.861807
6 Citylife 0.230906 0.845954
7 Landscape-Nature 0.119079 0.951245
8 Sports 0.314300 0.750679
9 Desert 0.193438 0.905835
10 Spring 0.218879 0.836941
11 Summer 0.246319 0.820512
12 Autumn 0.184301 0.882294
13 Winter 0.234659 0.858655
14 No-Visual-Season 0.261762 0.811160
15 Indoor 0.239401 0.842127
16 Outdoor 0.179089 0.904846
17 No-Visual-Place 0.270814 0.806859
18 Plants 0.188222 0.897001
19 Flowers 0.197196 0.880599
20 Trees 0.162360 0.914092
21 Sky 0.104132 0.958725
22 Clouds 0.098904 0.962802
23 Water 0.166723 0.913497
24 Lake 0.163001 0.911687
25 River 0.172502 0.906146
26 Sea 0.121002 0.944070
27 Mountains 0.116889 0.947534
28 Day 0.223998 0.860103
29 Night 0.183106 0.900944
30 No-Visual-Time 0.228606 0.852094
31 Sunny 0.281013 0.795957
32 Sunset-Sunrise 0.100105 0.962185
33 Canvas 0.231086 0.851494
34 Still-Life 0.242593 0.844506
35 Macro 0.237507 0.840604
36 Portrait 0.186449 0.896519
37 Overexposed 0.250102 0.827970
38 Underexposed 0.213127 0.865727
39 Neutral-Illumination 0.268412 0.805217
40 Motion-Blur 0.300103 0.776240
41 Out-of-focus 0.247461 0.833707
42 Partly-Blurred 0.209290 0.871998
43 No-Blur 0.219622 0.861406
44 Single-Person 0.260947 0.813519
45 Small-Group 0.262603 0.811108
46 Big-Group 0.185300 0.894235
47 No-Persons 0.209009 0.869163
48 Animals 0.220803 0.857892
49 Food 0.181101 0.906929
50 Vehicle 0.234708 0.845370
51 Aesthetic-Impression 0.375213 0.669407
52 Overall-Quality 0.388215 0.657283
53 Fancy 0.421180 0.614290
Average 0.218152 0.856780

____________________________________________________________________________________________________________

ITI_1262190868772__icprlocalhisto.txt

class EER AUC
1 Partylife 0.352702 0.715497
2 Familiy-Friends 0.432838 0.353651
3 Beach-Holidays 0.387602 0.669513
4 Building-Sights 0.361401 0.685374
5 Snow 0.315299 0.785166
6 Citylife 0.366524 0.521939
7 Landscape-Nature 0.327018 0.719191
8 Sports 0.412301 0.626974
9 Desert 0.314839 0.728060
10 Spring 0.364999 0.690006
11 Summer 0.358705 0.687117
12 Autumn 0.311332 0.767518
13 Winter 0.387564 0.668964
14 No-Visual-Season 0.358426 0.537625
15 Indoor 0.364732 0.687935
16 Outdoor 0.327956 0.693482
17 No-Visual-Place 0.464593 0.232860
18 Plants 0.335509 0.700599
19 Flowers 0.463542 0.302195
20 Trees 0.450606 0.236307
21 Sky 0.302135 0.636638
22 Clouds 0.283415 0.773594
23 Water 0.356909 0.691180
24 Lake 0.374151 0.637832
25 River 0.361592 0.600137
26 Sea 0.319015 0.642116
27 Mountains 0.288062 0.757912
28 Day 0.323230 0.660235
29 Night 0.188902 0.887716
30 No-Visual-Time 0.386123 0.487696
31 Sunny 0.342921 0.566378
32 Sunset-Sunrise 0.264226 0.817505
33 Canvas 0.370954 0.674453
34 Still-Life 0.387340 0.593945
35 Macro 0.371429 0.673942
36 Portrait 0.481995 0.164394
37 Overexposed 0.256100 0.825456
38 Underexposed 0.189155 0.880823
39 Neutral-Illumination 0.270049 0.637621
40 Motion-Blur 0.469390 0.271626
41 Out-of-focus 0.375102 0.659506
42 Partly-Blurred 0.400109 0.478139
43 No-Blur 0.382815 0.617229
44 Single-Person 0.390407 0.645676
45 Small-Group 0.500604 0.068283
46 Big-Group 0.458903 0.112963
47 No-Persons 0.416216 0.417399
48 Animals 0.381467 0.670387
49 Food 0.285151 0.771913
50 Vehicle 0.390386 0.594339
51 Aesthetic-Impression 0.432798 0.439667
52 Overall-Quality 0.453909 0.443095
53 Fancy 0.462113 0.548587
Average 0.365577 0.591667

____________________________________________________________________________________________________________

LSIS_1262858899140__sorted_run3_lsis_sim_rank_seuil05.txt

class EER AUC
1 Partylife 0.311600 0.750124
2 Familiy-Friends 0.342304 0.711786
3 Beach-Holidays 0.252600 0.816002
4 Building-Sights 0.313012 0.741543
5 Snow 0.280648 0.781811
6 Citylife 0.362717 0.684494
7 Landscape-Nature 0.243914 0.830688
8 Sports 0.428601 0.580959
9 Desert 0.287549 0.806379
10 Spring 0.317802 0.727649
11 Summer 0.311823 0.754782
12 Autumn 0.316613 0.752029
13 Winter 0.305912 0.747365
14 No-Visual-Season 0.343884 0.714930
15 Indoor 0.355723 0.697892
16 Outdoor 0.295079 0.776318
17 No-Visual-Place 0.354467 0.705327
18 Plants 0.306134 0.764653
19 Flowers 0.292604 0.764072
20 Trees 0.285731 0.778535
21 Sky 0.219212 0.859568
22 Clouds 0.211103 0.850878
23 Water 0.281105 0.783658
24 Lake 0.259301 0.805107
25 River 0.280989 0.798259
26 Sea 0.244592 0.820173
27 Mountains 0.213394 0.861362
28 Day 0.306415 0.766511
29 Night 0.208007 0.870934
30 No-Visual-Time 0.327651 0.737136
31 Sunny 0.322206 0.738705
32 Sunset-Sunrise 0.200105 0.869530
33 Canvas 0.346733 0.704104
34 Still-Life 0.341205 0.728018
35 Macro 0.343915 0.717539
36 Portrait 0.323146 0.737902
37 Overexposed 0.244002 0.827717
38 Underexposed 0.196901 0.880259
39 Neutral-Illumination 0.260229 0.807590
40 Motion-Blur 0.417477 0.605791
41 Out-of-focus 0.263201 0.824648
42 Partly-Blurred 0.310607 0.751332
43 No-Blur 0.302340 0.761285
44 Single-Person 0.356619 0.690816
45 Small-Group 0.376496 0.669038
46 Big-Group 0.363354 0.700791
47 No-Persons 0.350751 0.697482
48 Animals 0.349596 0.702548
49 Food 0.235202 0.837965
50 Vehicle 0.360831 0.693119
51 Aesthetic-Impression 0.430119 0.589178
52 Overall-Quality 0.447608 0.566125
53 Fancy 0.458779 0.552529
Average 0.310602 0.748961

____________________________________________________________________________________________________________

MMIS_1261257618173__test_NPDE_baseline2010.txt

class EER AUC
1 Partylife 0.284999 0.781453
2 Familiy-Friends 0.339825 0.714716
3 Beach-Holidays 0.252600 0.813299
4 Building-Sights 0.290109 0.775832
5 Snow 0.271530 0.801378
6 Citylife 0.322270 0.744873
7 Landscape-Nature 0.214414 0.856559
8 Sports 0.392414 0.644097
9 Desert 0.242500 0.812375
10 Spring 0.333400 0.732774
11 Summer 0.325249 0.737609
12 Autumn 0.322400 0.745654
13 Winter 0.310194 0.766604
14 No-Visual-Season 0.330197 0.729009
15 Indoor 0.333731 0.726109
16 Outdoor 0.294058 0.764078
17 No-Visual-Place 0.350099 0.712443
18 Plants 0.309806 0.752889
19 Flowers 0.290302 0.772919
20 Trees 0.295106 0.776770
21 Sky 0.209633 0.863865
22 Clouds 0.189410 0.878245
23 Water 0.264411 0.800500
24 Lake 0.281500 0.794169
25 River 0.298901 0.776575
26 Sea 0.203602 0.870701
27 Mountains 0.213602 0.856930
28 Day 0.304754 0.751755
29 Night 0.212300 0.860392
30 No-Visual-Time 0.309922 0.752353
31 Sunny 0.347301 0.706296
32 Sunset-Sunrise 0.172803 0.905024
33 Canvas 0.295506 0.764469
34 Still-Life 0.324697 0.731518
35 Macro 0.320988 0.741238
36 Portrait 0.302298 0.764266
37 Overexposed 0.335401 0.722879
38 Underexposed 0.205904 0.873592
39 Neutral-Illumination 0.379705 0.670857
40 Motion-Blur 0.404860 0.634909
41 Out-of-focus 0.263201 0.829036
42 Partly-Blurred 0.283988 0.785754
43 No-Blur 0.315806 0.754668
44 Single-Person 0.359782 0.689299
45 Small-Group 0.366392 0.680505
46 Big-Group 0.303520 0.758729
47 No-Persons 0.349850 0.698097
48 Animals 0.341519 0.714267
49 Food 0.243302 0.831589
50 Vehicle 0.319801 0.753338
51 Aesthetic-Impression 0.421841 0.599415
52 Overall-Quality 0.430105 0.596389
53 Fancy 0.479591 0.527393
Average 0.304932 0.756612

____________________________________________________________________________________________________________

MRIM_1262676461569__res_ICPR_LIG3.txt

class EER AUC
1 Partylife 0.406530 0.629099
2 Familiy-Friends 0.378187 0.665703
3 Beach-Holidays 0.228401 0.837030
4 Building-Sights 0.290109 0.769372
5 Snow 0.407700 0.605582
6 Citylife 0.311206 0.748461
7 Landscape-Nature 0.229404 0.850252
8 Sports 0.499744 0.486817
9 Desert 0.427511 0.591318
10 Spring 0.587401 0.482174
11 Summer 0.350801 0.680360
12 Autumn 0.641755 0.371238
13 Winter 0.600102 0.412445
14 No-Visual-Season 0.483319 0.116242
15 Indoor 0.361155 0.682993
16 Outdoor 0.380437 0.547361
17 No-Visual-Place 0.437723 0.575223
18 Plants 0.306814 0.755766
19 Flowers 0.313003 0.728789
20 Trees 0.262406 0.808093
21 Sky 0.317597 0.749252
22 Clouds 0.251108 0.818299
23 Water 0.241512 0.823408
24 Lake 0.288900 0.781383
25 River 0.242825 0.826291
26 Sea 0.221923 0.845152
27 Mountains 0.368968 0.657914
28 Day 0.404609 0.505557
29 Night 0.302458 0.755759
30 No-Visual-Time 0.350665 0.701570
31 Sunny 0.407907 0.622012
32 Sunset-Sunrise 0.231904 0.822760
33 Canvas 0.443723 0.571680
34 Still-Life 0.373674 0.669026
35 Macro 0.370488 0.670109
36 Portrait 0.288794 0.779538
37 Overexposed 0.542700 0.444714
38 Underexposed 0.660316 0.400053
39 Neutral-Illumination 0.499182 0.354567
40 Motion-Blur 0.412306 0.613196
41 Out-of-focus 0.480301 0.552436
42 Partly-Blurred 0.387614 0.642183
43 No-Blur 0.340814 0.700042
44 Single-Person 0.364844 0.683028
45 Small-Group 0.388907 0.566039
46 Big-Group 0.354969 0.668863
47 No-Persons 0.343844 0.680930
48 Animals 0.330496 0.716781
49 Food 0.402388 0.638893
50 Vehicle 0.346108 0.691233
51 Aesthetic-Impression 0.474312 0.528721
52 Overall-Quality 0.476663 0.543957
53 Fancy 0.489709 0.513727
Average 0.383137 0.639309

____________________________________________________________________________________________________________

TRS2008_1261716477070__testingSetAnnotationsICPR.txt

class EER AUC
1 Partylife 0.427603 0.605579
2 Familiy-Friends 0.422214 0.615457
3 Beach-Holidays 0.429101 0.614573
4 Building-Sights 0.452902 0.573149
5 Snow 0.379939 0.678857
6 Citylife 0.436117 0.582252
7 Landscape-Nature 0.325818 0.740830
8 Sports 0.567401 0.421943
9 Desert 0.549714 0.436890
10 Spring 0.416725 0.634806
11 Summer 0.405803 0.632782
12 Autumn 0.434301 0.598028
13 Winter 0.412742 0.622674
14 No-Visual-Season 0.411463 0.622938
15 Indoor 0.409512 0.629006
16 Outdoor 0.372881 0.673943
17 No-Visual-Place 0.448709 0.572552
18 Plants 0.335917 0.725008
19 Flowers 0.333403 0.737547
20 Trees 0.397210 0.648753
21 Sky 0.293924 0.781933
22 Clouds 0.285631 0.795467
23 Water 0.418387 0.633441
24 Lake 0.421794 0.628011
25 River 0.399959 0.637630
26 Sea 0.392402 0.668510
27 Mountains 0.361689 0.698120
28 Day 0.378451 0.665115
29 Night 0.342814 0.707434
30 No-Visual-Time 0.400955 0.638522
31 Sunny 0.407315 0.621283
32 Sunset-Sunrise 0.263703 0.802802
33 Canvas 0.484745 0.520095
34 Still-Life 0.435006 0.591812
35 Macro 0.469489 0.547876
36 Portrait 0.444918 0.596363
37 Overexposed 0.365189 0.658991
38 Underexposed 0.369203 0.684337
39 Neutral-Illumination 0.407529 0.618626
40 Motion-Blur 0.493588 0.510192
41 Out-of-focus 0.471669 0.538944
42 Partly-Blurred 0.437729 0.600337
43 No-Blur 0.433472 0.594648
44 Single-Person 0.471020 0.544907
45 Small-Group 0.454805 0.548602
46 Big-Group 0.426501 0.592125
47 No-Persons 0.385285 0.652472
48 Animals 0.435385 0.591617
49 Food 0.391900 0.655819
50 Vehicle 0.431634 0.595853
51 Aesthetic-Impression 0.466521 0.539220
52 Overall-Quality 0.501400 0.511859
53 Fancy 0.492009 0.518567
Average 0.415198 0.619983

____________________________________________________________________________________________________________

UAIC_1262539903396__run1.txt

class EER AUC
1 Partylife 0.518986 0.000000
2 Familiy-Friends 0.507436 0.000000
3 Beach-Holidays 0.501802 0.000000
4 Building-Sights 0.501403 0.000000
5 Snow 0.496859 0.087762
6 Citylife 0.479300 0.266083
7 Landscape-Nature 0.470200 0.178691
8 Sports 0.506202 0.020195
9 Desert 0.426006 0.198756
10 Spring 0.439771 0.322278
11 Summer 0.483001 0.257727
12 Autumn 0.361901 0.414197
13 Winter 0.346585 0.467286
14 No-Visual-Season 0.492729 0.144146
15 Indoor 0.444224 0.275862
16 Outdoor 0.476006 0.096181
17 No-Visual-Place 0.532760 0.190883
18 Plants 0.497212 0.000000
19 Flowers 0.528403 0.216306
20 Trees 0.488109 0.239825
21 Sky 0.462644 0.200899
22 Clouds 0.416608 0.338592
23 Water 0.488550 0.052980
24 Lake 0.445109 0.129792
25 River 0.474964 0.279947
26 Sea 0.469103 0.115405
27 Mountains 0.445403 0.267575
28 Day 0.413743 0.349766
29 Night 0.392401 0.367863
30 No-Visual-Time 0.491476 0.219443
31 Sunny 0.501302 0.000000
32 Sunset-Sunrise 0.434833 0.265619
33 Canvas 0.513502 0.000000
34 Still-Life 0.502897 0.000000
35 Macro 0.503116 0.019958
36 Portrait 0.509950 0.019242
37 Overexposed 0.475702 0.104936
38 Underexposed 0.498901 0.030382
39 Neutral-Illumination 0.495908 0.077255
40 Motion-Blur 0.480972 0.130368
41 Out-of-focus 0.486901 0.000000
42 Partly-Blurred 0.477523 0.207762
43 No-Blur 0.467458 0.236634
44 Single-Person 0.466085 0.188485
45 Small-Group 0.476002 0.114019
46 Big-Group 0.483540 0.005881
47 No-Persons 0.452252 0.219731
48 Animals 0.500109 0.141116
49 Food 0.494600 0.000000
50 Vehicle 0.486305 0.000000
51 Aesthetic-Impression 0.505600 0.000000
52 Overall-Quality 0.515403 0.000000
53 Fancy 0.510981 0.000000
Average 0.476203 0.140751

____________________________________________________________________________________________________________

UPMCLIP6_1262281196445__run1_result_pca5000_10000_score01_unbalanced_lossfunction10.txt

class EER AUC
1 Partylife 0.362821 0.677048
2 Familiy-Friends 0.358003 0.689844
3 Beach-Holidays 0.387602 0.653260
4 Building-Sights 0.322668 0.734212
5 Snow 0.269402 0.792173
6 Citylife 0.382584 0.657668
7 Landscape-Nature 0.274014 0.802024
8 Sports 0.477601 0.534809
9 Desert 0.272800 0.791862
10 Spring 0.349301 0.726734
11 Summer 0.323300 0.743051
12 Autumn 0.361901 0.683575
13 Winter 0.321101 0.734848
14 No-Visual-Season 0.341317 0.711327
15 Indoor 0.373874 0.675260
16 Outdoor 0.315908 0.755452
17 No-Visual-Place 0.371277 0.682213
18 Plants 0.308310 0.754857
19 Flowers 0.322000 0.736612
20 Trees 0.284930 0.777590
21 Sky 0.230432 0.849127
22 Clouds 0.239212 0.826069
23 Water 0.414100 0.624176
24 Lake 0.341814 0.704479
25 River 0.330857 0.730844
26 Sea 0.420557 0.605839
27 Mountains 0.231281 0.841258
28 Day 0.312850 0.756442
29 Night 0.196200 0.877872
30 No-Visual-Time 0.344016 0.717613
31 Sunny 0.324100 0.745944
32 Sunset-Sunrise 0.236402 0.835054
33 Canvas 0.392703 0.657641
34 Still-Life 0.350935 0.705797
35 Macro 0.390006 0.647517
36 Portrait 0.353708 0.697646
37 Overexposed 0.256100 0.821651
38 Underexposed 0.192191 0.879644
39 Neutral-Illumination 0.261866 0.800671
40 Motion-Blur 0.436608 0.580528
41 Out-of-focus 0.288891 0.783949
42 Partly-Blurred 0.336004 0.724925
43 No-Blur 0.317089 0.749762
44 Single-Person 0.364338 0.680429
45 Small-Group 0.393191 0.644673
46 Big-Group 0.380021 0.672033
47 No-Persons 0.365465 0.688811
48 Animals 0.383104 0.662606
49 Food 0.280685 0.794992
50 Vehicle 0.409657 0.614854
51 Aesthetic-Impression 0.436693 0.586659
52 Overall-Quality 0.442007 0.575794
53 Fancy 0.465563 0.543687
Average 0.337724 0.715913

ImageCLEF - Cross-language image retrieval evaluations