You are here

Home › Visual Concept Detection and Annotation Task 2009: Results EER › Revisions

Revision of Visual Concept Detection and Annotation Task 2009: Results EER from Fri, 08/07/2009 - 15:10

In the first table the average EER and AUC are presented for each run in alphabetical order. The results of the best run for each group are listed below with EER and AUC for each concept.
Additionally we added a run called "random" which contains random numbers for all concepts and photos. You can find a pdf with detailed results and diagrams for all runs per group at the ftp. We decided to split the ROC curves into three diagrams per run to ensure readability.
For evaluation we used the matlab script provided by Thomas last year.

As a test we did two evaluations: One with all 53 concepts and a second one without the concepts "aesthetic impression", "fancy" and, "high grade of overall quality". As you can see from the result list of the groups, it did not change much in the order of the best runs. Here is the result list reporting the best run for each group with all concepts, and here the one without the 3 concepts mentioned before.

________________________________________________________________________________________________________

Summary of Runs evaluated with EER, AUC

Run Average EER Average AUC
apexlab_61_2_1245568188287.txt 0.482693 0.070400
apexlab_61_2_1245569401060.txt 0.488715 0.082151
apexlab_61_2_1245571723120.txt 0.488715 0.082151
AVEIR_81_2_1245664594607.txt 0.485345 0.520723
AVEIR_81_2_1245664654451.txt 0.440589 0.550866
AVEIR_81_2_1245664755158.txt 0.464311 0.552315
AVEIR_81_2_1245664820829.txt 0.454191 0.566118
bpacad_18_2_1245621915717.txt 0.346106 0.707860
bpacad_18_2_1245622065724.txt 0.322632 0.733264
bpacad_18_2_1245622367725.txt 0.296315 0.771324
bpacad_18_2_1245622473940.txt 0.291718 0.773133
bpacad_18_2_1245623805085.txt 0.304113 0.746300
CEA LIST_24_2_1245339305674.txt 0.501514 0.460804
CEA LIST_24_2_1245339411928.txt 0.500495 0.469035
CEA LIST_24_2_1245339505739.txt 0.500535 0.456957
CEA LIST_24_2_1245339660021.txt 0.504021 0.463241
CVIUI2R_22_2_1244628714641.txt 0.253296 0.813893
CVIUI2R_22_2_1244629050173.txt 0.255945 0.811421
FIR2_92_2_1245417583652.txt 0.253572 0.817153
FIR2_92_2_1245516363637.txt 0.253566 0.817159
FIR2_92_2_1245516525876.txt 0.253685 0.816811
FIR2_92_2_1245516822169.txt 0.271969 0.762276
IAM Southampton_30_2_1245438072355.txt 0.330401 0.714825
IAM Southampton_30_2_1245519187248.txt 0.333452 0.711566
IAM Southampton_30_2_1245519327555.txt 0.342123 0.699769
INAOE TIA_66_2_1245620227762.txt 0.486201 0.100839
INAOE TIA_66_2_1245630111443.txt 0.484685 0.099306
INAOE TIA_66_2_1245631132743.txt 0.492958 0.044276
INAOE TIA_66_2_1245631427651.txt 0.492388 0.062220
INAOE TIA_66_2_1245631711558.txt 0.487231 0.094741
ISIS University of Amsterdam_76_2_1245075326057.txt 0.234476 0.838699
ISIS University of Amsterdam_76_2_1245075554764.txt 0.234476 0.838699
ISIS University of Amsterdam_76_2_1245075919629.txt 0.235479 0.837531
ISIS University of Amsterdam_76_2_1245076320558.txt 0.252997 0.821731
ISIS University of Amsterdam_76_2_1245076767051.txt 0.243547 0.830005
KameyamaLab_21_2_1245594455534.txt 0.452374 0.164048
KameyamaLab_21_2_1245616956073.txt 0.466948 0.127788
KameyamaLab_21_2_1245617358988.txt 0.497610 0.066594
KameyamaLab_21_2_1245617609041.txt 0.457482 0.152011
KameyamaLab_21_2_1245617818119.txt 0.455052 0.156040
LEAR_44_2_1245581505805.txt 0.258642 0.813300
LEAR_44_2_1245581860906.txt 0.304383 0.756649
LEAR_44_2_1245581967963.txt 0.273385 0.793920
LEAR_44_2_1245582143586.txt 0.256169 0.804713
LEAR_44_2_1245582451309.txt 0.249469 0.823105
LIP6_17_2_1245498965150.txt 0.372169 0.673089
LIP6_17_2_1245579903668.txt 0.383789 0.651276
LIP6_17_2_1245610812916.txt 0.406509 0.629883
LIP6_17_2_1245617011478.txt 0.498451 0.192313
LIP6_17_2_1245618383113.txt 0.410032 0.622688
LSIS_14_2_1245595798047.txt 0.481796 0.505016
LSIS_14_2_1245595947674.txt 0.330819 0.720931
LSIS_14_2_1245596027969.txt 0.488454 0.498070
LSIS_14_2_1245664294478.txt 0.360759 0.685542
LSIS_14_2_1245664386697.txt 0.428975 0.600487
MMIS_33_2_1245434554581.txt 0.312366 0.744231
MMIS_33_2_1245586552541.txt 0.352478 0.689410
MMIS_33_2_1245601239738.txt 0.356945 0.684821
MMIS_33_2_1245611281967.txt 0.352485 0.689407
MMIS_33_2_1245674693001.txt 0.352612 0.689342
MRIM_50_2_1245573948330.txt 0.442568 0.528129
MRIM_50_2_1245574356224.txt 0.392492 0.592542
MRIM_50_2_1245574874836.txt 0.439504 0.573579
MRIM_50_2_1245578233616.txt 0.383630 0.643450
Random 0.500280 0.499307
TELECOM ParisTech_39_2_1245415171956.txt 0.527132 0.458622
TELECOM ParisTech_39_2_1245415387504.txt 0.526302 0.459922
UAIC_34_2_1244812428616_changed.txt 0.479700 0.105589
Wroclaw University of Technology_49_2_1245621871943.txt 0.454221 0.170540
Wroclaw University of Technology_49_2_1245622279557.txt 0.451702 0.180370
Wroclaw University of Technology_49_2_1245622900052.txt 0.447512 0.214875
Wroclaw University of Technology_49_2_1245622992589.txt 0.447512 0.214875
Wroclaw University of Technology_49_2_1245624864334.txt 0.446024 0.220957
XRCE_36_2_1245429345115.txt 0.267301 0.802704

____________________________________________________________________________________________________________

Detailed results for the best runs of each group

apexlab_61_2_1245568188287.txt

class EER AUC
1 Partylife 0.509955 0.000000
2 Familiy-Friends 0.503086 0.021524
3 Beach-Holidays 0.508232 0.000000
4 Building-Sights 0.493159 0.047796
5 Snow 0.489045 0.000000
6 Citylife 0.479470 0.057399
7 Landscape-Nature 0.363316 0.415956
8 Sports 0.518878 0.000000
9 Desert 0.478308 0.000000
10 Spring 0.500077 0.000000
11 Summer 0.491156 0.055768
12 Autumn 0.482769 0.000000
13 Winter 0.481333 0.000000
14 No-Visual-Season 0.500323 0.037446
15 Indoor 0.486704 0.099962
16 Outdoor 0.423114 0.300792
17 No-Visual-Place 0.462387 0.233360
18 Plants 0.464094 0.148858
19 Flowers 0.509694 0.021022
20 Trees 0.477617 0.073858
21 Sky 0.347757 0.457234
22 Clouds 0.390240 0.357202
23 Water 0.493926 0.029044
24 Lake 0.488693 0.000000
25 River 0.495769 0.004201
26 Sea 0.486517 0.027919
27 Mountains 0.504604 0.007820
28 Day 0.438266 0.290515
29 Night 0.499133 0.003381
30 No-Visual-Time 0.409866 0.356533
31 Sunny 0.499544 0.017531
32 Sunset-Sunrise 0.481565 0.031087
33 Canvas 0.522155 0.002762
34 Still-Life 0.504619 0.005488
35 Macro 0.497971 0.003135
36 Portrait 0.512012 0.013624
37 Overexposed 0.502463 0.000000
38 Underexposed 0.506601 0.000000
39 Neutral-Illumination 0.495553 0.000000
40 Motion-Blur 0.504892 0.000000
41 Out-of-focus 0.497539 0.000000
42 Partly-Blurred 0.464727 0.166889
43 No-Blur 0.478410 0.098124
44 Single-Person 0.496065 0.067007
45 Small-Group 0.501948 0.023327
46 Big-Group 0.490539 0.018953
47 No-Persons 0.483908 0.047861
48 Animals 0.489160 0.038477
49 Food 0.490647 0.014279
50 Vehicle 0.483310 0.003038
51 Aesthetic-Impression 0.500047 0.015564
52 Overall-Quality 0.500090 0.098228
53 Fancy 0.501464 0.018232
Average 0.482693 0.070400

_________________________________________________________________________________________________________

AVEIR_81_2_1245664654451.txt

class EER AUC
1 Partylife 0.511079 0.299795
2 Familiy-Friends 0.506082 0.304718
3 Beach-Holidays 0.428526 0.606622
4 Building-Sights 0.432716 0.607004
5 Snow 0.425029 0.609073
6 Citylife 0.490809 0.324360
7 Landscape-Nature 0.386708 0.680444
8 Sports 0.477103 0.545843
9 Desert 0.434846 0.626516
10 Spring 0.500077 0.276235
11 Summer 0.435925 0.610980
12 Autumn 0.504571 0.513194
13 Winter 0.450275 0.563231
14 No-Visual-Season 0.380090 0.657301
15 Indoor 0.414162 0.627246
16 Outdoor 0.404090 0.632770
17 No-Visual-Place 0.422699 0.594921
18 Plants 0.387446 0.650357
19 Flowers 0.469311 0.527721
20 Trees 0.487487 0.328206
21 Sky 0.329940 0.744187
22 Clouds 0.327661 0.724462
23 Water 0.448542 0.596971
24 Lake 0.437383 0.601489
25 River 0.507914 0.509475
26 Sea 0.393207 0.654446
27 Mountains 0.388102 0.633162
28 Day 0.362669 0.662157
29 Night 0.421118 0.658216
30 No-Visual-Time 0.388780 0.622543
31 Sunny 0.500547 0.306774
32 Sunset-Sunrise 0.362100 0.686913
33 Canvas 0.489001 0.513640
34 Still-Life 0.410396 0.610443
35 Macro 0.465771 0.537495
36 Portrait 0.450626 0.553220
37 Overexposed 0.361661 0.696885
38 Underexposed 0.355257 0.677844
39 Neutral-Illumination 0.381194 0.653648
40 Motion-Blur 0.491846 0.531277
41 Out-of-focus 0.517462 0.494790
42 Partly-Blurred 0.363303 0.678161
43 No-Blur 0.499264 0.311454
44 Single-Person 0.445157 0.572846
45 Small-Group 0.510588 0.304787
46 Big-Group 0.498092 0.310001
47 No-Persons 0.437833 0.561926
48 Animals 0.497311 0.510989
49 Food 0.422462 0.607061
50 Vehicle 0.390077 0.627482
51 Aesthetic-Impression 0.519850 0.482369
52 Overall-Quality 0.510232 0.491831
53 Fancy 0.516819 0.480417
Average 0.440589 0.550866

_________________________________________________________________________________________________________

bpacad_18_2_1245622473940.txt

class EER AUC
1 Partylife 0.333012 0.729412
2 Familiy-Friends 0.319081 0.738106
3 Beach-Holidays 0.210385 0.855884
4 Building-Sights 0.269224 0.809330
5 Snow 0.249279 0.753308
6 Citylife 0.285231 0.786242
7 Landscape-Nature 0.187413 0.892934
8 Sports 0.435328 0.598196
9 Desert 0.258221 0.832415
10 Spring 0.325077 0.750015
11 Summer 0.292925 0.775406
12 Autumn 0.300539 0.778936
13 Winter 0.276078 0.798427
14 No-Visual-Season 0.295410 0.751407
15 Indoor 0.327866 0.693089
16 Outdoor 0.266170 0.808237
17 No-Visual-Place 0.335831 0.722833
18 Plants 0.281989 0.798572
19 Flowers 0.254927 0.817327
20 Trees 0.248854 0.837749
21 Sky 0.207233 0.877764
22 Clouds 0.183775 0.897878
23 Water 0.263624 0.809374
24 Lake 0.221616 0.859497
25 River 0.324244 0.741478
26 Sea 0.180177 0.895800
27 Mountains 0.233806 0.859109
28 Day 0.310928 0.763085
29 Night 0.216297 0.861866
30 No-Visual-Time 0.312638 0.756507
31 Sunny 0.331024 0.731865
32 Sunset-Sunrise 0.151344 0.925875
33 Canvas 0.326001 0.737793
34 Still-Life 0.317770 0.752569
35 Macro 0.345901 0.707401
36 Portrait 0.289394 0.778254
37 Overexposed 0.315065 0.761910
38 Underexposed 0.217034 0.860439
39 Neutral-Illumination 0.273189 0.791135
40 Motion-Blur 0.389309 0.660642
41 Out-of-focus 0.280881 0.744196
42 Partly-Blurred 0.247959 0.822959
43 No-Blur 0.277723 0.795658
44 Single-Person 0.342854 0.717566
45 Small-Group 0.376673 0.663048
46 Big-Group 0.279695 0.785951
47 No-Persons 0.332253 0.728397
48 Animals 0.321849 0.743197
49 Food 0.244924 0.844143
50 Vehicle 0.334388 0.732821
51 Aesthetic-Impression 0.400000 0.638167
52 Overall-Quality 0.409621 0.633304
53 Fancy 0.449010 0.568588
Average 0.291718 0.773133

_________________________________________________________________________________________________________

CEA LIST_24_2_1245339411928.txt

class EER AUC
1 Partylife 0.504335 0.499324
2 Familiy-Friends 0.522331 0.297182
3 Beach-Holidays 0.466994 0.550027
4 Building-Sights 0.476619 0.373816
5 Snow 0.529747 0.464372
6 Citylife 0.453315 0.511442
7 Landscape-Nature 0.494013 0.300858
8 Sports 0.504847 0.494698
9 Desert 0.456539 0.523810
10 Spring 0.525077 0.454807
11 Summer 0.521609 0.479027
12 Autumn 0.551770 0.453061
13 Winter 0.536549 0.439809
14 No-Visual-Season 0.509373 0.217810
15 Indoor 0.504941 0.488230
16 Outdoor 0.494769 0.499672
17 No-Visual-Place 0.485775 0.515818
18 Plants 0.554095 0.402716
19 Flowers 0.503982 0.471569
20 Trees 0.537011 0.459028
21 Sky 0.498780 0.420259
22 Clouds 0.496578 0.476519
23 Water 0.500694 0.502822
24 Lake 0.517077 0.487772
25 River 0.558847 0.432442
26 Sea 0.496540 0.507252
27 Mountains 0.475538 0.514777
28 Day 0.478079 0.474325
29 Night 0.482539 0.528711
30 No-Visual-Time 0.482494 0.404614
31 Sunny 0.522694 0.473590
32 Sunset-Sunrise 0.487844 0.522838
33 Canvas 0.489793 0.497866
34 Still-Life 0.508314 0.475529
35 Macro 0.474700 0.525334
36 Portrait 0.534119 0.456689
37 Overexposed 0.488547 0.501511
38 Underexposed 0.453309 0.558537
39 Neutral-Illumination 0.489199 0.518237
40 Motion-Blur 0.493596 0.508858
41 Out-of-focus 0.432846 0.574949
42 Partly-Blurred 0.470588 0.507763
43 No-Blur 0.483317 0.420183
44 Single-Person 0.503255 0.405166
45 Small-Group 0.501440 0.494209
46 Big-Group 0.528462 0.460178
47 No-Persons 0.496411 0.384834
48 Animals 0.516555 0.468169
49 Food 0.487770 0.503927
50 Vehicle 0.552402 0.444279
51 Aesthetic-Impression 0.496856 0.505254
52 Overall-Quality 0.490576 0.507696
53 Fancy 0.502796 0.496675
Average 0.500495 0.469035

________________________________________________________________________________________________________

CVIUI2R_22_2_1244628714641.txt

class EER AUC
1 Partylife 0.256342 0.817202
2 Familiy-Friends 0.270062 0.796281
3 Beach-Holidays 0.211968 0.856662
4 Building-Sights 0.226619 0.847701
5 Snow 0.228616 0.846711
6 Citylife 0.270325 0.800538
7 Landscape-Nature 0.148612 0.922420
8 Sports 0.377394 0.673564
9 Desert 0.239154 0.822335
10 Spring 0.267570 0.778164
11 Summer 0.280160 0.792462
12 Autumn 0.229663 0.837997
13 Winter 0.248078 0.815554
14 No-Visual-Season 0.281189 0.788595
15 Indoor 0.282119 0.796719
16 Outdoor 0.217660 0.861466
17 No-Visual-Place 0.310519 0.754465
18 Plants 0.208390 0.871422
19 Flowers 0.214464 0.846672
20 Trees 0.203031 0.866604
21 Sky 0.161735 0.914526
22 Clouds 0.141635 0.927116
23 Water 0.205137 0.867484
24 Lake 0.204382 0.882471
25 River 0.290707 0.774765
26 Sea 0.144459 0.913049
27 Mountains 0.150693 0.915384
28 Day 0.258704 0.821707
29 Night 0.180385 0.892631
30 No-Visual-Time 0.269947 0.804410
31 Sunny 0.300857 0.763463
32 Sunset-Sunrise 0.128079 0.944175
33 Canvas 0.262462 0.816417
34 Still-Life 0.276957 0.788985
35 Macro 0.304320 0.761416
36 Portrait 0.239700 0.829023
37 Overexposed 0.282308 0.784165
38 Underexposed 0.183706 0.884473
39 Neutral-Illumination 0.274460 0.791062
40 Motion-Blur 0.349694 0.703122
41 Out-of-focus 0.281350 0.788374
42 Partly-Blurred 0.226083 0.846242
43 No-Blur 0.234298 0.844305
44 Single-Person 0.297678 0.764571
45 Small-Group 0.320854 0.745789
46 Big-Group 0.244315 0.829592
47 No-Persons 0.250289 0.822020
48 Animals 0.279076 0.788256
49 Food 0.206155 0.860059
50 Vehicle 0.259302 0.810566
51 Aesthetic-Impression 0.402816 0.639535
52 Overall-Quality 0.396069 0.649272
53 Fancy 0.444129 0.574384
Average 0.253296 0.813893

_________________________________________________________________________________________________________

FIR2_92_2_1245516363637.txt

class EER AUC
1 Partylife 0.292309 0.785226
2 Familiy-Friends 0.258079 0.820205
3 Beach-Holidays 0.202232 0.880087
4 Building-Sights 0.230862 0.845922
5 Snow 0.257154 0.822622
6 Citylife 0.270233 0.801922
7 Landscape-Nature 0.148427 0.927049
8 Sports 0.341452 0.723468
9 Desert 0.239154 0.815976
10 Spring 0.250077 0.827001
11 Summer 0.269314 0.798147
12 Autumn 0.230288 0.834354
13 Winter 0.256627 0.812728
14 No-Visual-Season 0.279897 0.779965
15 Indoor 0.257667 0.815172
16 Outdoor 0.208941 0.868123
17 No-Visual-Place 0.303938 0.764992
18 Plants 0.210283 0.875548
19 Flowers 0.196847 0.866946
20 Trees 0.194395 0.887128
21 Sky 0.141478 0.933507
22 Clouds 0.138934 0.939633
23 Water 0.219368 0.859183
24 Lake 0.185434 0.884259
25 River 0.229509 0.854117
26 Sea 0.146925 0.910266
27 Mountains 0.165265 0.915438
28 Day 0.247260 0.831051
29 Night 0.186081 0.892301
30 No-Visual-Time 0.260315 0.817112
31 Sunny 0.301312 0.760689
32 Sunset-Sunrise 0.125906 0.945872
33 Canvas 0.256924 0.818312
34 Still-Life 0.262849 0.814597
35 Macro 0.327681 0.739309
36 Portrait 0.230474 0.845673
37 Overexposed 0.333359 0.733979
38 Underexposed 0.233618 0.843704
39 Neutral-Illumination 0.299873 0.761933
40 Motion-Blur 0.347944 0.717847
41 Out-of-focus 0.288616 0.778509
42 Partly-Blurred 0.251099 0.821693
43 No-Blur 0.259814 0.814980
44 Single-Person 0.284271 0.782152
45 Small-Group 0.311621 0.756991
46 Big-Group 0.239386 0.855781
47 No-Persons 0.244501 0.819910
48 Animals 0.257899 0.820064
49 Food 0.202078 0.880972
50 Vehicle 0.276617 0.809130
51 Aesthetic-Impression 0.407696 0.625786
52 Overall-Quality 0.414199 0.618455
53 Fancy 0.462501 0.553631
Average 0.253566 0.817159

________________________________________________________________________________________________________

KameyamaLab_21_2_1245594455534.txt

class EER AUC
1 Partylife 0.503693 0.023859
2 Familiy-Friends 0.390704 0.403592
3 Beach-Holidays 0.508232 0.000000
4 Building-Sights 0.485539 0.087857
5 Snow 0.489045 0.000000
6 Citylife 0.429355 0.267055
7 Landscape-Nature 0.302423 0.543437
8 Sports 0.518878 0.000000
9 Desert 0.478308 0.000000
10 Spring 0.500077 0.000000
11 Summer 0.433005 0.268657
12 Autumn 0.482769 0.000000
13 Winter 0.481255 0.000000
14 No-Visual-Season 0.505495 0.000000
15 Indoor 0.394906 0.384339
16 Outdoor 0.458307 0.152038
17 No-Visual-Place 0.467855 0.194148
18 Plants 0.365787 0.431736
19 Flowers 0.497305 0.068332
20 Trees 0.432323 0.213475
21 Sky 0.253155 0.599810
22 Clouds 0.277238 0.588327
23 Water 0.410621 0.329214
24 Lake 0.488693 0.000000
25 River 0.495769 0.000000
26 Sea 0.466232 0.134176
27 Mountains 0.504284 0.005871
28 Day 0.471792 0.103507
29 Night 0.405928 0.335337
30 No-Visual-Time 0.387479 0.394471
31 Sunny 0.441852 0.261221
32 Sunset-Sunrise 0.359926 0.420707
33 Canvas 0.522709 0.000000
34 Still-Life 0.498153 0.040049
35 Macro 0.496618 0.008880
36 Portrait 0.451539 0.235881
37 Overexposed 0.502463 0.000000
38 Underexposed 0.434310 0.280345
39 Neutral-Illumination 0.495553 0.000000
40 Motion-Blur 0.504892 0.000000
41 Out-of-focus 0.497539 0.000000
42 Partly-Blurred 0.383714 0.400622
43 No-Blur 0.495339 0.020345
44 Single-Person 0.362091 0.421959
45 Small-Group 0.463493 0.182630
46 Big-Group 0.477580 0.070841
47 No-Persons 0.486224 0.028614
48 Animals 0.460420 0.148149
49 Food 0.471463 0.089559
50 Vehicle 0.469158 0.052514
51 Aesthetic-Impression 0.478461 0.145037
52 Overall-Quality 0.436008 0.327033
53 Fancy 0.499867 0.030937
Average 0.452374 0.164048

________________________________________________________________________________________________________

LEAR_44_2_1245582451309.txt

class EER AUC
1 Partylife 0.283398 0.802666
2 Familiy-Friends 0.262255 0.807653
3 Beach-Holidays 0.196771 0.874293
4 Building-Sights 0.219345 0.858174
5 Snow 0.217154 0.865352
6 Citylife 0.267032 0.806259
7 Landscape-Nature 0.140722 0.933659
8 Sports 0.376291 0.676839
9 Desert 0.239154 0.844773
10 Spring 0.276858 0.782512
11 Summer 0.264642 0.797623
12 Autumn 0.268657 0.822537
13 Winter 0.252078 0.836493
14 No-Visual-Season 0.282482 0.789365
15 Indoor 0.272134 0.807097
16 Outdoor 0.212429 0.868361
17 No-Visual-Place 0.306672 0.759668
18 Plants 0.211965 0.870053
19 Flowers 0.219693 0.857161
20 Trees 0.204001 0.881903
21 Sky 0.145190 0.931684
22 Clouds 0.122546 0.944296
23 Water 0.195852 0.883341
24 Lake 0.176154 0.895285
25 River 0.213760 0.867704
26 Sea 0.149232 0.929320
27 Mountains 0.150693 0.919943
28 Day 0.247905 0.835259
29 Night 0.175101 0.902016
30 No-Visual-Time 0.260055 0.816068
31 Sunny 0.314984 0.754270
32 Sunset-Sunrise 0.125986 0.942828
33 Canvas 0.262621 0.802298
34 Still-Life 0.269231 0.805030
35 Macro 0.321187 0.742135
36 Portrait 0.242167 0.841100
37 Overexposed 0.268001 0.796439
38 Underexposed 0.192079 0.880106
39 Neutral-Illumination 0.268107 0.793742
40 Motion-Blur 0.345000 0.724011
41 Out-of-focus 0.263771 0.814771
42 Partly-Blurred 0.215407 0.863627
43 No-Blur 0.225466 0.852943
44 Single-Person 0.291557 0.780188
45 Small-Group 0.306624 0.765671
46 Big-Group 0.229925 0.856416
47 No-Persons 0.243112 0.834659
48 Animals 0.256387 0.813779
49 Food 0.208233 0.885419
50 Vehicle 0.261800 0.819188
51 Aesthetic-Impression 0.419521 0.619649
52 Overall-Quality 0.418237 0.614021
53 Fancy 0.462235 0.554898
Average 0.249469 0.823105

________________________________________________________________________________________________________

LIP6_17_2_1245498965150.txt

class EER AUC
1 Partylife 0.325305 0.735317
2 Familiy-Friends 0.417847 0.611509
3 Beach-Holidays 0.333386 0.731706
4 Building-Sights 0.425788 0.600321
5 Snow 0.302924 0.775999
6 Citylife 0.424234 0.599774
7 Landscape-Nature 0.348649 0.704066
8 Sports 0.405770 0.621842
9 Desert 0.337656 0.774718
10 Spring 0.341873 0.725866
11 Summer 0.356833 0.689512
12 Autumn 0.398062 0.639121
13 Winter 0.341725 0.727492
14 No-Visual-Season 0.391726 0.647420
15 Indoor 0.411717 0.618722
16 Outdoor 0.372067 0.672216
17 No-Visual-Place 0.392022 0.651238
18 Plants 0.363474 0.682621
19 Flowers 0.353310 0.702532
20 Trees 0.371431 0.667056
21 Sky 0.307350 0.751296
22 Clouds 0.286242 0.769063
23 Water 0.360465 0.689782
24 Lake 0.335231 0.723635
25 River 0.348378 0.710321
26 Sea 0.323602 0.741804
27 Mountains 0.284330 0.779532
28 Day 0.358156 0.699669
29 Night 0.205234 0.871483
30 No-Visual-Time 0.385396 0.658072
31 Sunny 0.366114 0.683642
32 Sunset-Sunrise 0.325310 0.744319
33 Canvas 0.411616 0.629936
34 Still-Life 0.379157 0.665593
35 Macro 0.430594 0.593407
36 Portrait 0.404677 0.634642
37 Overexposed 0.248769 0.800417
38 Underexposed 0.219771 0.857078
39 Neutral-Illumination 0.310038 0.738940
40 Motion-Blur 0.421923 0.598307
41 Out-of-focus 0.455270 0.548551
42 Partly-Blurred 0.438664 0.586476
43 No-Blur 0.444799 0.585215
44 Single-Person 0.426309 0.607515
45 Small-Group 0.442826 0.581515
46 Big-Group 0.455001 0.570030
47 No-Persons 0.416532 0.620174
48 Animals 0.403697 0.637385
49 Food 0.308713 0.752022
50 Vehicle 0.401149 0.639038
51 Aesthetic-Impression 0.460160 0.556738
52 Overall-Quality 0.451983 0.558627
53 Fancy 0.491701 0.510462
Average 0.372169 0.673089

________________________________________________________________________________________________________

LSIS_14_2_1245595947674.txt

class EER AUC
1 Partylife 0.341924 0.707093
2 Familiy-Friends 0.358388 0.686949
3 Beach-Holidays 0.291198 0.760850
4 Building-Sights 0.342224 0.709846
5 Snow 0.308616 0.755321
6 Citylife 0.376497 0.667780
7 Landscape-Nature 0.249977 0.822014
8 Sports 0.446441 0.563881
9 Desert 0.326154 0.758183
10 Spring 0.312384 0.746687
11 Summer 0.328467 0.721495
12 Autumn 0.358365 0.678038
13 Winter 0.320000 0.735585
14 No-Visual-Season 0.346477 0.702382
15 Indoor 0.357310 0.692710
16 Outdoor 0.291693 0.778712
17 No-Visual-Place 0.363774 0.685601
18 Plants 0.313321 0.749959
19 Flowers 0.277693 0.777700
20 Trees 0.322259 0.741479
21 Sky 0.203627 0.869576
22 Clouds 0.199622 0.867031
23 Water 0.288702 0.773581
24 Lake 0.261385 0.809874
25 River 0.368202 0.687481
26 Sea 0.225758 0.839438
27 Mountains 0.238770 0.825764
28 Day 0.293681 0.775400
29 Night 0.215966 0.855176
30 No-Visual-Time 0.327216 0.733654
31 Sunny 0.339683 0.712674
32 Sunset-Sunrise 0.177025 0.892958
33 Canvas 0.399589 0.631352
34 Still-Life 0.353544 0.691142
35 Macro 0.389465 0.649393
36 Portrait 0.329497 0.725035
37 Overexposed 0.296693 0.782120
38 Underexposed 0.216310 0.842784
39 Neutral-Illumination 0.297332 0.762613
40 Motion-Blur 0.442686 0.579959
41 Out-of-focus 0.413079 0.602230
42 Partly-Blurred 0.361943 0.682574
43 No-Blur 0.380765 0.663729
44 Single-Person 0.367628 0.678866
45 Small-Group 0.392004 0.646370
46 Big-Group 0.376212 0.673402
47 No-Persons 0.354249 0.695325
48 Animals 0.346555 0.696964
49 Food 0.299680 0.774717
50 Vehicle 0.366853 0.674523
51 Aesthetic-Impression 0.448616 0.569521
52 Overall-Quality 0.447227 0.571614
53 Fancy 0.480696 0.530255
Average 0.330819 0.720931

_________________________________________________________________________________________________________

IAM Southampton_30_2_1245438072355.txt

class EER AUC
1 Partylife 0.339917 0.713628
2 Familiy-Friends 0.343137 0.698376
3 Beach-Holidays 0.338848 0.712200
4 Building-Sights 0.294770 0.768424
5 Snow 0.308616 0.743089
6 Citylife 0.322085 0.728961
7 Landscape-Nature 0.233640 0.836262
8 Sports 0.469693 0.557155
9 Desert 0.345608 0.697414
10 Spring 0.332121 0.758765
11 Summer 0.363925 0.687830
12 Autumn 0.261858 0.802908
13 Winter 0.299451 0.750205
14 No-Visual-Season 0.342599 0.700910
15 Indoor 0.359552 0.681120
16 Outdoor 0.318484 0.738642
17 No-Visual-Place 0.359320 0.685880
18 Plants 0.277258 0.788211
19 Flowers 0.295954 0.765017
20 Trees 0.256080 0.811608
21 Sky 0.300880 0.759186
22 Clouds 0.281920 0.779627
23 Water 0.307879 0.749672
24 Lake 0.267077 0.793067
25 River 0.312882 0.744822
26 Sea 0.242940 0.825019
27 Mountains 0.248539 0.810700
28 Day 0.324790 0.727200
29 Night 0.237266 0.830814
30 No-Visual-Time 0.327997 0.723668
31 Sunny 0.383704 0.649658
32 Sunset-Sunrise 0.231525 0.831802
33 Canvas 0.298386 0.757557
34 Still-Life 0.340611 0.710556
35 Macro 0.382971 0.661135
36 Portrait 0.333242 0.717174
37 Overexposed 0.387616 0.642125
38 Underexposed 0.258735 0.809566
39 Neutral-Illumination 0.466328 0.329873
40 Motion-Blur 0.375308 0.653402
41 Out-of-focus 0.318462 0.739802
42 Partly-Blurred 0.314947 0.744514
43 No-Blur 0.320903 0.730738
44 Single-Person 0.385213 0.649594
45 Small-Group 0.401237 0.624075
46 Big-Group 0.297265 0.756414
47 No-Persons 0.391294 0.630352
48 Animals 0.347395 0.710635
49 Food 0.289848 0.772874
50 Vehicle 0.341796 0.702615
51 Aesthetic-Impression 0.416330 0.599904
52 Overall-Quality 0.435559 0.578519
53 Fancy 0.477501 0.512468
Average 0.330401 0.714825

_________________________________________________________________________________________________________

INAOE TIA_66_2_1245630111443.txt

class EER AUC
1 Partylife 0.501686 0.081188
2 Familiy-Friends 0.501089 0.059828
3 Beach-Holidays 0.506649 0.047650
4 Building-Sights 0.506062 0.044569
5 Snow 0.491462 0.071407
6 Citylife 0.474806 0.157710
7 Landscape-Nature 0.479161 0.113770
8 Sports 0.511232 0.048588
9 Desert 0.478308 0.000000
10 Spring 0.487539 0.071029
11 Summer 0.486234 0.105578
12 Autumn 0.482769 0.065231
13 Winter 0.476078 0.053163
14 No-Visual-Season 0.503555 0.018589
15 Indoor 0.441467 0.311932
16 Outdoor 0.472892 0.119381
17 No-Visual-Place 0.485168 0.144196
18 Plants 0.422353 0.319998
19 Flowers 0.504465 0.088096
20 Trees 0.485812 0.054962
21 Sky 0.401951 0.343245
22 Clouds 0.458041 0.184455
23 Water 0.498004 0.044659
24 Lake 0.494386 0.043998
25 River 0.493418 0.032165
26 Sea 0.494471 0.047004
27 Mountains 0.504764 0.057950
28 Day 0.455996 0.171160
29 Night 0.458928 0.176898
30 No-Visual-Time 0.396330 0.367709
31 Sunny 0.484141 0.138702
32 Sunset-Sunrise 0.483417 0.051492
33 Canvas 0.524925 0.062584
34 Still-Life 0.503695 0.056587
35 Macro 0.496076 0.066203
36 Portrait 0.511921 0.053038
37 Overexposed 0.498632 0.056204
38 Underexposed 0.481806 0.130407
39 Neutral-Illumination 0.495553 0.000000
40 Motion-Blur 0.507597 0.064790
41 Out-of-focus 0.482225 0.042939
42 Partly-Blurred 0.439083 0.316956
43 No-Blur 0.496320 0.018035
44 Single-Person 0.488002 0.150548
45 Small-Group 0.507623 0.038406
46 Big-Group 0.494435 0.053775
47 No-Persons 0.488307 0.026651
48 Animals 0.487311 0.078358
49 Food 0.483373 0.079252
50 Vehicle 0.482810 0.056939
51 Aesthetic-Impression 0.498733 0.053922
52 Overall-Quality 0.493448 0.180164
53 Fancy 0.503772 0.041146
Average 0.484685 0.099306

________________________________________________________________________________________________________

ISIS University of Amsterdam_76_2_1245075326057.txt

class EER AUC
1 Partylife 0.247030 0.834226
2 Familiy-Friends 0.241467 0.834319
3 Beach-Holidays 0.158540 0.905806
4 Building-Sights 0.199082 0.880350
5 Snow 0.227212 0.845767
6 Citylife 0.247005 0.826141
7 Landscape-Nature 0.129769 0.944342
8 Sports 0.360684 0.695417
9 Desert 0.178941 0.891355
10 Spring 0.264009 0.822184
11 Summer 0.260387 0.812906
12 Autumn 0.211847 0.869776
13 Winter 0.240706 0.843095
14 No-Visual-Season 0.261797 0.804503
15 Indoor 0.255425 0.830392
16 Outdoor 0.195149 0.889771
17 No-Visual-Place 0.285309 0.789495
18 Plants 0.207234 0.877303
19 Flowers 0.202156 0.868007
20 Trees 0.176771 0.903039
21 Sky 0.125570 0.945389
22 Clouds 0.104088 0.958370
23 Water 0.181014 0.901187
24 Lake 0.162976 0.910700
25 River 0.169096 0.897254
26 Sea 0.133561 0.935113
27 Mountains 0.141324 0.933729
28 Day 0.244520 0.841444
29 Night 0.181540 0.898423
30 No-Visual-Time 0.248601 0.832936
31 Sunny 0.307875 0.762960
32 Sunset-Sunrise 0.115923 0.953469
33 Canvas 0.252413 0.816991
34 Still-Life 0.250924 0.823617
35 Macro 0.262470 0.812331
36 Portrait 0.213849 0.864968
37 Overexposed 0.284888 0.787749
38 Underexposed 0.219771 0.857741
39 Neutral-Illumination 0.293520 0.777590
40 Motion-Blur 0.317079 0.744054
41 Out-of-focus 0.276662 0.791545
42 Partly-Blurred 0.227967 0.851634
43 No-Blur 0.238224 0.843473
44 Single-Person 0.279705 0.791910
45 Small-Group 0.276808 0.792427
46 Big-Group 0.206233 0.881498
47 No-Persons 0.231072 0.849673
48 Animals 0.257311 0.818053
49 Food 0.193125 0.895082
50 Vehicle 0.252310 0.832473
51 Aesthetic-Impression 0.387705 0.658111
52 Overall-Quality 0.384760 0.655844
53 Fancy 0.453803 0.565111
Average 0.234476 0.838699

_________________________________________________________________________________________________________

MMIS_33_2_1245434554581.txt

class EER AUC
1 Partylife 0.304351 0.762057
2 Familiy-Friends 0.352850 0.699346
3 Beach-Holidays 0.275447 0.781541
4 Building-Sights 0.308019 0.758819
5 Snow 0.326472 0.736028
6 Citylife 0.332327 0.726705
7 Landscape-Nature 0.225471 0.841860
8 Sports 0.415149 0.609441
9 Desert 0.232747 0.810619
10 Spring 0.315789 0.745246
11 Summer 0.320541 0.736663
12 Autumn 0.325154 0.715834
13 Winter 0.328000 0.728705
14 No-Visual-Season 0.324499 0.729445
15 Indoor 0.339175 0.716517
16 Outdoor 0.291535 0.765084
17 No-Visual-Place 0.349094 0.712857
18 Plants 0.318158 0.735529
19 Flowers 0.318156 0.748145
20 Trees 0.305869 0.758369
21 Sky 0.211369 0.865876
22 Clouds 0.192238 0.875234
23 Water 0.269698 0.797644
24 Lake 0.278462 0.770371
25 River 0.305751 0.759666
26 Sea 0.213746 0.854027
27 Mountains 0.217231 0.846818
28 Day 0.307544 0.750027
29 Night 0.212004 0.860332
30 No-Visual-Time 0.309254 0.751515
31 Sunny 0.351805 0.703280
32 Sunset-Sunrise 0.181372 0.889386
33 Canvas 0.325764 0.730393
34 Still-Life 0.342795 0.710929
35 Macro 0.334085 0.726973
36 Portrait 0.319905 0.740263
37 Overexposed 0.325385 0.732865
38 Underexposed 0.207616 0.871133
39 Neutral-Illumination 0.369759 0.685941
40 Motion-Blur 0.417548 0.615610
41 Out-of-focus 0.283225 0.790214
42 Partly-Blurred 0.283232 0.782909
43 No-Blur 0.310108 0.758036
44 Single-Person 0.362771 0.681202
45 Small-Group 0.379045 0.662475
46 Big-Group 0.317539 0.744126
47 No-Persons 0.357027 0.692858
48 Animals 0.350924 0.701156
49 Food 0.251319 0.828054
50 Vehicle 0.327312 0.734319
51 Aesthetic-Impression 0.420929 0.603074
52 Overall-Quality 0.434931 0.588334
53 Fancy 0.474927 0.520373
Average 0.312366 0.744231

________________________________________________________________________________________________________

MRIM_50_2_1245578233616.txt

class EER AUC
1 Partylife 0.413776 0.613955
2 Familiy-Friends 0.378086 0.664602
3 Beach-Holidays 0.226848 0.840090
4 Building-Sights 0.293990 0.764193
5 Snow 0.394308 0.623488
6 Citylife 0.309465 0.749787
7 Landscape-Nature 0.231876 0.849466
8 Sports 0.498778 0.485943
9 Desert 0.434846 0.571927
10 Spring 0.575077 0.478318
11 Summer 0.351160 0.687534
12 Autumn 0.642338 0.369232
13 Winter 0.608078 0.414560
14 No-Visual-Season 0.451842 0.415564
15 Indoor 0.360061 0.684764
16 Outdoor 0.379042 0.548222
17 No-Visual-Place 0.477675 0.490939
18 Plants 0.304910 0.755519
19 Flowers 0.312284 0.727943
20 Trees 0.260927 0.810992
21 Sky 0.321243 0.743695
22 Clouds 0.254007 0.813400
23 Water 0.247657 0.817723
24 Lake 0.278462 0.781375
25 River 0.243927 0.817610
26 Sea 0.228462 0.838315
27 Mountains 0.362079 0.671650
28 Day 0.403772 0.502165
29 Night 0.301494 0.756839
30 No-Visual-Time 0.392555 0.638275
31 Sunny 0.408859 0.620197
32 Sunset-Sunrise 0.243359 0.809695
33 Canvas 0.447539 0.567004
34 Still-Life 0.379157 0.664235
35 Macro 0.363579 0.675427
36 Portrait 0.287567 0.781651
37 Overexposed 0.457118 0.602102
38 Underexposed 0.657785 0.408018
39 Neutral-Illumination 0.435832 0.416092
40 Motion-Blur 0.428924 0.596749
41 Out-of-focus 0.472849 0.569053
42 Partly-Blurred 0.391564 0.640990
43 No-Blur 0.341757 0.698962
44 Single-Person 0.364325 0.681633
45 Small-Group 0.387261 0.565168
46 Big-Group 0.440849 0.584689
47 No-Persons 0.343135 0.683873
48 Animals 0.339832 0.708836
49 Food 0.400799 0.643239
50 Vehicle 0.344543 0.693701
51 Aesthetic-Impression 0.477241 0.527296
52 Overall-Quality 0.479986 0.535197
53 Fancy 0.499512 0.500976
Average 0.383630 0.643450

________________________________________________________________________________________________________

Random

class EER AUC
1 Partylife 0.490848 0.514777
2 Familiy-Friends 0.489470 0.507878
3 Beach-Holidays 0.498417 0.507891
4 Building-Sights 0.495930 0.506519
5 Snow 0.502924 0.488264
6 Citylife 0.511934 0.488245
7 Landscape-Nature 0.502831 0.501296
8 Sports 0.485694 0.518809
9 Desert 0.483094 0.495429
10 Spring 0.550000 0.454201
11 Summer 0.491490 0.506831
12 Autumn 0.477143 0.521870
13 Winter 0.531843 0.467272
14 No-Visual-Season 0.496445 0.502005
15 Indoor 0.496179 0.503102
16 Outdoor 0.499366 0.502449
17 No-Visual-Place 0.497722 0.501639
18 Plants 0.501840 0.497414
19 Flowers 0.495616 0.502129
20 Trees 0.505111 0.490758
21 Sky 0.502174 0.498084
22 Clouds 0.500090 0.508613
23 Water 0.497310 0.509055
24 Lake 0.532361 0.466051
25 River 0.490597 0.484599
26 Sea 0.501233 0.499618
27 Mountains 0.475538 0.526225
28 Day 0.495648 0.506126
29 Night 0.518534 0.475717
30 No-Visual-Time 0.499935 0.506747
31 Sunny 0.499544 0.501717
32 Sunset-Sunrise 0.489696 0.524102
33 Canvas 0.498892 0.495730
34 Still-Life 0.500084 0.497262
35 Macro 0.500857 0.500329
36 Portrait 0.510003 0.491031
37 Overexposed 0.526386 0.474949
38 Underexposed 0.497907 0.491914
39 Neutral-Illumination 0.514612 0.481588
40 Motion-Blur 0.522154 0.466811
41 Out-of-focus 0.476365 0.517162
42 Partly-Blurred 0.497174 0.504553
43 No-Blur 0.493376 0.506411
44 Single-Person 0.500340 0.496396
45 Small-Group 0.499238 0.502683
46 Big-Group 0.492924 0.515622
47 No-Persons 0.491317 0.511400
48 Animals 0.498571 0.506852
49 Food 0.501839 0.495119
50 Vehicle 0.494464 0.505875
51 Aesthetic-Impression 0.498076 0.506140
52 Overall-Quality 0.496589 0.503512
53 Fancy 0.497115 0.506518
Average 0.500280 0.499307

________________________________________________________________________________________________________

TELECOM ParisTech_39_2_1245415387504.txt

class EER AUC
1 Partylife 0.608783 0.336980
2 Familiy-Friends 0.513889 0.474792
3 Beach-Holidays 0.658540 0.287803
4 Building-Sights 0.425009 0.600935
5 Snow 0.537076 0.449516
6 Citylife 0.478006 0.523667
7 Landscape-Nature 0.577926 0.377686
8 Sports 0.546150 0.428563
9 Desert 0.500077 0.456119
10 Spring 0.519505 0.487131
11 Summer 0.475388 0.538704
12 Autumn 0.482769 0.515568
13 Winter 0.524078 0.470694
14 No-Visual-Season 0.464771 0.552188
15 Indoor 0.507794 0.473612
16 Outdoor 0.483513 0.517245
17 No-Visual-Place 0.492862 0.505177
18 Plants 0.414257 0.608039
19 Flowers 0.483308 0.516248
20 Trees 0.437081 0.581764
21 Sky 0.588928 0.372087
22 Clouds 0.616964 0.333725
23 Water 0.603436 0.348950
24 Lake 0.601138 0.363229
25 River 0.505015 0.492471
26 Sea 0.666693 0.268117
27 Mountains 0.571463 0.407910
28 Day 0.545616 0.440163
29 Night 0.656732 0.271035
30 No-Visual-Time 0.486399 0.510649
31 Sunny 0.493164 0.513171
32 Sunset-Sunrise 0.709387 0.212205
33 Canvas 0.472781 0.519529
34 Still-Life 0.475311 0.529063
35 Macro 0.476233 0.525853
36 Portrait 0.515849 0.473124
37 Overexposed 0.489563 0.511583
38 Underexposed 0.789003 0.138972
39 Neutral-Illumination 0.655654 0.304296
40 Motion-Blur 0.504256 0.491889
41 Out-of-focus 0.363232 0.686376
42 Partly-Blurred 0.410090 0.612960
43 No-Blur 0.378067 0.656576
44 Single-Person 0.511513 0.469908
45 Small-Group 0.533542 0.451912
46 Big-Group 0.501193 0.496279
47 No-Persons 0.535541 0.440397
48 Animals 0.498235 0.500382
49 Food 0.579856 0.384838
50 Vehicle 0.502539 0.484483
51 Aesthetic-Impression 0.513656 0.473195
52 Overall-Quality 0.515078 0.478665
53 Fancy 0.497115 0.509445
Average 0.526302 0.459922

________________________________________________________________________________________________________

UAIC_34_2_1244812428616_changed.txt

class EER AUC
1 Partylife 0.509955 0.000000
2 Familiy-Friends 0.506627 0.000000
3 Beach-Holidays 0.508232 0.000000
4 Building-Sights 0.504157 0.000000
5 Snow 0.484912 0.083562
6 Citylife 0.486786 0.105682
7 Landscape-Nature 0.466165 0.181383
8 Sports 0.518878 0.000000
9 Desert 0.434846 0.128683
10 Spring 0.441796 0.297611
11 Summer 0.477140 0.261615
12 Autumn 0.354693 0.431395
13 Winter 0.335529 0.469569
14 No-Visual-Season 0.497738 0.144131
15 Indoor 0.444422 0.280933
16 Outdoor 0.472257 0.112435
17 No-Visual-Place 0.529716 0.192463
18 Plants 0.494165 0.000000
19 Flowers 0.517818 0.000000
20 Trees 0.487487 0.000000
21 Sky 0.488705 0.000000
22 Clouds 0.470196 0.110082
23 Water 0.501041 0.000000
24 Lake 0.488693 0.000000
25 River 0.495769 0.000000
26 Sea 0.461618 0.233285
27 Mountains 0.506926 0.000000
28 Day 0.414410 0.347967
29 Night 0.394617 0.365801
30 No-Visual-Time 0.493948 0.217158
31 Sunny 0.500273 0.000000
32 Sunset-Sunrise 0.430848 0.263815
33 Canvas 0.522709 0.000000
34 Still-Life 0.504451 0.000000
35 Macro 0.494002 0.021832
36 Portrait 0.511099 0.019468
37 Overexposed 0.478540 0.105454
38 Underexposed 0.500081 0.038556
39 Neutral-Illumination 0.491741 0.082420
40 Motion-Blur 0.475539 0.130122
41 Out-of-focus 0.497539 0.000000
42 Partly-Blurred 0.478543 0.207988
43 No-Blur 0.464917 0.239400
44 Single-Person 0.467016 0.188661
45 Small-Group 0.477469 0.110165
46 Big-Group 0.495309 0.007106
47 No-Persons 0.451956 0.217460
48 Animals 0.498235 0.000000
49 Food 0.493925 0.000000
50 Vehicle 0.484309 0.000000
51 Aesthetic-Impression 0.500798 0.000000
52 Overall-Quality 0.514001 0.000000
53 Fancy 0.501553 0.000000
Average 0.479700 0.105589

_________________________________________________________________________________________________________

Wroclaw University of Technology_49_2_1245624864334.txt

class EER AUC
1 Partylife 0.491972 0.137421
2 Familiy-Friends 0.410312 0.360114
3 Beach-Holidays 0.500079 0.051280
4 Building-Sights 0.452546 0.224695
5 Snow 0.478908 0.039476
6 Citylife 0.432922 0.331183
7 Landscape-Nature 0.370649 0.419729
8 Sports 0.502798 0.028128
9 Desert 0.478308 0.000000
10 Spring 0.499923 0.085699
11 Summer 0.399132 0.386712
12 Autumn 0.472611 0.073291
13 Winter 0.468078 0.081931
14 No-Visual-Season 0.402715 0.369314
15 Indoor 0.401834 0.377120
16 Outdoor 0.363190 0.430891
17 No-Visual-Place 0.502481 0.011164
18 Plants 0.350752 0.448372
19 Flowers 0.442925 0.268476
20 Trees 0.406856 0.347349
21 Sky 0.283169 0.551715
22 Clouds 0.322078 0.517047
23 Water 0.448022 0.240122
24 Lake 0.488537 0.056229
25 River 0.470616 0.087115
26 Sea 0.459709 0.152786
27 Mountains 0.462567 0.178266
28 Day 0.442456 0.221072
29 Night 0.434327 0.268972
30 No-Visual-Time 0.484837 0.123664
31 Sunny 0.417791 0.361756
32 Sunset-Sunrise 0.374497 0.384629
33 Canvas 0.516617 0.040754
34 Still-Life 0.477158 0.186683
35 Macro 0.482367 0.085082
36 Portrait 0.444779 0.288762
37 Overexposed 0.498788 0.047338
38 Underexposed 0.422154 0.305997
39 Neutral-Illumination 0.434562 0.239904
40 Motion-Blur 0.493596 0.060990
41 Out-of-focus 0.487616 0.043751
42 Partly-Blurred 0.427779 0.334023
43 No-Blur 0.434249 0.319982
44 Single-Person 0.411250 0.357700
45 Small-Group 0.482212 0.162751
46 Big-Group 0.481078 0.091290
47 No-Persons 0.408659 0.357557
48 Animals 0.461092 0.222888
49 Food 0.451399 0.172873
50 Vehicle 0.466078 0.133260
51 Aesthetic-Impression 0.475364 0.206921
52 Overall-Quality 0.465087 0.290373
53 Fancy 0.499778 0.146133
Average 0.446024 0.220957

_________________________________________________________________________________________________________

XRCE_36_2_1245429345115.txt

class EER AUC
1 Partylife 0.294155 0.768999
2 Familiy-Friends 0.260167 0.812033
3 Beach-Holidays 0.197958 0.880361
4 Building-Sights 0.212245 0.868800
5 Snow 0.285770 0.785892
6 Citylife 0.264472 0.804715
7 Landscape-Nature 0.144157 0.930035
8 Sports 0.349728 0.702089
9 Desert 0.347846 0.728597
10 Spring 0.300077 0.771164
11 Summer 0.324462 0.731181
12 Autumn 0.265609 0.786658
13 Winter 0.337961 0.733147
14 No-Visual-Season 0.310278 0.758671
15 Indoor 0.268772 0.793162
16 Outdoor 0.232245 0.855863
17 No-Visual-Place 0.301407 0.740729
18 Plants 0.252024 0.830042
19 Flowers 0.246078 0.827269
20 Trees 0.210081 0.874884
21 Sky 0.148478 0.923916
22 Clouds 0.132901 0.939825
23 Water 0.194464 0.882896
24 Lake 0.193231 0.882797
25 River 0.193308 0.887619
26 Sea 0.135948 0.932557
27 Mountains 0.158379 0.911184
28 Day 0.274017 0.804463
29 Night 0.266408 0.832588
30 No-Visual-Time 0.263699 0.808376
31 Sunny 0.356088 0.701461
32 Sunset-Sunrise 0.149895 0.922481
33 Canvas 0.245925 0.820817
34 Still-Life 0.292157 0.788751
35 Macro 0.297646 0.770729
36 Portrait 0.215310 0.866189
37 Overexposed 0.316082 0.749324
38 Underexposed 0.231847 0.836391
39 Neutral-Illumination 0.293520 0.770107
40 Motion-Blur 0.368388 0.690486
41 Out-of-focus 0.319478 0.748058
42 Partly-Blurred 0.241365 0.834317
43 No-Blur 0.262267 0.824429
44 Single-Person 0.297387 0.764767
45 Small-Group 0.342029 0.743799
46 Big-Group 0.244077 0.839388
47 No-Persons 0.279231 0.808327
48 Animals 0.270168 0.800843
49 Food 0.218305 0.861875
50 Vehicle 0.266878 0.817658
51 Aesthetic-Impression 0.399343 0.631697
52 Overall-Quality 0.424610 0.610880
53 Fancy 0.468625 0.550050
Average 0.267301 0.802704

ImageCLEF - Cross-language image retrieval evaluations