14th Community Wide Experiment on the
Critical Assessment of Techniques for Protein Structure Prediction
Menu
EMA Analysis
Results Home Table Browser Estimate of Model Accuracy Results RR Assessment Results
  Global mode   Local mode
 
  Correlation   Differences (predicted vs observed)   Difference from the best   AUC/MCC
 
    Text file  

The scores were calculated over all models for all targets.
All results are for stage 2 EMA models (evaluation of the top 150 server TS models).
              GDT_TS     LDDT     CAD(AA)     SG
    #     Gr.Name     Gr.Model     MCC(40)     MCC(50)     AUC     MCC(40)     MCC(50)     AUC     MCC(40)     MCC(50)     AUC     MCC(40)     MCC(50)     AUC
1 DAVIS-EMAconsensus QA433_2 0.775 0.728 0.943 0.557 0.506 0.841 0.207 0.370 0.845 0.464 0.463 0.865
2 DAVIS-EMAconsensusAL QA263_2 0.728 0.620 0.941 0.476 0.438 0.829 0.166 0.302 0.834 0.394 0.379 0.849
3 MESHI_consensus QA214_2 0.740 0.746 0.940 0.541 0.520 0.849 0.206 0.411 0.861 0.457 0.505 0.878
4 Seder2020 QA005_2 0.000 0.154 0.939 0.000 0.705 0.850 0.000 0.000 - 0.000 0.000 -
5 MESHI QA032_2 0.738 0.742 0.938 0.530 0.508 0.843 0.201 0.404 0.856 0.450 0.497 0.873
6 ModFOLDclust2 QA035_2 0.728 0.724 0.938 0.493 0.522 0.839 0.200 0.398 0.843 0.424 0.491 0.859
7 MUfoldQA_G QA446_2 0.750 0.723 0.937 0.534 0.547 0.851 0.227 0.448 0.859 0.437 0.548 0.882
8 MULTICOM-CLUSTER QA075_2 0.597 0.672 0.932 0.549 0.609 0.878 0.248 0.459 0.870 0.474 0.567 0.885
9 EMAP_CHAE QA216_2 0.757 0.707 0.931 0.534 0.504 0.843 0.207 0.408 0.855 0.446 0.490 0.871
10 Wallner QA379_2 0.678 0.619 0.929 0.474 0.491 0.852 0.155 0.329 0.852 0.411 0.427 0.879
11 Yang_TBM QA460_2 0.744 0.692 0.927 0.575 0.572 0.856 0.204 0.424 0.848 0.475 0.524 0.877
12 UOSHAN QA409_2 0.738 0.696 0.925 0.504 0.497 0.833 0.206 0.399 0.830 0.422 0.481 0.856
13 Yang-Server QA140_2 0.703 0.669 0.922 0.535 0.564 0.863 0.215 0.423 0.856 0.416 0.530 0.886
14 MULTICOM-CONSTRUCT QA198_2 0.596 0.629 0.918 0.600 0.603 0.889 0.259 0.441 0.882 0.502 0.544 0.893
15 MULTICOM-HYBRID QA187_2 0.524 0.623 0.914 0.575 0.582 0.876 0.287 0.480 0.881 0.510 0.565 0.893
16 MULTICOM-AI QA275_2 0.523 0.624 0.912 0.540 0.576 0.875 0.289 0.497 0.876 0.496 0.573 0.883
17 Bhattacharya-Server QA149_2 0.535 0.448 0.909 0.380 0.370 0.897 0.120 0.216 0.923 0.333 0.280 0.924
18 Seder2020hard QA428_2 0.000 0.154 0.882 -0.007 -0.010 0.980 0.000 0.000 - 0.000 0.000 -
19 ModFOLD8 QA167_2 0.590 0.465 0.878 0.422 0.408 0.825 0.153 0.237 0.838 0.343 0.289 0.839
20 DeepPotential QA024_2 0.607 0.571 0.872 0.477 0.448 0.796 0.174 0.366 0.803 0.365 0.447 0.816
21 MUFOLD QA081_2 0.438 0.527 0.862 0.449 0.490 0.834 0.208 0.385 0.831 0.379 0.444 0.831
22 tFold QA238_2 0.494 0.132 0.862 0.390 0.091 0.836 0.126 0.096 0.844 0.333 0.128 0.855
23 ModFOLD8_rank QA120_2 0.408 0.573 0.860 0.479 0.568 0.872 0.332 0.456 0.883 0.504 0.552 0.884
24 P3De QA257_2 0.551 0.559 0.859 0.561 0.582 0.869 0.200 0.414 0.866 0.453 0.500 0.878
25 BAKER-ROSETTASERVER QA209_2 0.480 0.536 0.850 0.594 0.652 0.912 0.328 0.556 0.919 0.539 0.652 0.921
26 ModFOLD8_cor QA265_2 0.471 0.423 0.850 0.325 0.344 0.749 0.116 0.185 0.741 0.244 0.241 0.755
27 MUfoldQA_X QA248_2 0.500 0.426 0.847 0.312 0.327 0.731 0.127 0.189 0.749 0.264 0.252 0.742
28 ProQ2 QA067_2 0.390 0.472 0.845 0.402 0.448 0.822 0.229 0.403 0.837 0.357 0.416 0.814
29 RaptorX-QA QA073_2 0.613 0.486 0.845 0.469 0.442 0.795 0.175 0.309 0.808 0.391 0.388 0.815
30 BAKER-experimental QA403_2 0.459 0.485 0.842 0.566 0.625 0.904 0.314 0.564 0.918 0.528 0.592 0.898
31 KUHHAN QA104_2 0.445 0.449 0.831 0.344 0.361 0.786 0.219 0.264 0.801 0.310 0.276 0.773
32 3DCNN_prof QA074_2 0.490 0.533 0.830 0.525 0.601 0.885 0.194 0.398 0.886 0.429 0.486 0.876
33 ProQ3D QA339_2 0.448 0.511 0.825 0.501 0.575 0.870 0.285 0.483 0.886 0.450 0.538 0.875
34 Kiharalab_Z_Server QA364_2 0.453 0.495 0.822 0.326 0.335 0.750 0.205 0.292 0.752 0.316 0.363 0.781
35 Kiharalab QA071_2 0.453 0.495 0.821 0.326 0.335 0.751 0.205 0.292 0.751 0.310 0.364 0.781
36 SASHAN QA144_2 0.367 0.443 0.814 0.375 0.426 0.813 0.225 0.305 0.817 0.344 0.333 0.789
37 MULTICOM-DEEP QA252_2 0.375 0.434 0.806 0.495 0.523 0.856 0.303 0.463 0.865 0.481 0.528 0.863
38 MESHI_EMA QA112_2 0.414 0.406 0.805 0.312 0.356 0.763 0.105 0.247 0.746 0.259 0.311 0.760
39 Bhattacharya-QDeep QA429_2 0.430 0.468 0.805 0.457 0.521 0.829 0.198 0.370 0.817 0.392 0.451 0.819
40 tFold-CaT QA183_2 0.430 0.445 0.802 0.281 0.404 0.750 0.100 0.312 0.757 0.216 0.315 0.734
41 angleQA QA391_2 0.447 0.442 0.801 0.521 0.545 0.856 0.188 0.371 0.840 0.412 0.461 0.847
42 QMEANDisCo QA280_2 0.315 0.485 0.793 0.462 0.539 0.840 0.251 0.356 0.879 0.419 0.401 0.833
43 ProQ4 QA309_2 0.386 0.476 0.784 0.498 0.479 0.823 0.210 0.322 0.789 0.414 0.389 0.818
44 GraphQA QA210_2 0.474 0.436 0.783 0.516 0.522 0.843 0.221 0.389 0.845 0.429 0.462 0.847
45 EDN QA203_2 0.389 0.375 0.772 0.505 0.478 0.844 0.318 0.566 0.902 0.497 0.536 0.866
46 MESHI_server QA211_2 0.336 0.394 0.771 0.346 0.447 0.807 0.182 0.347 0.807 0.313 0.370 0.793
47 Bhattacharya-QDeepU QA199_2 0.415 0.410 0.770 0.482 0.458 0.821 0.200 0.352 0.837 0.437 0.413 0.843
48 Ornate QA346_2 0.207 0.396 0.763 0.292 0.498 0.842 0.346 0.451 0.911 0.326 0.451 0.847
49 LamoureuxLab QA066_2 0.416 0.402 0.763 0.323 0.348 0.729 0.131 0.248 0.724 0.257 0.281 0.721
50 MULTICOM-DIST QA319_2 0.291 0.333 0.758 0.426 0.430 0.839 0.327 0.475 0.869 0.434 0.482 0.853
51 tFold-IDT QA351_2 0.131 0.185 0.756 0.195 0.232 0.718 0.217 0.376 0.772 0.195 0.297 0.709
52 VoroCNN-GEMME QA406_2 0.266 0.375 0.753 0.420 0.496 0.829 0.364 0.435 0.896 0.461 0.422 0.828
53 VoroMQA-dark QA002_2 0.232 0.343 0.751 0.324 0.436 0.817 0.307 0.541 0.878 0.350 0.477 0.828
54 CMH1971 QA171_2 0.317 0.337 0.740 0.410 0.441 0.810 0.190 0.291 0.832 0.361 0.350 0.808
55 graph-sh QA247_2 0.284 0.271 0.739 0.439 0.406 0.827 0.373 0.255 0.905 0.468 0.294 0.842
56 VoroMQA-stout QA000_2 0.317 0.341 0.737 0.424 0.429 0.793 0.287 0.379 0.852 0.429 0.398 0.808
57 MASS QA317_2 0.160 0.325 0.726 0.199 0.296 0.751 0.068 0.238 0.746 0.182 0.242 0.733
58 VoroCNN-GDT QA153_2 0.282 0.324 0.723 0.456 0.479 0.826 0.348 0.420 0.901 0.493 0.408 0.828
59 VoroCNN QA313_2 0.255 0.306 0.714 0.411 0.450 0.810 0.344 0.397 0.887 0.443 0.387 0.812
60 CAO-QA1 QA217_2 0.273 0.286 0.712 0.251 0.253 0.685 0.153 0.272 0.782 0.255 0.296 0.738
61 LAW QA138_2 0.037 0.318 0.712 0.006 0.222 0.658 0.014 0.153 0.627 -0.006 0.145 0.628
62 VoroMQA-light QA102_2 0.255 0.078 0.688 0.276 0.089 0.735 0.100 0.082 0.788 0.238 0.103 0.754
63 Destini QA101_2 0.293 0.258 0.677 0.337 0.294 0.717 0.159 0.278 0.772 0.289 0.321 0.756
64 DIZ QA325_2 0.078 0.257 0.676 0.110 0.344 0.765 0.255 0.408 0.805 0.130 0.354 0.757
65 ropius0 QA254_2 0.091 0.086 0.662 0.129 0.100 0.717 0.183 0.190 0.839 0.151 0.148 0.755
66 CAO-SERVER QA305_2 0.146 0.206 0.619 -0.027 -0.038 0.521 -0.036 -0.023 0.510 -0.049 -0.043 0.523
67 bioinsilico_sbi_PAIR QA185_2 0.246 0.205 0.619 0.072 0.110 0.574 0.022 0.110 0.592 0.044 0.081 0.560
68 bioinsilico_sbi QA196_2 0.180 0.158 0.609 0.080 0.103 0.571 0.038 0.164 0.645 0.112 0.129 0.596
69 Anonimous QA082_2 0.075 0.207 0.570 0.240 0.211 0.696 0.082 0.160 0.726 0.242 0.201 0.698
70 Jones-UCL QA304_2 0.085 0.122 0.552 0.109 0.172 0.626 0.130 0.250 0.694 0.125 0.234 0.660
71 SBROD QA085_2 0.097 0.036 0.551 0.331 0.293 0.705 0.165 0.261 0.750 0.322 0.278 0.722
72 DeepML QA044_2 0.061 0.064 0.538 -0.056 -0.005 0.520 -0.034 -0.014 0.490 -0.007 -0.029 0.535
73 ShanghaiProtein QA398_2 0.117 0.064 0.525 0.319 0.211 0.659 0.218 0.416 0.830 0.330 0.336 0.758
Protein Structure Prediction Center
Sponsored by the US National Institute of General Medical Sciences (NIH/NIGMS)
Please address any questions or queries to:
© 2007-2020, University of California, Davis