14th Community Wide Experiment on the
Critical Assessment of Techniques for Protein Structure Prediction
Menu
RR Analysis : Group performance based on combined z-scores
Results Home Table Browser Estimate of Model Accuracy Results RR Assessment Results
The cummulative z-scores in this table are calculated according to the following procedure (example for the "first" models):
1. Calculate zscores from the raw scores for all "first" models (corresponding values from the main result table);
2. Remove outliers - models with zscores below the tolerance threshold (set to -2.0);
3. Recalculate zscores on the reduced dataset;
4. Assign z-scores below the penalty threshold (either -2.0 or 0.0) to the value of this threshold.
The final ranking was calculated according to the formula: 1.0*Z-score(F1) + 0.5*Z-score(ES(ext))
for FM domains, "L/5" long-range contacts with probability filter ">0".
    #     GR
    code		     GR
    name		     Domains Count     SUM Zscore
    (>-2.0)		     Rank SUM Zscore
    (>-2.0)		     AVG Zscore
    (>-2.0)		     Rank AVG Zscore
    (>-2.0)		     SUM Zscore
    (>0.0)		     Rank SUM Zscore
    (>0.0)		     AVG Zscore
    (>0.0)		     Rank AVG Zscore
    (>0.0)
1 368 tFold-CaT_human 22 19.0422 1 0.8656 1 22.0689 1 1.0031 1
2 010 TripletRes 22 17.6238 2 0.8011 2 20.9930 2 0.9542 2
3 024 DeepPotential 22 16.8832 3 0.7674 3 19.9146 3 0.9052 3
4 488 tFold-IDT_human 22 15.7025 4 0.7137 4 19.1326 4 0.8697 4
5 009 tFold_human 22 15.5769 5 0.7080 5 19.0061 5 0.8639 5
6 125 PreferredFold 22 14.6036 6 0.6638 6 18.4711 6 0.8396 6
7 183 tFold-CaT 22 12.1438 7 0.5520 7 15.2204 7 0.6918 7
8 351 tFold-IDT 22 11.7123 8 0.5324 8 14.8577 8 0.6753 8
9 238 tFold 22 8.9677 10 0.4076 10 14.4372 9 0.6562 9
10 216 EMAP_CHAE 22 11.5616 9 0.5255 9 14.4250 10 0.6557 10
11 380 PrayogRealDistance 22 8.4727 11 0.3851 11 13.5173 11 0.6144 11
12 420 MULTICOM 22 7.4406 14 0.3382 14 12.2621 12 0.5574 12
13 377 Yang_FM 22 7.5347 12 0.3425 12 12.1681 13 0.5531 13
14 304 Jones-UCL 22 7.2110 15 0.3278 15 11.6534 14 0.5297 14
15 198 MULTICOM-CONSTRUCT 22 5.7540 18 0.2615 18 10.8811 15 0.4946 15
16 075 MULTICOM-CLUSTER 22 5.7099 19 0.2595 19 10.6870 16 0.4858 16
17 319 MULTICOM-DIST 22 5.2827 21 0.2401 21 10.5963 17 0.4816 17
18 275 MULTICOM-AI 22 6.1331 17 0.2788 17 10.5578 18 0.4799 18
19 409 UOSHAN 22 6.1680 16 0.2804 16 10.4280 19 0.4740 19
20 367 FoldX 22 7.4641 13 0.3393 13 10.4196 20 0.4736 20
21 187 MULTICOM-HYBRID 22 5.1545 22 0.2343 22 10.3753 21 0.4716 21
22 344 PrayogBinnedMSA 22 2.4192 26 0.1100 26 10.0786 22 0.4581 22
23 252 MULTICOM-DEEP 22 4.9294 23 0.2241 23 9.8577 23 0.4481 23
24 140 Yang-Server 22 3.7599 24 0.1709 24 9.4589 24 0.4300 24
25 453 DMP2 22 1.9748 28 0.0898 28 9.3857 25 0.4266 25
26 222 TOWER 22 5.6315 20 0.2560 20 9.3561 26 0.4253 26
27 192 AILON 22 0.4545 29 0.0207 29 9.0889 27 0.4131 27
28 061 191227 22 2.0048 27 0.0911 27 8.8456 28 0.4021 28
29 207 Kiharalab_Contact 22 0.2554 30 0.0116 30 8.4570 29 0.3844 29
30 326 FALCON-DeepFolder 22 3.4279 25 0.1558 25 8.0910 30 0.3678 30
31 487 RaptorX 22 -0.3047 31 -0.0138 31 6.4173 31 0.2917 32
32 364 Kiharalab_Z_Server 22 -1.9687 33 -0.0895 33 6.2148 32 0.2825 33
33 071 Kiharalab 22 -1.7118 32 -0.0778 32 6.2141 33 0.2825 34
34 392 trfold 22 -2.8224 35 -0.1283 35 5.7198 34 0.2600 36
35 157 Shen-CDeep 21 -5.5309 37 -0.1681 37 5.6557 35 0.2693 35
36 268 PrayogBinnedSeq 22 -19.3125 46 -0.8778 48 4.6565 36 0.2117 37
37 195 ShanghaiTech 22 -2.2440 34 -0.1020 34 4.2422 37 0.1928 38
38 317 MASS 22 -8.2961 40 -0.3771 41 3.9297 38 0.1786 39
39 307 Zhou-SPOT-Contact 22 -5.1826 36 -0.2356 38 3.8143 39 0.1734 40
40 151 RBO-PSP-CP 22 -7.9206 39 -0.3600 40 3.7257 40 0.1694 41
41 431 A2I2Prot 22 -13.4863 44 -0.6130 45 3.1400 41 0.1427 42
42 387 edmc_pf 8 -29.2800 52 -0.1600 36 2.8816 42 0.3602 31
43 286 AmoebaContact 22 -5.9092 38 -0.2686 39 2.8563 43 0.1298 43
44 138 LAW 22 -8.7141 41 -0.3961 42 2.7985 44 0.1272 44
45 254 ropius0 22 -13.4533 43 -0.6115 44 2.6133 45 0.1188 45
46 006 BrainFold 21 -30.2975 54 -1.3475 56 2.4331 46 0.1159 46
47 101 Destini 22 -11.9666 42 -0.5439 43 2.3453 47 0.1066 47
48 388 Rostlab 22 -16.7423 45 -0.7610 46 2.1003 48 0.0955 48
49 323 DellaCorteLab 22 -20.9266 47 -0.9512 50 1.4882 49 0.0676 49
50 425 ProdGAN_Gonglab 22 -21.6293 50 -0.9832 53 1.2689 50 0.0577 50
51 081 MUFOLD 22 -20.9740 48 -0.9534 52 1.2477 51 0.0567 51
52 144 SASHAN 18 -25.1505 51 -0.9528 51 0.9888 52 0.0549 52
53 154 ICOS 21 -21.4660 49 -0.9270 49 0.7276 53 0.0346 53
54 196 bioinsilico_sbi 10 -38.3170 58 -1.4317 59 0.3334 54 0.0333 54
55 088 netris 22 -31.2266 55 -1.4194 58 0.1821 55 0.0083 56
56 448 BaiduUSA 22 -30.2739 53 -1.3761 57 0.1759 56 0.0080 57
57 104 KUHHAN 10 -36.8453 57 -1.2845 55 0.1613 57 0.0161 55
58 060 m3g 3 -40.4006 60 -0.8002 47 0.0000 58 0.0000 58
59 105 IOBIO 6 -38.6479 59 -1.1080 54 0.0000 58 0.0000 58
60 361 Jaaaca 22 -34.4677 56 -1.5667 60 0.0000 58 0.0000 58
Protein Structure Prediction Center
Sponsored by the US National Institute of General Medical Sciences (NIH/NIGMS)
Please address any questions or queries to:
© 2007-2020, University of California, Davis