Competition results: Table 0

The table below displays a 15-dimensional score for each entry, giving a limited representation of our assessment, e.g. MAS 5.0. Entries are (or should be) uniquely identified by method and the e-mail address (account@host) of the submitter, but the table uses abbreviated identifiers (which should suffice) built from the method nickname and e-mail account. For details about a particular entry, click on its identifier.

Because of space considerations, the table contains only certain of the 23 measures made by the assessment, and those measures chosen for display are rounded to 2 decimal places. For example, the value in column 2 (resp. column 4) for entry #9 (resp. entry #6) which has been rounded to "1.00" is actually less than 1 (resp. greater than 1). Similarly, various values expressed as ".99" are actually different.

Ideal score values are included in italics. The current best score values are in bold italics.

To see the entries ranked with respect to a particular measure, click on the corresponding heading: "1" ... "15".

The score components, along with the corresponding assessment score number, are as follows:

  1. [1] Median SD - median SD across replicates in the dilution data
  2. [2] R2 - average R-squared over all pairs of replicates
  3. [3] 1.25v20 corr - correlation between expression of arrays hybridized to 1.25 micrograms and 20 micrograms of RNA
  4. [6] Median slope - median slope obtained from regressing expression values on RNA concentrations in the dilution study
  5. [7] Signal detect slope - slope obtained from regressing expression values on nominal concentrations in the spike-in data
  6. [8] Signal detect R2 - R-squared obtained from regressing expression values on nominal concentrations in the spike-in data
  7. [12] AUC (FP<100) - area under the ROC curve up to 100 false positives
  8. [13] AFP, call if fc>2 - average false positives if we use fold-change > 2 as a cut-off
  9. [14] ATP, call if fc>2 - average true positives if we use fold-change > 2 as a cut-off
  10. [15] IQR - interquartile range of log ratios among genes not differentially expressed
  11. [16] Obs-intended-fc slope - slope obtained from regressing observed log-fold-changes against nominal log-fold-changes
  12. [17] Obs-(low)int-fc slope - slope obtained from regressing observed log-fold-changes against nominal log-fold-changes for genes with nominal concentrations less than or equal to 2.
  13. [21] FC=2, AUC (FP<100) - area under the ROC curve up to 100 false positives when comparing arrays with nominal fold changes of 2.
  14. [22] FC=2, AFP, call if fc>2 - average false positives if we use fold-change > 2 as a cut-off when comparing arrays where nominal fold-changes are 2
  15. [23] FC=2, ATP, call if fc>2 - average true positives if we use fold-change > 2 as a cut-off when comparing arrays where nominal fold-changes are 2
Table 0. Entries listed in order of submission

#genes subnormal: + = dilution, * = hgu95
no dilution study: +; no spike-in study: *

N Method / Submitter 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15
0 (perfection) 0.00 1.00 1.00 1.00 1.00 1.00 1.00 0.00 16.00 0.00 1.00 1.00 1.00 0.00 16.00
1 MAS_5.0 / rafa 0.29 0.89 0.73 0.85 0.71 0.86 0.36 3108.99 12.82 2.66 0.69 0.65 0.07 3072.18 3.71
2 RMA / rafa 0.09 0.99 0.94 0.87 0.63 0.80 0.82 15.84 11.98 0.31 0.61 0.36 0.54 1.00 1.71
3 dChip / rafa 0.09 0.99 0.91 0.77 0.53 0.85 0.67 36.91 11.43 0.45 0.52 0.32 0.17 28.64 1.25
4 ZAM2NBG / magnus.astrand 0.07 0.99 0.94 0.72 0.57 0.77 0.84 2.44 11.70 0.24 0.57 0.32 0.61 0.57 1.14
5 qn.p5 / cope 0.11 0.98 0.56 0.06 0.42 0.50 0.62 20.30 9.58 0.38 0.43 0.14 0.24 15.75 1.39
6 vsn_scal / w.huber 0.08 0.99 0.96 1.00 0.77 0.81 0.85 6.69 12.23 0.23 0.75 0.28 0.66 0.43 3.89
7 vsn / w.huber 0.06 0.99 0.96 0.67 0.51 0.81 0.85 0.40 10.83 0.15 0.50 0.19 0.66 0.21 1.11
8 RMAVSN / thomas.cappola 0.09 0.99 0.94 0.89 0.61 0.81 0.83 17.87 11.79 0.25 0.60 0.32 0.59 0.50 1.61
9 RMA_NBG / bolstad 0.04 1.00 0.91 0.56 0.48 0.81 0.85 0.13 10.45 0.12 0.47 0.15 0.68 0.11 1.04
10 GSVDmin / hzuzan 0.05 0.98 0.97 0.59 0.50 0.83 0.81 4.87 11.09 0.21 0.49 0.24 0.56 2.43 1.00
11 PLIER / Earl Hubbell 0.13 0.09 0.01 0.84 0.71 0.91 0.02 596.77 12.85 4.03 0.72 0.65 0.02 589.96 3.57
12 GSVDmod / hzuzan 0.05 1.00 0.97 0.55 0.51 0.85 0.84 0.79 11.19 0.19 0.50 0.24 0.60 0.54 1.11
13 PLIER+16 / Earl Hubbell 0.08 0.99 0.88 0.64 0.65 0.91 0.81 8.42 12.34 0.34 0.65 0.46 0.46 5.07 2.04
14 GCRMA / zwu 0.09 0.99 0.89 0.72 0.97 0.84 0.82 7.62 12.97 0.35 0.92 0.66 0.54 7.07 5.29
15 ChipMan / plauren 0.31 0.99 0.94 1.26 0.88 0.82 0.67 183.99 13.03 0.67 0.87 0.44 0.20 159.86 5.11
16 ProbePro / shilmer 0.16 0.70 0.58 0.84 1.45 0.47 0.17 2087.07 12.53 15.70 1.33 1.93 0.07 2046.46 4.93
17 MMEI / shibing.deng 0.02 1.00 0.92 0.52 0.45 0.80 0.86 0.12 10.41 0.12 0.45 0.16 0.69 0.11 1.00
18 PM / zhangli + * 0.05 0.99 0.97 0.53 0.46 0.87 0.84 1.39 10.67 0.15 0.45 0.18 0.64 0.68 1.00
19 RMA:GNV / szeto 0.09 0.99 0.98 0.68 0.62 0.80 0.82 15.86 11.99 0.31 0.61 0.36 0.54 1.00 1.71
20 GL / mai98ftu 0.05 0.99 0.92 0.56 0.48 0.81 0.83 0.15 10.42 0.14 0.47 0.16 0.66 0.11 1.18
21 MAS5+32 / Earl Hubbell 0.07 0.98 0.93 0.71 0.60 0.88 0.72 20.56 11.76 0.51 0.59 0.33 0.18 19.18 1.68
22 gMOS_v.1 / m.milo 0.32 0.97 0.81 0.64 0.95 0.75 0.54 1358.01 12.75 2.15 0.94 1.04 0.10 1319.07 5.36
23 rsvd / jack liu + -- -- -- -- 0.66 0.90 0.81 2.63 12.14 0.35 0.66 0.41 0.49 2.04 2.89
24 ZL / lzhou 0.34 0.99 0.04 0.23 0.57 0.65 0.79 21.99 11.98 0.24 0.57 0.36 0.42 37.57 2.36
32 gltran / lzhou 0.04 0.99 0.94 0.64 0.51 0.78 0.84 1.46 11.09 0.19 0.50 0.22 0.65 0.68 1.04
33 UM-Tr-Mn / jmacdon + -- -- -- -- 0.68 0.87 0.51 1399.72 12.56 1.76 0.67 0.54 0.07 1385.00 2.64
34 GS_RMA / thon + -- -- -- -- 0.63 0.80 0.82 15.86 11.98 0.31 0.61 0.36 0.54 0.93 1.71
35 GS_GCRMA / thon + -- -- -- -- 0.84 0.91 0.84 6.53 13.15 0.41 0.82 0.65 0.58 3.00 4.71
36 gcrma113 / zwu + -- -- -- -- 0.87 0.91 0.85 3.89 13.16 0.37 0.86 0.68 0.61 2.57 4.89
41 mgMOS_gs / liux 0.21 0.96 0.88 0.80 0.76 0.82 0.57 1061.31 13.12 1.37 0.75 0.90 0.07 1028.61 4.14
42 mmgMOSgs / liux 0.23 0.96 0.82 0.86 1.03 0.80 0.59 1616.01 13.65 1.79 1.02 1.40 0.09 1570.11 6.71
43 vsn / huber 0.06 0.99 0.96 0.67 0.51 0.81 0.84 0.38 10.81 0.15 0.50 0.18 0.66 0.21 1.11
44 vsn_scal / huber 0.08 0.99 0.96 1.00 0.76 0.81 0.84 6.45 12.20 0.23 0.74 0.28 0.66 0.39 3.82
49 dChipwMM / rafa 0.42 0.86 0.73 0.83 0.91 0.61 0.12 872.82 12.81 3.11 0.87 1.68 0.07 842.21 4.18
50 NLF95 / scvortso + -- -- -- -- 0.65 0.89 0.91 4.90 11.89 0.00 0.64 0.34 0.91 0.82 1.25
53 Afit_qn / Michael.D.Lynch + -- -- -- -- 0.79 0.82 0.76 61.60 12.84 0.57 0.75 0.66 0.34 31.82 3.68
54 Afit_fn / Michael.D.Lynch + -- -- -- -- 0.79 0.80 0.72 767.26 12.94 0.55 0.75 0.68 0.23 437.00 4.29
56 PQN / wei-min.liu + -- -- -- -- 0.57 0.83 0.78 17.68 11.64 0.35 0.56 0.33 0.36 3.86 1.07
57 PQNB1 / wei-min.liu + -- -- -- -- 0.08 0.78 0.75 0.00 0.21 0.05 0.08 0.07 0.33 0.00 0.29
58 PQNB1+16 / wei-min.liu + -- -- -- -- 0.01 0.81 0.79 0.00 0.00 0.00 0.01 0.01 0.41 0.00 0.00
59 DQN / wei-min.liu + -- -- -- -- 0.72 0.88 0.56 1693.28 12.82 1.48 0.71 0.68 0.07 1666.57 3.46
60 DQNB1 / wei-min.liu + -- -- -- -- 0.08 0.84 0.56 0.00 0.44 0.15 0.07 0.10 0.08 0.00 0.64
61 DQNB1+16 / wei-min.liu + -- -- -- -- 0.01 0.87 0.64 0.00 0.00 0.01 0.01 0.01 0.09 0.00 0.00
62 l-FARMS / hochreit 0.00 1.00 0.96 1.29 0.77 0.80 0.85 0.34 11.82 0.03 0.80 0.31 0.78 0.25 5.04
63 q-FARMS / hochreit 0.00 1.00 0.99 0.81 0.59 0.78 0.89 0.17 10.87 0.00 0.60 0.23 0.84 0.11 2.32
65 DIMO / mena2 + -- -- -- -- 0.87 0.80 0.63 248.64 13.12 0.83 0.85 0.72 0.16 207.89 5.57
67 RMA-Mean / mmcgee + -- -- -- -- 0.59 0.81 0.78 17.50 11.70 0.37 0.58 0.31 0.37 4.29 1.43
68 RMA-75 / mmcgee + -- -- -- -- 0.59 0.81 0.78 18.66 11.73 0.37 0.58 0.32 0.38 4.00 1.43
69 chipcal4 / mahoney.douglas + -- -- -- -- 0.94 0.70 0.80 43.55 13.45 0.46 0.95 0.41 0.51 22.75 7.07
71 i_gcrma1 / Xu + -- -- -- -- 0.84 0.91 0.84 6.85 13.11 0.41 0.82 0.65 0.57 3.18 4.54
72 i_gcrma2 / Xu + -- -- -- -- 0.90 0.91 0.84 9.20 13.45 0.44 0.88 0.70 0.58 4.93 5.57
73 i_gcrma3 / Xu + -- -- -- -- 0.84 0.91 0.84 6.92 13.18 0.41 0.82 0.66 0.58 3.07 4.39
76 dimo / mena2 + -- -- -- -- 0.52 0.79 0.85 1.02 10.97 0.15 0.51 0.18 0.65 0.61 1.14
81 dfwfcb / zhongxue + -- -- -- -- 0.31 0.63 0.93 0.00 7.20 0.00 0.29 0.12 0.93 0.00 1.00
87 test / cresus22 * 0.09 0.99 0.96 0.67 -- -- -- -- -- -- -- -- -- -- --
88 en.FARMS / clevert 0.00 1.00 0.98 0.00 0.63 0.85 0.93 0.00 11.60 0.00 0.65 0.25 0.93 0.00 2.46
89 VST-RMA / dupan 0.04 1.00 0.97 0.60 0.49 0.80 0.85 0.12 10.43 0.12 0.47 0.15 0.68 0.11 1.11
91 GCRMAm / rfajri + -- -- -- -- 0.87 0.91 0.76 88.94 13.35 0.69 0.85 0.78 0.26 75.46 5.18
92 GCRMA39 / rfajri + -- -- -- -- 0.92 0.90 0.79 51.78 13.44 0.58 0.90 0.89 0.41 42.54 5.82
116 g14Mb / rfajri + -- -- -- -- 0.82 0.92 0.83 6.55 13.05 0.44 0.80 0.59 0.55 3.25 4.25
117 RMA / m boareto + -- -- -- -- 0.10 0.76 0.64 0.26 1.64 0.14 0.10 0.08 0.10 0.07 0.82
118 RMA / m boareto + -- -- -- -- 0.10 0.76 0.64 0.26 1.64 0.14 0.10 0.08 0.10 0.07 0.82
119 mrma / m boareto + -- -- -- -- 0.42 0.80 0.81 5.98 10.47 0.22 0.41 0.24 0.52 0.43 1.04
120 RMA34 / m boareto + -- -- -- -- 0.10 0.76 0.64 0.26 1.64 0.14 0.10 0.08 0.10 0.07 0.82
121 RMA34 / m boareto + -- -- -- -- 0.62 0.80 0.81 17.56 11.97 0.32 0.61 0.36 0.52 1.18 1.71
122 RMAp / m boareto + -- -- -- -- 0.89 0.80 0.81 51.35 13.23 0.46 0.87 0.52 0.52 11.04 5.79
131 RPA / leo.lahti + -- -- -- -- 0.64 0.80 0.84 13.93 12.16 0.27 0.63 0.39 0.61 0.68 1.93
0 (perfection) 0.00 1.00 1.00 1.00 1.00 1.00 1.00 0.00 16.00 0.00 1.00 1.00 1.00 0.00 16.00
N Method / Submitter 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15

Back home