blob: 5c4a151520871822c7abce8ae8ee66e37d7580e2 (
plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
|
Classic baseline: task x backbone
| task | backbone | metric | n | val | test |
| --- | --- | --- | --- | --- | --- |
| ogbg-molhiv | appnp | rocauc | 1 | 0.7675 +/- 0.0000 | 0.7000 +/- 0.0000 |
| ogbg-molhiv | arma | rocauc | 1 | 0.7872 +/- 0.0000 | 0.7296 +/- 0.0000 |
| ogbg-molhiv | cheb | rocauc | 1 | 0.7831 +/- 0.0000 | 0.7282 +/- 0.0000 |
| ogbg-molhiv | film | rocauc | 1 | 0.7922 +/- 0.0000 | 0.7842 +/- 0.0000 |
| ogbg-molhiv | gatv2 | rocauc | 1 | 0.7835 +/- 0.0000 | 0.7563 +/- 0.0000 |
| ogbg-molhiv | gcn | rocauc | 1 | 0.7754 +/- 0.0000 | 0.7198 +/- 0.0000 |
| ogbg-molhiv | gen | rocauc | 1 | 0.7530 +/- 0.0000 | 0.7314 +/- 0.0000 |
| ogbg-molhiv | gin | rocauc | 1 | 0.8167 +/- 0.0000 | 0.7724 +/- 0.0000 |
| ogbg-molhiv | gine | rocauc | 1 | 0.7942 +/- 0.0000 | 0.7445 +/- 0.0000 |
| ogbg-molhiv | graphconv | rocauc | 1 | 0.7707 +/- 0.0000 | 0.7108 +/- 0.0000 |
| ogbg-molhiv | graphsage | rocauc | 1 | 0.7969 +/- 0.0000 | 0.7625 +/- 0.0000 |
| ogbg-molhiv | mf | rocauc | 1 | 0.7845 +/- 0.0000 | 0.7074 +/- 0.0000 |
| ogbg-molhiv | pna | rocauc | 1 | 0.7780 +/- 0.0000 | 0.7648 +/- 0.0000 |
| ogbg-molhiv | resgated | rocauc | 1 | 0.8144 +/- 0.0000 | 0.7242 +/- 0.0000 |
| ogbg-molhiv | sgc | rocauc | 1 | 0.7479 +/- 0.0000 | 0.7019 +/- 0.0000 |
| ogbg-molhiv | tag | rocauc | 1 | 0.7528 +/- 0.0000 | 0.7255 +/- 0.0000 |
| ogbg-molhiv | transformer | rocauc | 1 | 0.7617 +/- 0.0000 | 0.7547 +/- 0.0000 |
Delta vs matching classic
| task | backbone | compute | metric | n | val score (delta) | test score (delta) | steps |
| --- | --- | --- | --- | --- | --- | --- | --- |
| ogbg-molhiv | appnp | fixed-rrog | rocauc | 1 | 0.7203 (-0.0471) | 0.6825 (-0.0175) | |
| ogbg-molhiv | arma | fixed-rrog | rocauc | 1 | 0.7926 (0.0054) | 0.7318 (0.0021) | |
| ogbg-molhiv | cheb | fixed-rrog | rocauc | 1 | 0.7735 (-0.0096) | 0.7426 (0.0144) | |
| ogbg-molhiv | film | fixed-rrog | rocauc | 1 | 0.7633 (-0.0288) | 0.7728 (-0.0114) | |
| ogbg-molhiv | gatv2 | fixed-rrog | rocauc | 1 | 0.7835 (0.0001) | 0.7466 (-0.0096) | |
| ogbg-molhiv | gcn | fixed-rrog | rocauc | 1 | 0.7455 (-0.0300) | 0.7483 (0.0285) | |
| ogbg-molhiv | gen | fixed-rrog | rocauc | 1 | 0.8128 (0.0598) | 0.7631 (0.0318) | |
| ogbg-molhiv | gin | fixed-rrog | rocauc | 1 | 0.7524 (-0.0644) | 0.7324 (-0.0400) | |
| ogbg-molhiv | gine | fixed-rrog | rocauc | 1 | 0.7575 (-0.0368) | 0.7401 (-0.0044) | |
| ogbg-molhiv | graphconv | fixed-rrog | rocauc | 1 | 0.7713 (0.0006) | 0.6979 (-0.0129) | |
| ogbg-molhiv | graphsage | fixed-rrog | rocauc | 1 | 0.7587 (-0.0382) | 0.7641 (0.0016) | |
| ogbg-molhiv | mf | fixed-rrog | rocauc | 1 | 0.7931 (0.0085) | 0.7217 (0.0143) | |
| ogbg-molhiv | pna | fixed-rrog | rocauc | 1 | 0.7890 (0.0111) | 0.7630 (-0.0018) | |
| ogbg-molhiv | resgated | fixed-rrog | rocauc | 1 | 0.8174 (0.0030) | 0.7055 (-0.0187) | |
| ogbg-molhiv | sgc | fixed-rrog | rocauc | 1 | 0.7482 (0.0003) | 0.7177 (0.0158) | |
| ogbg-molhiv | tag | fixed-rrog | rocauc | 1 | 0.7804 (0.0276) | 0.7352 (0.0096) | |
| ogbg-molhiv | transformer | fixed-rrog | rocauc | 1 | 0.8088 (0.0471) | 0.7413 (-0.0134) | |
|
